Xuan-Son Nguyen 64eda5deb9 convert : ability to lazy-load safetensors remotely without downloading to disk (#12820) ...

* gguf util : add SafetensorRemote

* fix style

* convert: add --remote option

* convert : allow using lazy remote tensors

It's a bit slow for now since everything is blocking and single-threaded.

* correct metadata.name

* small style fix

* support HF_TOKEN

* convert : use writeable buffer for remote lazy tensors

* convert : fix flake8 lint regarding lamdba assigment

* multithreaded download

* multithread: print debug

* fix style

* Revert "multithreaded download"

This reverts commit 42fc895ace.

* bring back _get_request_headers

---------

Co-authored-by: Francis Couture-Harpin <git@compilade.net>

2025-04-10 17:24:44 +02:00

..

scripts

…

__init__.py

…

constants.py

…

gguf_reader.py

…

gguf_writer.py

…

gguf.py

…

lazy.py

…

metadata.py

…

py.typed

…

quants.py

…

tensor_mapping.py

…

utility.py

convert : ability to lazy-load safetensors remotely without downloading to disk (#12820)

2025-04-10 17:24:44 +02:00

vocab.py

…