llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-14 12:19:48 -04:00

Files

Daniel Bevenius 36d3f00e14 requirements : fix PyTorch uint64 compatibility (#15134 )

This commit addresses an issue with the convert_hf_to_gguf script
which is currently failing with:
```console
AttributeError: module 'torch' has no attribute 'uint64'
```

This occurred because safetensors expects torch.uint64 to be available
in the public API, but PyTorch 2.2.x only provides limited support for
unsigned types beyond uint8 it seems. The torch.uint64 dtype exists but
is not exposed in the standard torch namespace
(see pytorch/pytorch#58734).

PyTorch 2.4.0 properly exposes torch.uint64 in the public API, resolving
the compatibility issue with safetensors. This also required torchvision
to updated to =0.19.0 for compatibility.

Refs: https://huggingface.co/spaces/ggml-org/gguf-my-repo/discussions/186#68938de803e47d990aa087fb
Refs: https://github.com/pytorch/pytorch/issues/58734

2025-08-07 05:31:48 +02:00

requirements-all.txt

scripts: benchmark for HTTP server throughput (#14668 )

2025-07-14 13:14:30 +02:00

requirements-compare-llama-bench.txt

compare-llama-bench: add option to plot (#14169 )

2025-06-14 10:34:20 +02:00

requirements-convert_hf_to_gguf_update.txt

ci : check that pre-tokenizer hashes are up-to-date (#15032 )

2025-08-02 14:39:01 +02:00

requirements-convert_hf_to_gguf.txt

requirements : fix PyTorch uint64 compatibility (#15134 )