tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-06-27 12:05:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
74a6d922f12ccfe16b0c265f43be8978c6f25e98
llama.cpp/examples/quantize
History
Kerfuffle 4f0154b0ba llama : support requantizing models instead of only allowing quantization from 16/32bit (#1691) 
* Add support for quantizing already quantized models

* Threaded dequantizing and f16 to f32 conversion

* Clean up thread blocks with spares calculation a bit

* Use std::runtime_error exceptions.
2023-06-10 10:59:17 +03:00
..
CMakeLists.txt
Add git-based build information for better issue tracking (#1232)
2023-05-01 18:23:47 +02:00
quantize.cpp
llama : support requantizing models instead of only allowing quantization from 16/32bit (#1691)
2023-06-10 10:59:17 +03:00
README.md
Overhaul the examples structure
2023-03-25 20:26:40 +02:00

README.md

quantize

TODO