tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-07-29 05:33:37 -04:00
Code Issues Packages Projects Releases Wiki Activity
279 Commits 472 Branches 4,045 Tags
6e7801d08d81c931a5427bae46f00763e993f54a
Commit Graph

2 Commits

Author SHA1 Message Date
Stephan Walter
c1f885067c ggml : introduce structs for the q4 data blocks (#356) 
* Introduce structs for the q4 data blocks

* ggml : rename quant struct variables + fix ARM_NEON

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-28 18:56:03 +03:00
Stephan Walter
69c92298a9 Deduplicate q4 quantization functions (#383) 
* Deduplicate q4 quantization functions

* Use const; add basic test

* Re-enable quantization test

* Disable AVX2 flags in CI

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-22 19:29:06 +02:00