tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-07-28 13:20:27 -04:00
Code Issues Packages Projects Releases Wiki Activity
306 Commits 470 Branches 4,044 Tags
f2d1c472946dee2aba9077e8df73346796752b10
Commit Graph

2 Commits

Author SHA1 Message Date
Stephan Walter
c1f885067c ggml : introduce structs for the q4 data blocks (#356) 
* Introduce structs for the q4 data blocks

* ggml : rename quant struct variables + fix ARM_NEON

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-28 18:56:03 +03:00
Stephan Walter
69c92298a9 Deduplicate q4 quantization functions (#383) 
* Deduplicate q4 quantization functions

* Use const; add basic test

* Re-enable quantization test

* Disable AVX2 flags in CI

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-03-22 19:29:06 +02:00