tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-09-18 05:05:24 -04:00
Code Issues Packages Projects Releases Wiki Activity
4,469 Commits 495 Branches 4,381 Tags
82caffa74e4e101df3adba878ecb99f6e25e3d84
Commit Graph

52 Commits

Author SHA1 Message Date
unbounded
62cfc54f77 Add quantize-stats command for testing quantization (#728) 
Command that calculates some statistics over the errors introduced by
quantization, like mean square error, max error and some percentile errors for layer
weights. Should be useful for testing quantization improvements.

Exposes some internal state from ggml and llama for testing
 2023-04-08 00:09:18 +02:00
Georgi Gerganov
a316a425d0 Overhaul the examples structure 
- main -> examples
- utils -> examples (renamed to "common")
- quantize -> examples
- separate tools for "perplexity" and "embedding"

Hope I didn't break something !
 2023-03-25 20:26:40 +02:00