tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-30 11:59:59 -04:00
Code Issues Packages Projects Releases Wiki Activity
Files
e5155e698645242d4f019267ecc40ea9bad81b09
llama.cpp/tools
History
Oleksandr Kuvshynov e5155e6986 server : export max observed n_past value (#15361) 
Add tracking for high watermark cache usage and make it available in /metrics endpoint.

Use-case: Tracking largest needed cache usage under realistic workload
to better understand memory requirements and be able to adjust
cache size/quantization for model/cache accordingly.
2025-08-18 00:28:58 +02:00
..
batched-bench
llama : add high-throughput mode (#14363)
2025-07-16 16:35:42 +03:00
cvector-generator
llama : deprecate llama_kv_self_ API (#14030)
2025-06-06 14:11:15 +03:00
export-lora
mtmd : fix 32-bit narrowing issue in export-lora and mtmd clip (#14503)
2025-07-25 13:08:04 +02:00
gguf-split
scripts : make the shell scripts cross-platform (#14341)
2025-06-30 10:17:18 +02:00
imatrix
imatrix : warn when GGUF imatrix is saved without .gguf suffix (#15076)
2025-08-04 23:26:52 +02:00
llama-bench
Fixed name -override-tensors to -override-tensor (#15129)
2025-08-06 17:28:48 +01:00
main
chat : include kwargs in template example (#15309)
2025-08-14 10:28:29 -07:00
mtmd
model : support vision LiquidAI LFM2-VL family (#15347)
2025-08-16 23:33:54 +02:00
perplexity
perplexity: give more information about constraints on failure (#15303)
2025-08-14 09:16:32 +03:00
quantize
llama : add gpt-oss (#15091)
2025-08-05 22:10:36 +03:00
rpc
…
run
cmake : do not search for curl libraries by ourselves (#14613)
2025-07-10 15:29:05 +03:00
server
server : export max observed n_past value (#15361)
2025-08-18 00:28:58 +02:00
tokenize
…
tts
…
CMakeLists.txt
…