llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-27 10:38:56 -04:00

Files

Radoslav Gerganov c556418b60 llama-bench : use local GPUs along with RPC servers (#14917 )

Currently if RPC servers are specified with '--rpc' and there is a local
GPU available (e.g. CUDA), the benchmark will be performed only on the
RPC device(s) but the backend result column will say "CUDA,RPC" which is
incorrect. This patch is adding all local GPU devices and makes
llama-bench consistent with llama-cli.

2025-07-28 18:59:04 +03:00

batched-bench

llama : add high-throughput mode (#14363 )

2025-07-16 16:35:42 +03:00

cvector-generator

llama : deprecate llama_kv_self_ API (#14030 )

2025-06-06 14:11:15 +03:00

export-lora

mtmd : fix 32-bit narrowing issue in export-lora and mtmd clip (#14503 )

2025-07-25 13:08:04 +02:00

gguf-split

scripts : make the shell scripts cross-platform (#14341 )