llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-07-21 18:28:31 +00:00

Files

oobabooga 233461f812 sampling : Integrate Top-nσ into main sampling chain (and add it to the server) (#13264 )

* sampling: add Top-nσ sampler to `llama-server` and sampler ordering

* revert: sampler ordering

* revert: VS' crappy auto-formatting

* revert: VS' crappy auto-formatting pt.2

* revert: my crappy eye sight...

* sampling: add XTC to Top-nσ sampler chain

* sampling: add Dyna. Temp. to Top-nσ sampler chain

* sampling: actually remove Top-nσ from sampler(oops)

* Integrate top_n_sigma into main sampler chain

* Define COMMON_SAMPLER_TYPE_TOP_N_SIGMA

* Formatting

* Lint

* Exit early in the sampler if nsigma < 0

---------

Co-authored-by: CasualAutopsy <casual_autopsy@outlook.com>

2025-05-05 22:12:19 +02:00

batched-bench

llama : move end-user examples to tools directory (#13249 )

2025-05-02 20:27:13 +02:00

cvector-generator

llama : move end-user examples to tools directory (#13249 )

2025-05-02 20:27:13 +02:00

export-lora

llama : move end-user examples to tools directory (#13249 )

2025-05-02 20:27:13 +02:00

gguf-split

llama : move end-user examples to tools directory (#13249 )