Johannes Gäßler 5fa07c2f93 CUDA: optimize FA for GQA + large batches (#12014)

2025-02-22 12:20:17 +01:00

..

.gitignore

…

CMakeLists.txt

sampling : support for llguidance grammars (#10224)

2025-02-02 09:55:32 +02:00

get-model.cpp

…

get-model.h

…

run-json-schema-to-grammar.mjs

…

test-arg-parser.cpp

…

test-autorelease.cpp

…

test-backend-ops.cpp

CUDA: optimize FA for GQA + large batches (#12014)

2025-02-22 12:20:17 +01:00

test-barrier.cpp

…

test-c.c

…

test-chat-template.cpp

tool-call: refactor common chat / tool-call api (+ tests / fixes) (#11900)

2025-02-18 18:03:23 +00:00

test-chat.cpp

tool-call: refactor common chat / tool-call api (+ tests / fixes) (#11900)

2025-02-18 18:03:23 +00:00

test-double-float.cpp

…

test-gguf.cpp

cleanup: fix compile warnings associated with gnu_printf (#11811)

2025-02-12 10:06:53 -04:00

test-grammar-integration.cpp

sampling : support for llguidance grammars (#10224)

2025-02-02 09:55:32 +02:00

test-grammar-llguidance.cpp

sampling : support for llguidance grammars (#10224)

2025-02-02 09:55:32 +02:00

test-grammar-parser.cpp

…

test-json-schema-to-grammar.cpp

sampling : support for llguidance grammars (#10224)

2025-02-02 09:55:32 +02:00

test-llama-grammar.cpp

…

test-log.cpp

…

test-lora-conversion-inference.sh

ci : use -no-cnv in gguf-split tests (#11254)

2025-01-15 18:28:35 +02:00

test-model-load-cancel.cpp

…

test-opt.cpp

…

test-quantize-fns.cpp

…

test-quantize-perf.cpp

…

test-rope.cpp

…

test-sampling.cpp

sampling: add Top-nσ sampler (#11223)

2025-02-13 08:45:57 +02:00

test-tokenizer-0.cpp

…

test-tokenizer-0.py

…

test-tokenizer-0.sh

…

test-tokenizer-1-bpe.cpp

…

test-tokenizer-1-spm.cpp

…

test-tokenizer-random.py

…