Johannes Gäßler 658987cfc9 CUDA: noncont MMVQ + batched bs1 MUL_MAT_ID (#13014) ...

* CUDA: noncont MMVQ + batched bs1 MUL_MAT_ID

* fix logic for RoPE support, CUDA graphs

2025-04-22 21:27:40 +02:00

..

.gitignore

…

CMakeLists.txt

cmake : enable curl by default (#12761)

2025-04-07 13:35:19 +02:00

get-model.cpp

…

get-model.h

…

run-json-schema-to-grammar.mjs

…

test-arg-parser.cpp

common : refactor downloading system, handle mmproj with -hf option (#12694)

2025-04-01 23:44:05 +02:00

test-autorelease.cpp

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

test-backend-ops.cpp

CUDA: noncont MMVQ + batched bs1 MUL_MAT_ID (#13014)

2025-04-22 21:27:40 +02:00

test-barrier.cpp

…

test-c.c

…

test-chat-template.cpp

ci: detach common from the library (#12827)

2025-04-09 10:11:11 +02:00

test-chat.cpp

tool-call: fix non-tool-calling grammar crashes w/ Qwen / Hermes 2 templates (#12900)

2025-04-11 21:47:52 +02:00

test-double-float.cpp

…

test-gguf.cpp

cleanup: fix compile warnings associated with gnu_printf (#11811)

2025-02-12 10:06:53 -04:00

test-grammar-integration.cpp

sampling : support for llguidance grammars (#10224)

2025-02-02 09:55:32 +02:00

test-grammar-llguidance.cpp

upgrade to llguidance 0.7.10 (#12576)

2025-03-26 11:06:09 -07:00

test-grammar-parser.cpp

…

test-json-schema-to-grammar.cpp

tool-call: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)

2025-03-05 13:05:13 +00:00

test-llama-grammar.cpp

…

test-log.cpp

…

test-lora-conversion-inference.sh

ci : use -no-cnv in gguf-split tests (#11254)

2025-01-15 18:28:35 +02:00

test-model-load-cancel.cpp

…

test-opt.cpp

…

test-quantize-fns.cpp

tests : fix test-quantize-fns to init the CPU backend (#12306)

2025-03-10 14:07:15 +02:00

test-quantize-perf.cpp

…

test-rope.cpp

…

test-sampling.cpp

sampling: add Top-nσ sampler (#11223)

2025-02-13 08:45:57 +02:00

test-tokenizer-0.cpp

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

test-tokenizer-0.py

…

test-tokenizer-0.sh

…

test-tokenizer-1-bpe.cpp

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

test-tokenizer-1-spm.cpp

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

test-tokenizer-random.py

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00