David Huang 7f323a589f Add --no-op-offload to improve -ot pp perf in MoE models like llama4 400B (#13386)

2025-05-11 14:18:39 +02:00

..

.gitignore

…

CMakeLists.txt

mtmd : add C public API (#13184)

2025-05-04 23:43:42 +02:00

get-model.cpp

…

get-model.h

…

run-json-schema-to-grammar.mjs

llama : move end-user examples to tools directory (#13249)

2025-05-02 20:27:13 +02:00

test-arg-parser.cpp

common : add common_remote_get_content (#13123)

2025-04-26 22:58:12 +02:00

test-autorelease.cpp

…

test-backend-ops.cpp

sync : ggml (#13268)

2025-05-02 20:54:30 +03:00

test-barrier.cpp

…

test-c.c

…

test-chat-template.cpp

llama-chat : reset glmedge chat template (#13253)

2025-05-02 11:06:09 +02:00

test-chat.cpp

…

test-double-float.cpp

…

test-gbnf-validator.cpp

…

test-gguf.cpp

…

test-grammar-integration.cpp

…

test-grammar-llguidance.cpp

…

test-grammar-parser.cpp

…

test-json-schema-to-grammar.cpp

…

test-llama-grammar.cpp

…

test-log.cpp

…

test-lora-conversion-inference.sh

…

test-model-load-cancel.cpp

…

test-mtmd-c-api.c

mtmd : add C public API (#13184)

2025-05-04 23:43:42 +02:00

test-opt.cpp

Add --no-op-offload to improve -ot pp perf in MoE models like llama4 400B (#13386)

2025-05-11 14:18:39 +02:00

test-quantize-fns.cpp

…

test-quantize-perf.cpp

…

test-quantize-stats.cpp

docker : do not build tests (#13204)

2025-04-30 10:44:07 +02:00

test-rope.cpp

…

test-sampling.cpp

sampling : make top_n_sigma no-op at <=0 or a single candidate (#13345)

2025-05-06 22:36:24 +02:00

test-tokenizer-0.cpp

…

test-tokenizer-0.py

…

test-tokenizer-0.sh

…

test-tokenizer-1-bpe.cpp

…

test-tokenizer-1-spm.cpp

…

test-tokenizer-random.py

…