Georgi Gerganov e093dd2382 tests : re-enable tokenizer tests (#8611) ...

* models : remove duplicated gpt-2 vocab

* models : remove old stablelm vocab

* tests : re-enable MPT tokenizer tests

* tests : re-enable DeepSeek tokenizer tests

* cmake : sort

ggml-ci

2024-07-22 13:32:49 +03:00

..

.gitignore

…

CMakeLists.txt

tests : re-enable tokenizer tests (#8611)

2024-07-22 13:32:49 +03:00

get-model.cpp

…

get-model.h

…

run-json-schema-to-grammar.mjs

…

test-autorelease.cpp

…

test-backend-ops.cpp

…

test-c.c

…

test-chat-template.cpp

…

test-double-float.cpp

…

test-grad0.cpp

…

test-grammar-integration.cpp

…

test-grammar-parser.cpp

…

test-json-schema-to-grammar.cpp

json: attempt to skip slow tests when running under emulator (#8189)

2024-06-28 18:02:05 +01:00

test-llama-grammar.cpp

…

test-model-load-cancel.cpp

…

test-opt.cpp

…

test-quantize-fns.cpp

…

test-quantize-perf.cpp

…

test-rope.cpp

…

test-sampling.cpp

…

test-tokenizer-0.cpp

…

test-tokenizer-0.py

…

test-tokenizer-0.sh

…

test-tokenizer-1-bpe.cpp

…

test-tokenizer-1-spm.cpp

…

test-tokenizer-random.py

…