Xuan Son Nguyen 26a39bbd6b Add MiniCPM, Deepseek V2 chat template + clean up llama_chat_apply_template_internal (#8172) ...

* tmp_contains

* minicpm chat template

* add DeepSeek Lite template

* change deepseek-lite to deepseek2

* correct code comment

* correct code from master branch

2024-06-28 15:11:44 +02:00

..

.gitignore

tests : gitignore ggml-common.h

2024-03-09 14:17:11 +02:00

CMakeLists.txt

ggml : fix loongson compile warnings (#7537)

2024-05-31 14:17:10 +03:00

get-model.cpp

…

get-model.h

…

run-json-schema-to-grammar.mjs

json-schema-to-grammar improvements (+ added to server) (#5978)

2024-03-21 11:50:43 +00:00

test-autorelease.cpp

…

test-backend-ops.cpp

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

test-c.c

…

test-chat-template.cpp

Add MiniCPM, Deepseek V2 chat template + clean up llama_chat_apply_template_internal (#8172)

2024-06-28 15:11:44 +02:00

test-double-float.cpp

…

test-grad0.cpp

ggml : refactor rope norm/neox (#7634)

2024-06-05 11:29:20 +03:00

test-grammar-integration.cpp

json: restore default additionalProperties to false, fix some pattern escapes (#8180)

2024-06-28 09:26:45 +01:00

test-grammar-parser.cpp

grammars: x{min,max} repetition operator (#6640)

2024-06-06 10:07:06 +01:00

test-json-schema-to-grammar.cpp

json: restore default additionalProperties to false, fix some pattern escapes (#8180)

2024-06-28 09:26:45 +01:00

test-llama-grammar.cpp

llama : return nullptr from llama_grammar_init (#8093)

2024-06-25 15:07:28 -04:00

test-model-load-cancel.cpp

…

test-opt.cpp

…

test-quantize-fns.cpp

tests : include IQ2_XXS and IQ2_XS in test-quantize-fns (#6303)

2024-03-25 19:33:15 +02:00

test-quantize-perf.cpp

…

test-rope.cpp

ggml : refactor rope norm/neox (#7634)

2024-06-05 11:29:20 +03:00

test-sampling.cpp

…

test-tokenizer-0.cpp

tests : add test-tokenizer-0.sh + fix some tokenizers (#7036)

2024-05-04 08:32:32 +03:00

test-tokenizer-0.py

py : logging and flake8 suppression refactoring (#7081)

2024-05-05 08:07:48 +03:00

test-tokenizer-0.sh

tests : fix test-tokenizer-0.sh

2024-05-28 15:04:09 +03:00

test-tokenizer-1-bpe.cpp

llama : lookup word in vocab before doing BPE merges (#7193)

2024-05-11 11:12:06 +03:00

test-tokenizer-1-spm.cpp

llama : fix BPE pre-tokenization (#6920)

2024-04-29 16:58:41 +03:00

test-tokenizer-random.py

tokenizer : BPE fixes (#7530)

2024-06-18 18:40:52 +02:00