tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-09 18:40:20 -04:00
Code Issues Packages Projects Releases Wiki Activity
Files
482548716f664f76e325ded58c9e8b7563e5e23a
llama.cpp/models
History
Xuan-Son Nguyen 07e4351ce6 convert : allow partial update to the chkhsh pre-tokenizer list (#13847) 
* convert : allow partial update to the chkhsh pre-tokenizer list

* code style

* update tokenizer out

* rm inp/out files for models not having gguf

* fixed hash for glm

* skip nomic-bert-moe test

* Update convert_hf_to_gguf_update.py

* fix minerva-7b hash

* rm redundant import
2025-05-30 12:24:37 +02:00
..
templates
…
.editorconfig
…
ggml-vocab-aquila.gguf
…
ggml-vocab-baichuan.gguf
Add more tokenizer tests (#3742)
2023-10-24 09:17:17 +02:00
ggml-vocab-bert-bge.gguf
…
ggml-vocab-bert-bge.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-bert-bge.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-command-r.gguf
…
ggml-vocab-command-r.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-command-r.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-deepseek-coder.gguf
…
ggml-vocab-deepseek-coder.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-deepseek-coder.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-deepseek-llm.gguf
…
ggml-vocab-deepseek-llm.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-deepseek-llm.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-falcon.gguf
llama : fix BPE pre-tokenization (#6920)
2024-04-29 16:58:41 +03:00
ggml-vocab-falcon.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-falcon.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-gpt-2.gguf
…
ggml-vocab-gpt-2.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-gpt-2.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-gpt-neox.gguf
…
ggml-vocab-llama-bpe.gguf
…
ggml-vocab-llama-bpe.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-llama-bpe.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-llama-spm.gguf
llama : fix BPE pre-tokenization (#6920)
2024-04-29 16:58:41 +03:00
ggml-vocab-llama-spm.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-llama-spm.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-mpt.gguf
…
ggml-vocab-mpt.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-mpt.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-nomic-bert-moe.gguf
…
ggml-vocab-phi-3.gguf
…
ggml-vocab-phi-3.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-phi-3.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-qwen2.gguf
…
ggml-vocab-qwen2.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-qwen2.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-refact.gguf
…
ggml-vocab-refact.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-refact.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-starcoder.gguf
…
ggml-vocab-starcoder.gguf.inp
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00
ggml-vocab-starcoder.gguf.out
convert : allow partial update to the chkhsh pre-tokenizer list (#13847)
2025-05-30 12:24:37 +02:00