jaime-m-p b43272afa2 Unicode codepoint flags for custom regexs (#7245) ...

* Replace CODEPOINT_TYPE_* with codepoint_flags
* Update and bugfix brute force random test
* Deterministic brute force random test
* Unicode normalization NFD
* Get rid of BOM

2024-05-18 01:09:13 +02:00

..

build-info.cmake

…

build-info.sh

…

check-requirements.sh

llama : fix BPE pre-tokenization (#6920)

2024-04-29 16:58:41 +03:00

ci-run.sh

…

compare-commits.sh

ggml : group all experts in a single ggml_mul_mat_id (#6505)

2024-04-18 15:18:48 +02:00

compare-llama-bench.py

llama-bench : add pp+tg test type (#7199)

2024-05-10 18:03:54 +02:00

convert-gg.sh

…

debug-test.sh

Added a single test function script and fix debug-test.sh to be more robust (#7279)

2024-05-17 22:40:14 +10:00

gen-authors.sh

license : update copyright notice + add AUTHORS (#6405)

2024-04-09 09:23:19 +03:00

gen-build-info-cpp.cmake

…

gen-unicode-data.py

Unicode codepoint flags for custom regexs (#7245)

2024-05-18 01:09:13 +02:00

get-flags.mk

build : pass all warning flags to nvcc via -Xcompiler (#5570)

2024-02-18 16:21:52 -05:00

get-hellaswag.sh

…

get-pg.sh

…

get-wikitext-2.sh

model: support arch DbrxForCausalLM (#6515)

2024-04-13 11:33:52 +02:00

get-wikitext-103.sh

lookup: complement data from context with general text statistics (#5479)

2024-03-23 01:24:36 +01:00

get-winogrande.sh

…

hf.sh

scripts : add --outdir option to hf.sh (#6600)

2024-04-11 16:22:47 +03:00

install-oneapi.bat

…

LlamaConfig.cmake.in

cuda : rename build flag to LLAMA_CUDA (#6299)

2024-03-26 01:16:01 +01:00

pod-llama.sh

cuda : rename build flag to LLAMA_CUDA (#6299)

2024-03-26 01:16:01 +01:00

qnt-all.sh

…

run-all-perf.sh

…

run-all-ppl.sh

…

run-with-preset.py

convert.py : add python logging instead of print() (#6511)

2024-05-03 22:36:41 +03:00

server-llm.sh

cuda : rename build flag to LLAMA_CUDA (#6299)

2024-03-26 01:16:01 +01:00

sync-ggml-am.sh

script : sync ggml-rpc

2024-05-14 19:14:38 +03:00

sync-ggml.last

sync : ggml

2024-05-15 13:23:41 +03:00

sync-ggml.sh

script : sync ggml-rpc

2024-05-14 19:14:38 +03:00

verify-checksum-models.py

convert.py : add python logging instead of print() (#6511)

2024-05-03 22:36:41 +03:00

xxd.cmake

build: generate hex dump of server assets during build (#6661)

2024-04-21 18:48:53 +01:00