Clauszy 06a92a193a server : fix cache reuse logic (#12161) ...

The first kv shift offsets the positions of all tokens after head_c.
When using llama_kv_cache_seq_rm next, using head_c will remove the valid tokens because their positions have already been offset.

2025-03-05 09:25:45 +02:00

..

batched

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

batched-bench

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

batched.swift

swift : fix llama-vocab api usage (#11645)

2025-02-04 13:15:24 +02:00

convert-llama2c-to-ggml

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

cvector-generator

repo : update links to new url (#11886)

2025-02-15 16:40:57 +02:00

deprecation-warning

…

embedding

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

eval-callback

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

export-lora

export-lora : fix tok_embd tensor (#11330)

2025-01-21 14:07:12 +01:00

gbnf-validator

Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639)

2025-01-30 19:13:58 +00:00

gen-docs

…

gguf

…

gguf-hash

…

gguf-split

ci : use -no-cnv in gguf-split tests (#11254)

2025-01-15 18:28:35 +02:00

gritlm

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

imatrix

examples: fix typo in imatrix/README.md (#11884)

2025-02-15 21:03:30 +02:00

infill

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

jeopardy

…

llama-bench

llama-bench : fix unexpected global variable initialize sequence issue (#11832)

2025-02-14 02:13:43 +01:00

llama.android

repo : update links to new url (#11886)

2025-02-15 16:40:57 +02:00

llama.swiftui

llama : add xcframework build script (#11996)

2025-03-05 06:30:31 +01:00

llava

Update granite vision docs for 3.2 model (#12105)

2025-02-28 11:31:47 +00:00

lookahead

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

lookup

repo : update links to new url (#11886)

2025-02-15 16:40:57 +02:00

main

main: allow preloading conversation with -p and add -st / --single-turn (#12145)

2025-03-04 12:19:39 -04:00

parallel

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

passkey

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

perplexity

Fix: Compile failure due to Microsoft STL breaking change (#11836)

2025-02-12 21:36:11 +01:00

quantize

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

quantize-stats

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

retrieval

repo : update links to new url (#11886)

2025-02-15 16:40:57 +02:00

rpc

…

run

Adding UTF-8 support to llama.cpp (#12111)

2025-03-03 12:44:56 +00:00

save-load-state

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

server

server : fix cache reuse logic (#12161)

2025-03-05 09:25:45 +02:00

simple

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

simple-chat

Add Jinja template support (#11016)

2025-01-21 13:18:51 +00:00

simple-cmake-pkg

repo : update links to new url (#11886)

2025-02-15 16:40:57 +02:00

speculative

repo : update links to new url (#11886)

2025-02-15 16:40:57 +02:00

speculative-simple

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

sycl

[SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035)

2025-02-24 22:33:23 +08:00

tokenize

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

tts

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

chat-13B.bat

…

chat-13B.sh

…

chat-persistent.sh

…

chat-vicuna.sh

…

chat.sh

…

CMakeLists.txt

…

convert_legacy_llama.py

…

json_schema_pydantic_example.py

…

json_schema_to_grammar.py

…

llama.vim

repo : update links to new url (#11886)

2025-02-15 16:40:57 +02:00

llm.vim

…

Miku.sh

…

pydantic_models_to_grammar_examples.py

repo : update links to new url (#11886)

2025-02-15 16:40:57 +02:00

pydantic_models_to_grammar.py

…

reason-act.sh

…

regex_to_grammar.py

…

server_embd.py

…

server-llama2-13B.sh

…

ts-type-to-grammar.sh

…