Georgi Gerganov a10b36c91a llama : refactor kv cache guard (#12695) ...

* llama : refactor kv cache guard

ggml-ci

* cont : fix comment [no ci]

* llama : fix kv_cache restore logic

ggml-ci

* context : simplify kv cache updates

ggml-ci

* cont : better name [no ci]

* llama : fix llama_decode return code when could not find KV slot

ggml-ci

* context : change log err -> warn [no ci]

* kv-cache : add comment + warning

2025-04-02 14:32:59 +03:00

..

batched

common : refactor downloading system, handle mmproj with -hf option (#12694)

2025-04-01 23:44:05 +02:00

batched-bench

common : refactor downloading system, handle mmproj with -hf option (#12694)

2025-04-01 23:44:05 +02:00

batched.swift

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

convert-llama2c-to-ggml

…

cvector-generator

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

deprecation-warning

…

embedding

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

eval-callback

…

export-lora

common : refactor downloading system, handle mmproj with -hf option (#12694)

2025-04-01 23:44:05 +02:00

gbnf-validator

…

gen-docs

…

gguf

…

gguf-hash

…

gguf-split

…

gritlm

common : refactor downloading system, handle mmproj with -hf option (#12694)

2025-04-01 23:44:05 +02:00

imatrix

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

infill

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

jeopardy

…

llama-bench

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

llama.android

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

llama.swiftui

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

llava

common : refactor downloading system, handle mmproj with -hf option (#12694)

2025-04-01 23:44:05 +02:00

lookahead

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

lookup

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

main

docs : bring llama-cli conversation/template docs up-to-date (#12426)

2025-03-17 21:14:32 +01:00

parallel

llama : refactor kv cache guard (#12695)

2025-04-02 14:32:59 +03:00

passkey

common : refactor downloading system, handle mmproj with -hf option (#12694)

2025-04-01 23:44:05 +02:00

perplexity

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

quantize

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

quantize-stats

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

retrieval

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

rpc

rpc : update README for cache usage (#12620)

2025-03-28 09:44:13 +02:00

run

run: de-duplicate fmt and format functions and optimize (#11596)

2025-03-25 18:46:11 +01:00

save-load-state

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

server

common : remove json.hpp from common.cpp (#12697)

2025-04-02 09:58:34 +02:00

simple

…

simple-chat

llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)

2025-03-13 12:35:44 +02:00

simple-cmake-pkg

…

speculative

common : refactor downloading system, handle mmproj with -hf option (#12694)

2025-04-01 23:44:05 +02:00

speculative-simple

common : refactor downloading system, handle mmproj with -hf option (#12694)

2025-04-01 23:44:05 +02:00

sycl

[SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035)

2025-02-24 22:33:23 +08:00

tokenize

…

tts

common : refactor downloading system, handle mmproj with -hf option (#12694)

2025-04-01 23:44:05 +02:00

chat-13B.bat

…

chat-13B.sh

…

chat-persistent.sh

…

chat-vicuna.sh

…

chat.sh

…

CMakeLists.txt

…

convert_legacy_llama.py

…

json_schema_pydantic_example.py

…

json_schema_to_grammar.py

tool-call: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)

2025-03-05 13:05:13 +00:00

llama.vim

…

llm.vim

…

Miku.sh

…

pydantic_models_to_grammar_examples.py

…

pydantic_models_to_grammar.py

…

reason-act.sh

…

regex_to_grammar.py

…

server_embd.py

…

server-llama2-13B.sh

…

ts-type-to-grammar.sh

…