tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-07-26 03:03:25 -04:00
Code Issues Packages Projects Releases Wiki Activity
Files
b1583
llama.cpp/examples
History
rhjdvsgsgks e2bd725f4b py : fix oai proxy (#3972) 
* fix oai proxy

fix generation not stoped while bot stop talking in chat mode

fix possible `slot_id` not exist

response for cors (and pre flight)

* oai proxy: workaround for some client (such as Chatbox)

* use stop as separator to replace hardcoded `\n`
2023-11-30 22:50:40 +02:00
..
baby-llama
…
batched
cuda : add batched cuBLAS GEMM for faster attention (#3749)
2023-10-24 16:48:37 +03:00
batched-bench
Extend llama_kv_cache_seq_rm to allow matching any sequence (#3843)
2023-10-29 11:31:40 -06:00
batched.swift
main.swift : fix eos checking (#4197)
2023-11-24 11:25:10 +02:00
beam-search
llama : remove token functions with context args in favor of model (#3720)
2023-10-23 22:40:03 +03:00
benchmark
sync : ggml (backend v2) (#3912)
2023-11-13 14:16:23 +02:00
convert-llama2c-to-ggml
gguf : support big endian platform (#3552)
2023-10-20 14:19:40 +03:00
embedding
build : link against build info instead of compiling against it (#3879)
2023-11-02 08:50:16 +02:00
export-lora
sync : ggml (backend v2) (#3912)
2023-11-13 14:16:23 +02:00
finetune
finetune - update readme to mention llama support only (#4148)
2023-11-20 19:30:00 +01:00
gguf
…
infill
main : Add ChatML functionality to main example (#4046)
2023-11-20 14:56:59 +01:00
jeopardy
parallel : add option to load external prompt file (#3416)
2023-10-06 16:16:38 +03:00
llama-bench
build : link against build info instead of compiling against it (#3879)
2023-11-02 08:50:16 +02:00
llama.swiftui
examples : iOS example with swift ui (#4159)
2023-11-27 16:56:52 +02:00
llava
llava : fix compilation warning that fread return value is not used (#4069)
2023-11-17 17:22:56 +02:00
lookahead
examples : add readme files
2023-11-29 11:00:17 +02:00
main
main : Add ChatML functionality to main example (#4046)
2023-11-20 14:56:59 +01:00
main-cmake-pkg
cmake : add missed dependencies (#3763)
2023-10-24 20:48:45 +03:00
metal
sync : ggml (backend v2) (#3912)
2023-11-13 14:16:23 +02:00
parallel
llama : KV cache view API + better KV cache management (#4170)
2023-11-23 19:07:56 +02:00
perplexity
Respect tokenizer.ggml.add_bos_token value when tokenizing (#4040)
2023-11-16 19:14:37 -07:00
quantize
build : link against build info instead of compiling against it (#3879)
2023-11-02 08:50:16 +02:00
quantize-stats
build : link against build info instead of compiling against it (#3879)
2023-11-02 08:50:16 +02:00
save-load-state
build : link against build info instead of compiling against it (#3879)
2023-11-02 08:50:16 +02:00
server
py : fix oai proxy (#3972)
2023-11-30 22:50:40 +02:00
simple
simple : fix batch handling (#3803)
2023-10-27 08:37:41 -06:00
speculative
examples : add readme files
2023-11-29 11:00:17 +02:00
tokenize
tokenize example: Respect normal add BOS token behavior (#4126)
2023-11-18 14:48:17 -07:00
train-text-from-scratch
sync : ggml (backend v2) (#3912)
2023-11-13 14:16:23 +02:00
alpaca.sh
…
chat-13B.bat
…
chat-13B.sh
…
chat-persistent.sh
…
chat-vicuna.sh
…
chat.sh
…
CMakeLists.txt
lookahead : add example for lookahead decoding (#4207)
2023-11-26 20:33:07 +02:00
gpt4all.sh
…
json-schema-to-grammar.py
…
llama2-13b.sh
…
llama2.sh
…
llama.vim
…
llm.vim
…
make-ggml.py
…
Miku.sh
…
reason-act.sh
…
server-llama2-13B.sh
…