tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-07-19 09:08:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
7051aacfac0057fa5fac9ea46c55bffc3892d810
llama.cpp/examples
History
Kawrakow 7051aacfac winogrande: evaluate log-probs in parallel (#5036) 
This is a relatively minor performance tweak resulting in
~10% speedup on my system.

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2024-01-19 11:39:11 +02:00
..
baby-llama
…
batched
…
batched-bench
llama : ggml-backend integration (#4766)
2024-01-12 20:07:38 +01:00
batched.swift
…
beam-search
…
benchmark
2-bit quantizations (#4897)
2024-01-14 09:45:56 +02:00
convert-llama2c-to-ggml
…
embedding
…
export-lora
…
finetune
finetune : add training data file to log message (#4979)
2024-01-16 19:54:24 +02:00
gguf
…
imatrix
imatrix : fix assert for src0 non-cont check
2024-01-18 21:45:51 +02:00
infill
…
jeopardy
…
llama-bench
llama : ggml-backend integration (#4766)
2024-01-12 20:07:38 +01:00
llama.android
android : introduce starter project example (#4926)
2024-01-16 15:47:34 +02:00
llama.swiftui
…
llava
…
lookahead
…
lookup
…
main
main : add parameter --no-display-prompt (#4541)
2024-01-13 18:09:08 +02:00
main-cmake-pkg
…
parallel
…
passkey
…
perplexity
winogrande: evaluate log-probs in parallel (#5036)
2024-01-19 11:39:11 +02:00
quantize
Add ability to use importance matrix for all k-quants (#4930)
2024-01-14 16:21:12 +02:00
quantize-stats
…
save-load-state
llama : minimize size used for state save/load (#4820)
2024-01-13 18:29:43 +02:00
server
server : defer tasks when "slot unavailable" (#5018)
2024-01-18 22:33:05 +02:00
simple
…
speculative
speculative : threading options (#4959)
2024-01-16 13:04:32 +02:00
tokenize
…
train-text-from-scratch
…
alpaca.sh
…
base-translate.sh
…
chat-13B.bat
…
chat-13B.sh
…
chat-persistent.sh
…
chat-vicuna.sh
…
chat.sh
…
CMakeLists.txt
metal : remove old API (#4919)
2024-01-13 20:45:45 +02:00
gpt4all.sh
…
json-schema-to-grammar.py
…
llama2-13b.sh
…
llama2.sh
…
llama.vim
…
llm.vim
…
make-ggml.py
…
Miku.sh
…
pydantic_models_to_grammar.py
examples : fix and improv docs for the grammar generator (#4909)
2024-01-16 14:10:48 +02:00
pydantic-models-to-grammar-examples.py
examples : add complete parallel function calling example (#4974)
2024-01-16 19:41:42 +02:00
reason-act.sh
…
server-llama2-13B.sh
…