tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-01 15:09:32 -04:00
Code Issues Packages Projects Releases Wiki Activity
Files
b4354
llama.cpp/examples
History
Georgi Gerganov 0e70ba686e server : add "tokens" output (#10853) 
* server : add "tokens" output

ggml-ci

* server : update readme

ggml-ci

* server : return tokens ids only if requested

ggml-ci

* tests : improve "tokens" type check

Co-authored-by: Xuan Son Nguyen <thichthat@gmail.com>

* server : remove "tokens" from the OAI endpoint

ggml-ci

---------

Co-authored-by: Xuan Son Nguyen <thichthat@gmail.com>
2024-12-18 11:05:29 +02:00
..
batched
sampling : refactor + optimize penalties sampler (#10803)
2024-12-16 12:31:14 +02:00
batched-bench
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
batched.swift
llama : llama_perf + option to disable timings during decode (#9355)
2024-09-13 09:53:38 +03:00
convert-llama2c-to-ggml
make : deprecate (#10514)
2024-12-02 21:22:53 +02:00
cvector-generator
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
deprecation-warning
Update deprecation-warning.cpp (#10619)
2024-12-04 23:19:20 +01:00
embedding
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
eval-callback
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
export-lora
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
gbnf-validator
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
gen-docs
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
gguf
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
gguf-hash
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
gguf-split
remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)
2024-12-12 19:02:49 +01:00
gritlm
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
imatrix
make : deprecate (#10514)
2024-12-02 21:22:53 +02:00
infill
readme : add option, update default value, fix formatting (#10271)
2024-12-03 12:50:08 +02:00
jeopardy
…
llama-bench
remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)
2024-12-12 19:02:49 +01:00
llama.android
llama : remove all_pos_0, all_pos_1, all_seq_id from llama_batch (#9745)
2024-10-18 23:18:01 +02:00
llama.swiftui
llama : use cmake for swift build (#10525)
2024-12-08 13:14:54 +02:00
llava
llava : Allow locally downloaded models for QwenVL (#10833)
2024-12-15 21:43:25 +01:00
lookahead
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
lookup
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
main
sampling : refactor + optimize penalties sampler (#10803)
2024-12-16 12:31:14 +02:00
main-cmake-pkg
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
parallel
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
passkey
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
perplexity
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
quantize
Update README.md (#10772)
2024-12-11 16:16:32 +01:00
quantize-stats
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
retrieval
remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)
2024-12-12 19:02:49 +01:00
rpc
ggml : move CPU backend to a separate file (#10144)
2024-11-03 19:34:08 +01:00
run
Opt class for positional argument handling (#10508)
2024-12-13 19:34:25 +01:00
save-load-state
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
server
server : add "tokens" output (#10853)
2024-12-18 11:05:29 +02:00
simple
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
simple-chat
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
speculative
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
speculative-simple
ggml : move AMX to the CPU backend (#10570)
2024-11-29 21:54:58 +01:00
sycl
[SYCL]set context default value to avoid memory issue, update guide (#9476)
2024-09-18 08:30:31 +08:00
tokenize
remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)
2024-12-12 19:02:49 +01:00
chat-13B.bat
…
chat-13B.sh
…
chat-persistent.sh
scripts : fix pattern and get n_tokens in one go (#10221)
2024-11-09 09:06:54 +02:00
chat-vicuna.sh
…
chat.sh
…
CMakeLists.txt
common : improve -ctv -ctk CLI arguments (#10806)
2024-12-12 22:53:05 +01:00
convert_legacy_llama.py
metadata: Detailed Dataset Authorship Metadata (#8875)
2024-11-13 21:10:38 +11:00
json_schema_pydantic_example.py
…
json_schema_to_grammar.py
grammar : fix JSON Schema for string regex with top-level alt. (#9903)
2024-10-16 19:03:24 +03:00
llama.vim
llama.vim : bump generation time limit to 3s [no ci]
2024-10-23 17:16:56 +03:00
llm.vim
…
Miku.sh
…
pydantic_models_to_grammar_examples.py
…
pydantic_models_to_grammar.py
…
reason-act.sh
…
regex_to_grammar.py
…
server_embd.py
…
server-llama2-13B.sh
…
ts-type-to-grammar.sh
…