Georgi Gerganov ce4a7b8493 server : various fixes (#10704) ...

* server : various fixes

ggml-ci

* server : show curent seed in slot_params

ggml-ci

* fix /slots endpoint

* Update examples/server/server.cpp

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

* server : reflect endpoint response changes in the readme

ggml-ci

---------

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
Co-authored-by: Xuan Son Nguyen <thichthat@gmail.com>

2024-12-07 18:02:05 +02:00

..

batched

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

batched-bench

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

batched.swift

…

convert-llama2c-to-ggml

make : deprecate (#10514)

2024-12-02 21:22:53 +02:00

cvector-generator

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

deprecation-warning

Update deprecation-warning.cpp (#10619)

2024-12-04 23:19:20 +01:00

embedding

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

eval-callback

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

export-lora

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

gbnf-validator

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

gen-docs

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

gguf

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

gguf-hash

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

gguf-split

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

gritlm

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

imatrix

make : deprecate (#10514)

2024-12-02 21:22:53 +02:00

infill

readme : add option, update default value, fix formatting (#10271)

2024-12-03 12:50:08 +02:00

jeopardy

…

llama-bench

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

llama.android

…

llama.swiftui

…

llava

clip : add sycl support (#10574)

2024-12-04 01:26:37 +01:00

lookahead

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

lookup

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

main

readme : add option, update default value, fix formatting (#10271)

2024-12-03 12:50:08 +02:00

main-cmake-pkg

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

parallel

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

passkey

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

perplexity

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

quantize

ggml : refactor online repacking (#10446)

2024-12-07 14:37:50 +02:00

quantize-stats

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

retrieval

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

rpc

…

run

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

save-load-state

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

server

server : various fixes (#10704)

2024-12-07 18:02:05 +02:00

simple

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

simple-chat

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

speculative

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

speculative-simple

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

sycl

…

tokenize

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

chat-13B.bat

…

chat-13B.sh

…

chat-persistent.sh

…

chat-vicuna.sh

…

chat.sh

…

CMakeLists.txt

…

convert_legacy_llama.py

…

json_schema_pydantic_example.py

…

json_schema_to_grammar.py

…

llama.vim

…

llm.vim

…

Miku.sh

…

pydantic_models_to_grammar_examples.py

…

pydantic_models_to_grammar.py

…

reason-act.sh

…

regex_to_grammar.py

…

server_embd.py

…

server-llama2-13B.sh

…

ts-type-to-grammar.sh

…