Behnam M cd108e641d server : add a /health endpoint (#4860) ...

* added /health endpoint to the server

* added comments on the additional /health endpoint

* Better handling of server state

When the model is being loaded, the server state is `LOADING_MODEL`. If model-loading fails, the server state becomes `ERROR`, otherwise it becomes `READY`. The `/health` endpoint provides more granular messages now according to the server_state value.

* initialized server_state

* fixed a typo

* starting http server before initializing the model

* Update server.cpp

* Update server.cpp

* fixes

* fixes

* fixes

* made ServerState atomic and turned two-line spaces into one-line

2024-01-10 21:56:05 +02:00

..

baby-llama

ggml : change ggml_scale to take a float instead of tensor (#4573)

2023-12-21 23:20:49 +02:00

batched

examples : add passkey test (#3856)

2024-01-08 11:14:04 +02:00

batched-bench

…

batched.swift

…

beam-search

…

benchmark

ggml : add ggml_row_size() (fixes llama out of space) (#4461)

2023-12-14 14:13:33 +02:00

convert-llama2c-to-ggml

ggml : remove n_dims from ggml_tensor (#4469)

2023-12-14 16:52:08 +01:00

embedding

…

export-lora

ggml : change ggml_scale to take a float instead of tensor (#4573)

2023-12-21 23:20:49 +02:00

finetune

finetune : remove unused includes (#4756)

2024-01-04 21:45:37 +02:00

gguf

gguf : simplify example dependencies

2023-12-21 23:08:14 +02:00

infill

…

jeopardy

…

llama-bench

llama-bench : add no-kv-offload parameter (#4812)

2024-01-07 17:59:01 +01:00

llama.swiftui

llama.swiftui : update readme

2024-01-08 15:57:36 +02:00

llava

clip : support more quantization types (#4846)

2024-01-10 15:37:09 +02:00

lookahead

english : use typos to fix comments and logs (#4354)

2023-12-12 11:53:36 +02:00

lookup

lookup : add prompt lookup decoding example (#4484)

2023-12-22 18:05:56 +02:00

main

main : add self-extend support (#4815)

2024-01-08 11:18:32 +02:00

main-cmake-pkg

main-cmake-pkg : fix build issue (#4665)

2023-12-29 16:18:20 +02:00

metal

…

parallel

…

passkey

examples : add passkey test (#3856)

2024-01-08 11:14:04 +02:00

perplexity

…

quantize

…

quantize-stats

llama : per-layer KV cache + quantum K cache (#4309)

2023-12-07 13:03:17 +02:00

save-load-state

…

server

server : add a /health endpoint (#4860)

2024-01-10 21:56:05 +02:00

simple

simple : update error message for KV cache check (#4324)

2023-12-04 18:04:21 +02:00

speculative

english : use typos to fix comments and logs (#4354)

2023-12-12 11:53:36 +02:00

tokenize

…

train-text-from-scratch

ggml : change ggml_scale to take a float instead of tensor (#4573)

2023-12-21 23:20:49 +02:00

alpaca.sh

…

base-translate.sh

examples : improve base-translate.sh script (#4783)

2024-01-06 11:40:24 +02:00

chat-13B.bat

…

chat-13B.sh

…

chat-persistent.sh

…

chat-vicuna.sh

…

chat.sh

…

CMakeLists.txt

examples : add passkey test (#3856)

2024-01-08 11:14:04 +02:00

gpt4all.sh

…

json-schema-to-grammar.py

…

llama2-13b.sh

…

llama2.sh

…

llama.vim

…

llm.vim

…

make-ggml.py

…

Miku.sh

…

reason-act.sh

…

server-llama2-13B.sh

…