mirror of
https://github.com/ggml-org/llama.cpp.git
synced 2025-06-26 19:55:04 +00:00
797f2ac062
* kv-cache : simplify the interface ggml-ci * context : revert llama_batch_allocr position change ggml-ci
llama.cpp/example/simple-chat
The purpose of this example is to demonstrate a minimal usage of llama.cpp to create a simple chat program using the chat template from the GGUF file.
./llama-simple-chat -m Meta-Llama-3.1-8B-Instruct.gguf -c 2048
...