tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-19 22:36:13 -04:00
Code Issues Packages Projects Releases Wiki Activity

main: allow preloading conversation with -p and add -st / --single-turn (#12145)

Browse Source 
* Add chat template formatting to -no-cnv

* only enable prompt formatting if explicitly enabled

* add -st / --single-turn

* add --single-turn and -p in conversation mode

* fix -sys + -p

* reword warning

* small readability change and fix (long) outdated example usage

* only activate single turn in conversation mode
This commit is contained in:
Sigbjørn Skjæret
2025-03-04 17:19:39 +01:00
committed by GitHub
parent 1a24c4621f
commit 56d7a9f812
3 changed files with 52 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
common/common.h
View File

@@ -328,6 +328,8 @@ struct common_params {
bool warmup = true; // warmup run
bool check_tensors = false; // validate tensor data
bool single_turn = false; // single turn chat conversation
ggml_type cache_type_k = GGML_TYPE_F16; // KV cache data type for the K
ggml_type cache_type_v = GGML_TYPE_F16; // KV cache data type for the V