tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-20 06:36:48 -04:00
Code Issues Packages Projects Releases Wiki Activity

Add chatml fallback for cpp llama_chat_apply_template (#8160)

Browse Source 
* add chatml fallback for cpp `llama_chat_apply_template`

* remove redundant code
This commit is contained in:
Xuan Son Nguyen
2024-06-27 18:14:19 +02:00
committed by GitHub
parent ab3679112d
commit 16791b8f0b
2 changed files with 20 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
common/common.h
View File

@@ -380,6 +380,8 @@ struct llama_chat_msg {
bool llama_chat_verify_template(const std::string & tmpl);
// CPP wrapper for llama_chat_apply_template
// If the built-in template is not supported, we default to chatml
// If the custom "tmpl" is not supported, we throw an error
std::string llama_chat_apply_template(const struct llama_model * model,
const std::string & tmpl,
const std::vector<llama_chat_msg> & chat,