tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-06-30 12:55:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

Allow passing grammar to completion endpoint (#2532)

Browse Source 
* Allow passing grammar to completion endpoint
This commit is contained in:
Martin Krasser
2023-08-08 15:29:19 +02:00
committed by GitHub
parent acfc5478ff
commit f5bfea0580
3 changed files with 61 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/server/README.md
View File

@ -151,6 +151,8 @@ node .
`mirostat_eta`: Set the Mirostat learning rate, parameter eta (default: 0.1).
`grammar`: Set grammar for grammar-based sampling (default: no grammar)
`seed`: Set the random number generator (RNG) seed (default: -1, -1 = random seed).
`ignore_eos`: Ignore end of stream token and continue generating (default: false).