tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-06-27 03:55:20 +00:00
Code Issues Packages Projects Releases Wiki Activity

main : add --in-suffix option (#1318)

Browse Source 
* adding --in-suffix option

* print input suffix before generation
This commit is contained in:
44670
2023-05-04 23:41:12 +08:00
committed by GitHub
parent 20fbf2a2a0
commit 2edbdb0f99
4 changed files with 25 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
examples/main/README.md
View File

@ -112,6 +112,14 @@ The `--in-prefix` flag is used to add a prefix to your input, primarily, this is
./main -r "User:" --in-prefix " "
```
### In-Suffix
The `--in-suffix` flag is used to add a suffix after your input. This is useful for adding an "Assistant:" prompt after the user's input. It's added after the new-line character (`\n`) that's automatically added to the end of the user's input. Here's an example of how to use the `--in-suffix` flag in conjunction with the `--reverse-prompt` flag:
```sh
./main -r "User:" --in-prefix " " --in-suffix "Assistant:"
```
### Instruction Mode
Instruction mode is particularly useful when working with Alpaca models, which are designed to follow user instructions for specific tasks: