mirror of
https://github.com/ggml-org/llama.cpp.git
synced 2025-07-05 22:53:45 +00:00
03fb8a002d
This will reproduce the issue in llama13b
{
'prompt': 'Q: hello world \nA: ',
'stop': ['\n'],
'temperature': 0.0,
'n_predict': 10,
'cache_prompt': True,
'n_probs': 10
}