tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-09-03 13:48:51 -04:00
Code Issues Packages Projects Releases Wiki Activity

sampling : refactor init to use llama_sampling_params (#3696)

Browse Source 
* sampling : refactor init to use llama_sampling_params

* llama : combine repetition, frequency and presence penalties in 1 call

* examples : remove embd-input and gptneox-wip

* sampling : rename penalty params + reduce size of "prev" vector

* sampling : add llama_sampling_print helper

* sampling : hide prev behind API and apply #3661

ggml-ci
This commit is contained in:
Georgi Gerganov
2023-10-20 21:07:23 +03:00
committed by GitHub
parent 8cf19d60dc
commit d1031cf49c
30 changed files with 365 additions and 4502 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
README.md
View File

@@ -962,7 +962,6 @@ docker run --gpus all -v /path/to/models:/models local/llama.cpp:light-cuda -m /
- [main](./examples/main/README.md)
- [server](./examples/server/README.md)
- [embd-input](./examples/embd-input/README.md)
- [jeopardy](./examples/jeopardy/README.md)
- [BLIS](./docs/BLIS.md)
- [Performance troubleshooting](./docs/token_generation_performance_tips.md)