tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-06-27 03:55:20 +00:00
Code Issues Packages Projects Releases Wiki Activity

examples : add passkey test (#3856)

Browse Source 
* examples : add passkey test

* passkey : better prints

* passkey : select pass key pos from CLI

* passkey : simplify n_past logic

* make : add passkey target

* passkey : add "self-extend"-like context extension (#4810)

* llama : "self-extend"-like context extension

* passkey : add comment

* passkey : add readme
This commit is contained in:
Georgi Gerganov
2024-01-08 11:14:04 +02:00
committed by GitHub
parent b7e7982953
commit b0034d93ce
9 changed files with 361 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/batched/batched.cpp
View File

@ -69,6 +69,7 @@ int main(int argc, char ** argv) {
std::vector<llama_token> tokens_list;
tokens_list = ::llama_tokenize(model, params.prompt, true);
const int n_kv_req = tokens_list.size() + (n_len - tokens_list.size())*n_parallel;
// initialize the context