Xuan Son Nguyen
cda0e4b648
llama : remove all_pos_0, all_pos_1, all_seq_id from llama_batch (#9745)
* refactor llama_batch_get_one
* adapt all examples
* fix simple.cpp
* fix llama_bench
* fix
* fix context shifting
* free batch before return
* use common_batch_add, reuse llama_batch in loop
* null terminated seq_id list
* fix save-load-state example
* fix perplexity
* correct token pos in llama_batch_allocr
2024-10-18 23:18:01 +02:00
..
2024-10-10 22:57:42 +02:00
2024-10-18 23:18:01 +02:00
2024-10-10 22:57:42 +02:00
2024-10-18 23:18:01 +02:00
2024-10-10 22:57:42 +02:00
2024-10-18 23:18:01 +02:00
2024-10-10 22:57:42 +02:00
2024-10-10 22:57:42 +02:00
2024-10-10 22:57:42 +02:00
2024-10-18 23:18:01 +02:00
2024-10-18 23:18:01 +02:00
2024-10-18 23:18:01 +02:00
2024-10-18 23:18:01 +02:00
2024-10-18 23:18:01 +02:00
2024-10-18 23:18:01 +02:00
2024-10-18 23:18:01 +02:00
2024-10-18 23:18:01 +02:00
2024-10-18 23:18:01 +02:00
2024-10-10 22:57:42 +02:00
2024-10-18 23:18:01 +02:00
2024-10-10 22:57:42 +02:00
2024-10-18 23:18:01 +02:00
2024-10-18 23:18:01 +02:00
2024-10-18 23:18:01 +02:00
2024-10-18 23:18:01 +02:00
2024-10-10 22:57:42 +02:00
2024-10-16 19:03:24 +03:00