tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-01 15:09:32 -04:00
Code Issues Packages Projects Releases Wiki Activity
2,809 Commits 471 Branches 4,078 Tags
acdce3cdef6fc2f0b7b5623231fd7762c0884d1c
Commit Graph

2 Commits

Author SHA1 Message Date
Ting Sun
87e21bbacd bench : make n_batch and n_ubatch configurable in Batched bench (#6500) 
* bench: make n_batch and n_ubatch configurable

* bench: update doc for batched bench
 2024-04-05 21:34:53 +03:00
Georgi Gerganov
8c70a5ff25 batched : add bench tool (#3545) 
* batched : add bench tool

* batched : minor fix table

* batched-bench : add readme + n_kv_max is now configurable

* batched-bench : init warm-up batch

* batched-bench : pass custom set of PP, TG and PL

* batched-bench : add mmq CLI arg
 2023-10-11 21:25:33 +03:00