tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-07-30 06:03:37 -04:00
Code Issues Packages Projects Releases Wiki Activity

scripts: benchmark for HTTP server throughput (#14668)

Browse Source 
* scripts: benchmark for HTTP server throughput

* fix server connection reset
This commit is contained in:
Johannes Gäßler
2025-07-14 13:14:30 +02:00
committed by GitHub
parent 0f4c6ec0f1
commit 494c5899cb
4 changed files with 218 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
requirements/requirements-all.txt
View File

@@ -3,6 +3,7 @@
-r ../tools/server/tests/requirements.txt
-r ./requirements-compare-llama-bench.txt
-r ./requirements-server-bench.txt
-r ./requirements-pydantic.txt
-r ./requirements-test-tokenizer-random.txt

5
requirements/requirements-server-bench.txt Normal file
View File

@@ -0,0 +1,5 @@
datasets~=3.2.0
matplotlib~=3.10.0
numpy~=1.26.4
requests~=2.32.3
tqdm~=4.67.1