Files
llama.cpp/examples/parallel

llama.cpp/example/parallel

Simplified simulation of serving incoming requests in parallel