llama.cpp/speculative at 0a5eebb45d5697127b84418576dc479c400c4b3d - llama.cpp - Cat's Mantra

tqcq/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-07-27 11:43:35 -04:00

Files

History

FK 84e723653c speculative: add --n-gpu-layers-draft option (#3063 )

2023-09-13 08:50:46 +02:00

..

CMakeLists.txt

speculative : PoC for speeding-up inference via speculative sampling (#2926 )

2023-09-03 15:12:08 +03:00

speculative.cpp

speculative: add --n-gpu-layers-draft option (#3063 )

2023-09-13 08:50:46 +02:00