llama.cpp/speculative at 84e723653ca99d51a74b454984acf2c077468561 - llama.cpp - Cat's Mantra

tqcq/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-06-28 04:15:21 +00:00

Files

History

FK 84e723653c speculative: add --n-gpu-layers-draft option (#3063 )

2023-09-13 08:50:46 +02:00

..

CMakeLists.txt

speculative : PoC for speeding-up inference via speculative sampling (#2926 )

2023-09-03 15:12:08 +03:00

speculative.cpp

speculative: add --n-gpu-layers-draft option (#3063 )

2023-09-13 08:50:46 +02:00