llama.cpp/mmq-instance-iq2_xs.cu at a05e2afcc241c1ecd38ec5cb4c579d90cdf3f918 - llama.cpp - Cat's Mantra

tqcq/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-12 11:27:43 -04:00

Files

Johannes Gäßler 69c487f4ed CUDA: MMQ code deduplication + iquant support (#8495 )

* CUDA: MMQ code deduplication + iquant support

* 1 less parallel job for CI build

2024-07-20 22:25:26 +02:00

6 lines

140 B

Plaintext

Raw Blame History

 // This file has been autogenerated by generate_cu_files.py, do not edit manually.
 #include "../mmq.cuh"
 DECL_MMQ_CASE(GGML_TYPE_IQ2_XS);