tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-06-28 04:15:21 +00:00
Code Issues Packages Projects Releases Wiki Activity

Vulkan IQ4_NL Support (#8613)

Browse Source 
* Fix Vulkan matmul tests compile errors

* Add Vulkan IQ4_NL support

* Fix Vulkan DeepSeek-Coder-V2-Lite MoE support
This commit is contained in:
0cc4m
2024-07-23 10:56:49 +02:00
committed by GitHub
parent 46e47417aa
commit 751fcfc6c3
7 changed files with 222 additions and 193 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
ggml/src/vulkan-shaders/vulkan-shaders-gen.cpp
View File

@ -52,7 +52,8 @@ const std::vector<std::string> type_names = {
"q3_k",
"q4_k",
"q5_k",
"q6_k"
"q6_k",
"iq4_nl"
};
void execute_command(const std::string& command, std::string& stdout_str, std::string& stderr_str) {