tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-07-31 22:53:52 -04:00
Code Issues Packages Projects Releases Wiki Activity

Refactor Vulkan backend to allow multiple contexts (#7961)

Browse Source 
* Refactor Vulkan backend to allow multiple contexts

* Fix too many shader groups called validation error in llama3 on AMD and Intel GPUs

* Fix Vulkan debug build error
This commit is contained in:
0cc4m
2024-06-23 10:21:25 +02:00
committed by GitHub
parent b5a5f34efa
commit 45c0e2e4c1
8 changed files with 21021 additions and 20675 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
vulkan-shaders/mul_mat_vec.comp
View File

@@ -13,7 +13,7 @@ layout (constant_id = 0) const uint BLOCK_SIZE = 32;
shared FLOAT_TYPE tmp[BLOCK_SIZE];
void main() {
const uint row = gl_WorkGroupID.x;
const uint row = gl_WorkGroupID.x + gl_NumWorkGroups.x * gl_WorkGroupID.z;
const uint tid = gl_LocalInvocationID.x;
uint a_offset, b_offset, d_offset;