0cc4m 5fd89a70ea Vulkan Optimizations and Fixes (#8959) ...

* Optimize Vulkan REPEAT performance

* Use Vulkan GLSL fused multiply-add instruction where possible

* Add GGML_VULKAN_PERF option to output performance data per operator

* Rework and fix Vulkan descriptor set and descriptor pool handling

* Fix float32 concat f16 shader validation error

* Add Vulkan GROUP_NORM eps parameter

* Fix validation error with transfer queue memory barrier flags

* Remove trailing whitespaces

2024-08-14 18:32:53 +02:00

..

add.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

argsort.comp

…

clamp.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

CMakeLists.txt

cmake : Link vulkan-shaders-gen with pthreads (#8835)

2024-08-06 15:21:47 +02:00

concat.comp

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00

copy.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

dequant_f32.comp

…

dequant_funcs.comp

Vulkan IQ4_NL Support (#8613)

2024-07-23 10:56:49 +02:00

dequant_head.comp

…

dequant_iq4_nl.comp

Vulkan IQ4_NL Support (#8613)

2024-07-23 10:56:49 +02:00

dequant_q2_k.comp

…

dequant_q3_k.comp

…

dequant_q4_0.comp

Vulkan IQ4_NL Support (#8613)

2024-07-23 10:56:49 +02:00

dequant_q4_1.comp

…

dequant_q4_k.comp

…

dequant_q5_0.comp

…

dequant_q5_1.comp

…

dequant_q5_k.comp

…

dequant_q6_k.comp

…

dequant_q8_0.comp

…

diag_mask_inf.comp

…

div.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

gelu_quick.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

gelu.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

generic_binary_head.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

generic_head.comp

…

generic_unary_head.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

get_rows_quant.comp

…

get_rows.comp

…

group_norm.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

im2col.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

leaky_relu.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

mul_mat_split_k_reduce.comp

…

mul_mat_vec_base.comp

…

mul_mat_vec_nc.comp

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00

mul_mat_vec_p021.comp

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00

mul_mat_vec_q2_k.comp

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00

mul_mat_vec_q3_k.comp

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00

mul_mat_vec_q4_k.comp

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00

mul_mat_vec_q5_k.comp

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00

mul_mat_vec_q6_k.comp

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00

mul_mat_vec.comp

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00

mul_mm.comp

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00

mul.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

norm.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

pad.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

relu.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

repeat.comp

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00

rms_norm.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

rope_head.comp

…

rope_neox.comp

…

rope_norm.comp

…

scale.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

silu.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

soft_max.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

square.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

sum_rows.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

tanh.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

timestep_embedding.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

types.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

upscale.comp

vulkan : implement Stable Diffusion operators (ggml/904)

2024-08-05 08:50:57 +03:00

vulkan-shaders-gen.cpp

Vulkan Optimizations and Fixes (#8959)

2024-08-14 18:32:53 +02:00