tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-07-16 15:47:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
6efcd65945a98cf6883cdd9de4c8ccd8c79d219a
llama.cpp/ggml/src
History
Jeff Bolz 6efcd65945 vulkan: optimize flash attention split_k_reduce (#14554) 
* vulkan: allow FA split_k with smaller KV values

* vulkan: spread split_k_reduce work across more threads

k_num can get rather large. Use the whole workgroup to reduce the M/L values.

Launch a thread for each element in the HSV dimension of the output. Helps a
lot for large HSV (like deepseek).
2025-07-08 20:11:42 +02:00
..
ggml-blas
cmake : Fix broken CMake error messages (ggml/1252)
2025-06-01 13:43:57 +03:00
ggml-cann
CANN: Replace aclrtMemsetSync with aclnnInplaceZero operator (#14002)
2025-07-04 11:50:07 +08:00
ggml-cpu
ggml : implement GEGLU_ERF and GEGLU_QUICK ops (#14445)
2025-07-03 23:07:22 +02:00
ggml-cuda
cuda : fix rope with partial rotation and non-cont src (#14580)
2025-07-08 10:15:21 +03:00
ggml-hip
HIP: disable rocwmma on gfx12 by default until rocm 7.0 (#14202)
2025-06-16 13:47:38 +02:00
ggml-metal
metal : disable fast math in all quantize kernels (#14528)
2025-07-04 19:19:09 +03:00
ggml-musa
musa: enable fp16 mma (all) and cublas on qy2 (#13842)
2025-06-26 12:11:59 +08:00
ggml-opencl
opencl: add GELU_ERF (#14476)
2025-07-04 23:24:56 -07:00
ggml-rpc
rpc : nicer error messages for RPC server crash (#14076)
2025-06-10 09:41:01 +03:00
ggml-sycl
cuda : fix rope with partial rotation and non-cont src (#14580)
2025-07-08 10:15:21 +03:00
ggml-vulkan
vulkan: optimize flash attention split_k_reduce (#14554)
2025-07-08 20:11:42 +02:00
CMakeLists.txt
ggml : remove kompute backend (#14501)
2025-07-03 07:48:32 +03:00
ggml-alloc.c
ggml: Don't assert fail when tensor data changes (#13222)
2025-05-01 22:46:10 +02:00
ggml-backend-impl.h
ggml : upgrade init_tensor API to return a ggml_status (#11854)
2025-02-28 14:41:47 +01:00
ggml-backend-reg.cpp
ggml : remove kompute backend (#14501)
2025-07-03 07:48:32 +03:00
ggml-backend.cpp
vulkan: Add fusion support for RMS_NORM+MUL (#14366)
2025-06-29 09:43:36 +02:00
ggml-common.h
ggml-cpu : split arch-specific implementations (#13892)
2025-06-09 16:47:13 +02:00
ggml-impl.h
vulkan: Add fusion support for RMS_NORM+MUL (#14366)
2025-06-29 09:43:36 +02:00
ggml-opt.cpp
mnist: fix segmentation fault (ggml/1227)
2025-05-19 13:29:56 +03:00
ggml-quants.c
ggml-quants : rename best_mad to best_error (ggml/1283)
2025-07-01 11:06:39 +03:00
ggml-quants.h
ggml : build backends as libraries (#10256)
2024-11-14 18:04:35 +01:00
ggml-threading.cpp
ggml : build backends as libraries (#10256)
2024-11-14 18:04:35 +01:00
ggml-threading.h
remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)
2024-12-12 19:02:49 +01:00
ggml.c
ggml : implement GEGLU_ERF and GEGLU_QUICK ops (#14445)
2025-07-03 23:07:22 +02:00
ggml.cpp
ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)
2025-06-01 13:43:57 +03:00
gguf.cpp
ggml : do not output unprintable characters on GGUF load failure (#14381)
2025-06-25 23:26:51 +02:00