Eve dafae66cc2 vulkan: dynamic subgroup size for the remaining k quants (#10745) ...

* q5_k

q4_k

q3_k

q2_k

q6_k multi row example

* revert as multi row isnt faster for k quants

2024-12-10 20:33:23 +01:00

..

ggml-blas

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-cann

ggml : refactor online repacking (#10446)

2024-12-07 14:37:50 +02:00

ggml-cpu

ggml : disable iq4_nl interleave size 8 (#10709)

2024-12-07 18:38:15 +02:00

ggml-cuda

CUDA: rename macros to avoid conflicts with WinAPI (#10736)

2024-12-10 18:23:24 +01:00

ggml-hip

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-kompute

kompute : improve backend to pass test_backend_ops (#10542)

2024-11-28 12:51:38 +01:00

ggml-metal

metal : Extend how Llama.cpp locates metal resources (#10676)

2024-12-07 09:55:01 +02:00

ggml-musa

mtgpu: Add MUSA_DOCKER_ARCH in Dockerfiles && update cmake and make (#10516)

2024-11-26 17:00:41 +01:00

ggml-rpc

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-sycl

ggml : refactor online repacking (#10446)

2024-12-07 14:37:50 +02:00

ggml-vulkan

vulkan: dynamic subgroup size for the remaining k quants (#10745)

2024-12-10 20:33:23 +01:00

CMakeLists.txt

ggml : refactor online repacking (#10446)

2024-12-07 14:37:50 +02:00

ggml-alloc.c

ggml: new optimization interface (ggml/988)

2024-11-17 08:30:29 +02:00

ggml-backend-impl.h

ggml : automatic selection of best CPU backend (#10606)

2024-12-01 16:12:41 +01:00

ggml-backend-reg.cpp

ggml : add predefined list of CPU backend variants to build (#10626)

2024-12-04 14:45:40 +01:00

ggml-backend.cpp

ggml : move AMX to the CPU backend (#10570)

2024-11-29 21:54:58 +01:00

ggml-common.h

CUDA: rename macros to avoid conflicts with WinAPI (#10736)

2024-12-10 18:23:24 +01:00

ggml-impl.h

Avoid using __fp16 on ARM with old nvcc (#10616)

2024-12-04 01:41:37 +01:00

ggml-opt.cpp

ggml-opt: fix data corruption (ggml/1022)

2024-11-21 09:22:02 +02:00

ggml-quants.c

ggml : refactor online repacking (#10446)

2024-12-07 14:37:50 +02:00

ggml-quants.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.cpp

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml.c

ggml : refactor online repacking (#10446)

2024-12-07 14:37:50 +02:00