Georgi Gerganov 106964e3d2 metal : enable mat-vec kernels for bs <= 4 (#10491)

2024-11-25 21:49:31 +02:00

..

ggml-amx

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-blas

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-cann

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-cpu

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-cuda

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-hip

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-kompute

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-metal

metal : enable mat-vec kernels for bs <= 4 (#10491)

2024-11-25 21:49:31 +02:00

ggml-musa

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-rpc

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-sycl

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-vulkan

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

CMakeLists.txt

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-aarch64.c

ggml : optimize Q4_0 into Q4_0_X_Y repack (#10324)

2024-11-16 01:53:37 +01:00

ggml-aarch64.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-alloc.c

ggml: new optimization interface (ggml/988)

2024-11-17 08:30:29 +02:00

ggml-backend-impl.h

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-backend-reg.cpp

llama : accept a list of devices to use to offload a model (#10497)

2024-11-25 19:30:06 +01:00

ggml-backend.cpp

ggml/sched : do not skip views in pre-assignments

2024-11-21 09:22:05 +02:00

ggml-common.h

ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151)

2024-09-05 21:48:47 -04:00

ggml-impl.h

ggml-opt: fix data corruption (ggml/1022)

2024-11-21 09:22:02 +02:00

ggml-opt.cpp

ggml-opt: fix data corruption (ggml/1022)

2024-11-21 09:22:02 +02:00

ggml-quants.c

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-quants.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.cpp

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml-threading.h

ggml : build backends as libraries (#10256)

2024-11-14 18:04:35 +01:00

ggml.c

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00