Sigbjørn Skjæret 36ca8b3628 CUDA: don't convert BF16 weights to FP32 (ggml/1174) ...

* add bf16 support

* use convert_from_bf16_cuda instead of convert_unary_cuda for f32

* revert 7ec5085

* move functionality into convert_unary with constexpr

2025-04-07 18:44:17 +03:00

..

ggml-blas

ggml : add support for dynamic loading of backends (#10469)

2024-11-25 15:13:39 +01:00

ggml-cann

CANN: fix typo in ggml-cann (#12733)

2025-04-07 19:34:14 +08:00

ggml-cpu

cpu: move all the operators into a separate c++ file (except mul_mat) (ggml/1167)

2025-04-07 18:44:17 +03:00

ggml-cuda

CUDA: don't convert BF16 weights to FP32 (ggml/1174)

2025-04-07 18:44:17 +03:00

ggml-hip

HIP: implement FlashAttention via rocWMMA for CDNA and RDNA3+ (#12032)

2025-03-03 22:10:54 +01:00

ggml-kompute

llama : add Qwen2VL support + multimodal RoPE (#10361)

2024-12-14 14:43:46 +02:00

ggml-metal

metal : use F32 prec in FA kernels (#12688)

2025-04-01 14:57:19 +03:00

ggml-musa

cuda : enable CUDA Graph on CUDA Toolkit < 12.x (#12394)

2025-03-17 20:25:13 +02:00

ggml-opencl

opencl: use max_alloc_size in backend ctx instead of querying again (#12705)

2025-04-02 17:01:42 -07:00

ggml-rpc

rpc : send hash when tensor data is above some fixed threshold (#12496)

2025-03-28 08:18:04 +02:00

ggml-sycl

sycl: remove redundant memcopy in function ggml_backend_sycl_buffer_set_tensor (#12734)

2025-04-07 17:22:57 +02:00

ggml-vulkan

vulkan: fix NaN issue in flash attention shader (#12776)

2025-04-06 11:03:47 +02:00

CMakeLists.txt

cmake : fix ccache conflict (#12522)

2025-03-29 11:04:58 +01:00

ggml-alloc.c

ggml : upgrade init_tensor API to return a ggml_status (#11854)

2025-02-28 14:41:47 +01:00

ggml-backend-impl.h

ggml : upgrade init_tensor API to return a ggml_status (#11854)

2025-02-28 14:41:47 +01:00

ggml-backend-reg.cpp

ggml-backend : fix backend search path (#12330)

2025-03-11 14:25:17 +01:00

ggml-backend.cpp

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

ggml-common.h

musa: fix all warnings, re-enable -DLLAMA_FATAL_WARNINGS=ON in ci and update doc (#12611)

2025-03-30 10:59:38 +02:00

ggml-impl.h

ggml : riscv: add 128-bit RVV support (#12530)

2025-03-27 08:38:34 +02:00

ggml-opt.cpp

…

ggml-quants.c

ggml : portability fixes for VS 2017 (#12150)

2025-03-04 18:53:26 +02:00

ggml-quants.h

…

ggml-threading.cpp

…

ggml-threading.h

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

2024-12-12 19:02:49 +01:00

ggml.c

llama : add option to override model tensor buffers (#11397)

2025-04-02 14:52:01 +02:00

gguf.cpp

Fix clang warning in gguf_check_reserved_keys (#12686)

2025-04-01 13:12:53 +02:00