3 Commits

Author	SHA1	Message	Date
Diego Devesa	459895c326	ggml : add more generic custom op, remove deprecated custom ops (ggml/1183) ... * ggml : add more generic ggml_custom op * ggml : remove deprecated custom ops	2025-04-11 00:17:47 +03:00
Georgi Gerganov	a19b5cef16	llama : fix FA when KV cache is not used (i.e. embeddings) (#12825) ... * ggml : FA supports F32 V * graph : cast KV to F16 when the KV cache is not used ggml-ci * server : add test that exercises embeddings with FA enabled ggml-ci	2025-04-08 19:54:51 +03:00
cmdr2	995083e4ed	cpu: move all the operators into a separate c++ file (except mul_mat) (ggml/1167) ... * cpu: refactor SIMD mappings and vectorized op functions into separate files * Fix warning for ggml_float to float * Fix warnings * cpu: move all the operations (except mul_mat) to a separate c++ file * fix whitespace * Update ggml/src/ggml-cpu/vec.h Co-authored-by: Diego Devesa <slarengh@gmail.com> * Fix PR comments - use GGML_UNUSED, use cassert in ops.cpp * Reverse the order of import for ops.h and vec.h, to match what was present in ggml-cpu.c previously --------- Co-authored-by: Diego Devesa <slarengh@gmail.com>	2025-04-07 18:44:17 +03:00