tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-07-28 13:20:27 -04:00
Code Issues Packages Projects Releases Wiki Activity
5,795 Commits 470 Branches 4,044 Tags
bd288e8fa52b5244f65cee21cb61062f1a9e0ca5
Commit Graph

5795 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Aaron Teo
bd288e8fa5 ggml: refactor fp32->fp16 and fp16->fp32 simd to ggml-cpu 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-24 15:05:46 +08:00
Aaron Teo
5834dee1fc ggml-cpu: move nnpa fp16->fp32 and fp32->fp16 to simd-mappings 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-23 17:52:28 +08:00
Aaron Teo
5004e4395b ggml-cpu: remove unnecessary target compile definitions 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 23:37:44 +08:00
Aaron Teo
489cdf44bf ggml-cpu: clarify naming of dlf16 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 23:34:42 +08:00
Aaron Teo
07de57c69a ggml-cpu: add todo comment for future reference 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 21:07:30 +08:00
Aaron Teo
72965ea8b0 ggml-cpu: add ggml-impl.h future notes 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 21:06:57 +08:00
Aaron Teo
46227c61c9 ggml-cpu: remove typedef from cmakelists 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 21:02:05 +08:00
Aaron Teo
1b4dbf477c ggml-cpu: remove typedefs.h 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 21:01:21 +08:00
Aaron Teo
5c9b083511 Revert "ggml-cpu: move s390x typedef to own header file" 
This reverts commit 18d79e1a30.

Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:59:04 +08:00
Aaron Teo
e43dc82a21 ggml-cpu: undo cmakelists work 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:56:46 +08:00
Aaron Teo
3ec0bdc1df ggml-cpu: bring back compile definitions 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:47:05 +08:00
Aaron Teo
ebb8489a0c ggml-cpu: add s390x detection in ggml-src 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:38:55 +08:00
Aaron Teo
c8b3b89548 ggml-cpu: add compiler error macro 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:17:21 +08:00
Aaron Teo
04a395ea73 ggml-cpu: switch to quotes for import 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:11:51 +08:00
Aaron Teo
263b820b42 ggml-cpu: bring back compile macros 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 20:09:04 +08:00
Aaron Teo
781c263722 ggml-cpu: move things around 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:41:01 +08:00
Aaron Teo
18d79e1a30 ggml-cpu: move s390x typedef to own header file 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
(cherry picked from commit 157f856c34)
 2025-06-21 19:31:34 +08:00
Aaron Teo
ba3513e44b ggml-cpu: switch to private macros 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:27:55 +08:00
Aaron Teo
a91c3ab6b0 ggml-cpu: add ggml-impl.h to cmakelists 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:19:11 +08:00
Aaron Teo
72c91436f6 ggml-cpu: move macro definitions 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:16:40 +08:00
Aaron Teo
84593387a7 ggml-cpu: bruteforce macro definitions 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:14:31 +08:00
Aaron Teo
ed76ff6e42 ggml-cpu: add debug prints 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:11:59 +08:00
Aaron Teo
fadc138763 ggml-cpu: test more macros 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:10:39 +08:00
Aaron Teo
1cacdd9a36 ggml-cpu: fix macro declaration 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:08:48 +08:00
Aaron Teo
3004a79f4b ggml-cpu: switch to importing ggml-cpu-impl instead 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:04:09 +08:00
Aaron Teo
48df977079 Revert "ggml-cpu: move s390x typedef to own header file" 
This reverts commit 157f856c34.

Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:03:09 +08:00
Aaron Teo
157f856c34 ggml-cpu: move s390x typedef to own header file 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 19:00:20 +08:00
Aaron Teo
e7910fc975 ggml-cpu: update macro tests 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 18:43:43 +08:00
Aaron Teo
8129838037 ggml-cpu: import vecintrin.h to fix compiler errors 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 18:42:02 +08:00
Aaron Teo
4ad6efa37b ggml-cpu: diagnose why __NNPA__ macro is not being defined 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 18:33:08 +08:00
Aaron Teo
0e571dd3d8 ggml-cpu: add missing __func__ 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 18:10:26 +08:00
Aaron Teo
1547ea230c ggml-cpu: add nnpa macro check in ggml-impl 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 18:09:37 +08:00
Aaron Teo
f1b1d98e8d ggml-cpu: activate nnpa fp32->fp16 or fp16->fp32 compute 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:51:55 +08:00
Aaron Teo
8ef51b9055 ggml-cpu: bring back fp32->fp16 store nnpa 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:49:36 +08:00
Aaron Teo
987d1690e4 ggml-cpu: clarified vector naming 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:39:35 +08:00
Aaron Teo
4621a23c14 ggml-cpu: add 4 element loops for fp32->fp16 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:32:20 +08:00
Aaron Teo
373fa28e4c ggml-cpu: change to typedef vector types 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:26:20 +08:00
Aaron Teo
7413dabc8c ggml-cpu: fix compiler types 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:23:18 +08:00
Aaron Teo
e12e9fe704 ggml-cpu: reattempt fp32->fp16 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:20:20 +08:00
Aaron Teo
54811fc128 ggml-cpu: fix typo 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:13:57 +08:00
Aaron Teo
433d587426 ggml-cpu: reattempt fp32->fp16 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:12:22 +08:00
Aaron Teo
946c78ebde ggml-cpu: switch to elif macro 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 17:06:18 +08:00
Aaron Teo
27131e5f34 ggml-cpu: disable fp32->fp16 nnpa conversions for now 
there are some conversion failures in nnpa that requires the eyes of an
ibm stsm. will create a separate pr to introduce the fp32->fp16 change.

Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 16:58:43 +08:00
Aaron Teo
4f017d718a ggml-cpu: test fix for conversion failure 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 16:55:16 +08:00
Aaron Teo
5424d9e757 ggml-cpu: add breakpoint for debugging 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 16:51:05 +08:00
Aaron Teo
bb9345ca8a ggml-cpu: activate nnpa for ggml_cpu_fp32_to_fp16 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 16:50:05 +08:00
Aaron Teo
e0f8fb930b ggml-cpu: clarify variable naming 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 16:43:41 +08:00
Aaron Teo
27b4c3f338 ggml-cpu: remove noop, general code cleanup 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 16:41:39 +08:00
Aaron Teo
8312adc980 ggml-cpu: rework noop 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 16:24:32 +08:00
Aaron Teo
6d507bbeb0 ggml-cpu: switch to vec_xst for 4 element loops also 
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
 2025-06-21 16:23:23 +08:00