tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-13 11:57:43 -04:00
Code Issues Packages Projects Releases Wiki Activity
Files
a743d76a01f23038b2c85af1e9048ee836767b44
llama.cpp/ggml-cuda
History
Johannes Gäßler a743d76a01 CUDA: generalize FP16 fattn vec kernel (#7061) 
* CUDA: generalize FP16 fattn vec kernel

* disable unsupported head sizes for AMD in test

* try AMD fix

* fix batch size 2-8

* partially revert changes
2024-05-09 14:32:02 +02:00
..
acc.cu
…
acc.cuh
…
alibi.cu
…
alibi.cuh
…
arange.cu
…
arange.cuh
…
argsort.cu
…
argsort.cuh
…
binbcast.cu
ggml : group all experts in a single ggml_mul_mat_id (#6505)
2024-04-18 15:18:48 +02:00
binbcast.cuh
…
clamp.cu
Introduction of CUDA Graphs to LLama.cpp (#6766)
2024-05-08 22:55:49 +02:00
clamp.cuh
…
common.cuh
CUDA: generalize FP16 fattn vec kernel (#7061)
2024-05-09 14:32:02 +02:00
concat.cu
…
concat.cuh
…
convert.cu
Introduction of CUDA Graphs to LLama.cpp (#6766)
2024-05-08 22:55:49 +02:00
convert.cuh
llama : add Command R Plus support (#6491)
2024-04-09 11:16:13 +03:00
cpy.cu
Introduction of CUDA Graphs to LLama.cpp (#6766)
2024-05-08 22:55:49 +02:00
cpy.cuh
Introduction of CUDA Graphs to LLama.cpp (#6766)
2024-05-08 22:55:49 +02:00
dequantize.cuh
llama : add Command R Plus support (#6491)
2024-04-09 11:16:13 +03:00
diagmask.cu
…
diagmask.cuh
…
dmmv.cu
llama : add Command R Plus support (#6491)
2024-04-09 11:16:13 +03:00
dmmv.cuh
…
fattn.cu
CUDA: generalize FP16 fattn vec kernel (#7061)
2024-05-09 14:32:02 +02:00
fattn.cuh
ggml : add Flash Attention (#5021)
2024-04-30 12:16:08 +03:00
getrows.cu
…
getrows.cuh
…
im2col.cu
…
im2col.cuh
…
mmq.cu
Introduction of CUDA Graphs to LLama.cpp (#6766)
2024-05-08 22:55:49 +02:00
mmq.cuh
…
mmvq.cu
Introduction of CUDA Graphs to LLama.cpp (#6766)
2024-05-08 22:55:49 +02:00
mmvq.cuh
…
norm.cu
…
norm.cuh
…
pad.cu
…
pad.cuh
…
pool2d.cu
…
pool2d.cuh
…
quantize.cu
llama : add Command R Plus support (#6491)
2024-04-09 11:16:13 +03:00
quantize.cuh
llama : add Command R Plus support (#6491)
2024-04-09 11:16:13 +03:00
rope.cu
…
rope.cuh
…
scale.cu
Introduction of CUDA Graphs to LLama.cpp (#6766)
2024-05-08 22:55:49 +02:00
scale.cuh
…
softmax.cu
ggml : add Flash Attention (#5021)
2024-04-30 12:16:08 +03:00
softmax.cuh
…
sumrows.cu
…
sumrows.cuh
…
tsembd.cu
…
tsembd.cuh
…
unary.cu
…
unary.cuh
…
upscale.cu
…
upscale.cuh
…
vecdotq.cuh
…