ggml-org/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-08-19 18:45:26 +08:00
Code Issues Packages Projects Releases Wiki Activity
10,505 Commits 712 Branches 7,121 Tags

Default Branch

master

ee4c505a4f · server: add dedup-cache-models preset option (#27346) · Updated 2026-08-19 17:04:26 +08:00
 ZIP  TAR.GZ

Branches

gg/fix-cpu-blas

87f4102a70 · llama : revert n_threads_batch logic · Updated 2023-11-28 03:47:35 +08:00    tqcq

8925
3
 ZIP  TAR.GZ
ceb/perf-faster-multigpu

6272b6764a · use stride=128 if built for tensor cores · Updated 2023-11-28 02:09:14 +08:00    tqcq

8928
3
 ZIP  TAR.GZ
lookahead

8d8b76d469 · lookahead : add comments · Updated 2023-11-26 17:26:55 +08:00    tqcq

8940
9
 ZIP  TAR.GZ
server-oai-compat

21b70babf7 · straightforward /v1/models endpoint · Updated 2023-11-25 00:22:39 +08:00    tqcq

8941
12
 ZIP  TAR.GZ
kv-cache-opts

f8e9f11428 · common : add -dkvc arg for enabling kv cache dumps · Updated 2023-11-24 00:47:56 +08:00    tqcq

8947
4
 ZIP  TAR.GZ
ceb/fix-yarn-neox

f824902623 · YaRN : correction to GPT-NeoX implementation · Updated 2023-11-16 06:10:52 +08:00    tqcq

8979
1
 ZIP  TAR.GZ
llama-metadata

d0445a2eff · better documentation · Updated 2023-11-10 08:38:20 +08:00    tqcq

8996
3
 ZIP  TAR.GZ
fix-tensor-split-zero

47d604fa2d · fix issues · Updated 2023-11-05 20:20:22 +08:00    tqcq

9010
3
 ZIP  TAR.GZ
revert-pool

3ef358fffd · Revert "cuda : use CUDA memory pool with async memory allocation/deallocation when available (#3903)" · Updated 2023-11-05 04:26:51 +08:00    tqcq

9014
2
 ZIP  TAR.GZ
metal-soft-max

46868a499e · metal : multi-simd softmax · Updated 2023-11-02 03:16:34 +08:00    tqcq

9039
1
 ZIP  TAR.GZ
llm-build-context

a8796f9609 · llm : cleanup + comments · Updated 2023-11-02 02:08:02 +08:00    tqcq

9048
4
 ZIP  TAR.GZ
llm-reuse-constants

7420bef83e · wip wip wip · Updated 2023-11-01 14:51:43 +08:00    tqcq

9048
1
 ZIP  TAR.GZ
llama-refactor

afb3929279 · Merge branch 'master' into llama-refactor · Updated 2023-11-01 02:35:31 +08:00    tqcq

9050
21
 ZIP  TAR.GZ
test-mmv

29fe516913 · wip · Updated 2023-11-01 00:36:37 +08:00    tqcq

9051
1
 ZIP  TAR.GZ
deploy

dab42893c9 · scripts : working curl pipe · Updated 2023-10-31 23:03:56 +08:00    tqcq

9051
3
 ZIP  TAR.GZ
llama-refactor-norm

7923b70cb8 · llama : add llm_build_inp_embd helper · Updated 2023-10-31 22:43:08 +08:00    tqcq

9056
37
 ZIP  TAR.GZ
ggml-impl

4b3cb98d46 · ggml-impl : move extern "C" to start of file · Updated 2023-10-31 01:05:58 +08:00    tqcq

9052
7
 ZIP  TAR.GZ
lto

bc28aaa8c2 · make : use -lfto=auto to avoid warnings and maintain perf · Updated 2023-10-30 22:00:53 +08:00    tqcq

9052
5
 ZIP  TAR.GZ
scratch

15267192c0 · llama : refactor tensor offloading as callback · Updated 2023-10-29 19:04:36 +08:00    tqcq

9056
15
 ZIP  TAR.GZ
ggml-quants

8a86b95e87 · quantize : --pure option for disabling k-quant mixtures · Updated 2023-10-29 04:37:03 +08:00    tqcq

9057
3
 ZIP  TAR.GZ