Default Branch

ee4c505a4f · server: add dedup-cache-models preset option (#27346) · Updated 2026-08-19 17:04:26 +08:00

Branches

5418932b71 · llama : fix comments for llama_kv_cache API · Updated 2023-10-04 02:01:52 +08:00    tqcq

9192
5

c5650ed470 · server : avoid context swaps by shifting the KV cache · Updated 2023-09-29 00:03:36 +08:00    tqcq

9216
57

72e7ef4e53 · simple : fixes · Updated 2023-09-27 05:19:36 +08:00    tqcq

9242
48

784d14ed31 · llama : store non-RoPEd K cache (WIP) · Updated 2023-09-18 04:43:07 +08:00    tqcq

9254
5

92a4f86879 · llama : make starcoder graph build more consistent with others · Updated 2023-09-15 22:57:10 +08:00    tqcq

9264
20

e7e7b11455 · llama : remove experimental stuff · Updated 2023-09-15 03:52:01 +08:00    tqcq

9276
3

2f689dee06 · metal : minor · Updated 2023-09-07 20:33:21 +08:00    tqcq

9309
5

30ac7a4117 · gitignore : metal · Updated 2023-09-05 03:23:16 +08:00    tqcq

9321
12

f3a84b2e0d · llama : better express the KV cache dependencies in the graph · Updated 2023-09-05 02:44:48 +08:00    tqcq

9321
5

c79d130f74 · make : fix speculative build · Updated 2023-09-04 20:50:04 +08:00    tqcq

9322
9

847896aba7 · speculative : add --draft CLI arg · Updated 2023-09-03 18:51:07 +08:00    tqcq

9328
3

8c2b881281 · cuda : poc for norm quants (only -b 1 works) · Updated 2023-08-31 02:42:28 +08:00    tqcq

9369
3

b4e70822f6 · metal : add poc for normalized Q4_0 and Q4_1 · Updated 2023-08-30 23:47:16 +08:00    tqcq

9369
7

488e03200e · Merge branch 'master' into gguf-publish-ci · Updated 2023-08-30 16:34:55 +08:00    tqcq

9374
4

33a5517d87 · llama.cpp : print gguf version · Updated 2023-08-27 05:56:48 +08:00    tqcq

9416
10

d34472c124 · Fix HellaSwag · Updated 2023-08-26 15:55:39 +08:00    tqcq

9429
1

0248ca811e · gguf : add notes for tests · Updated 2023-08-25 14:08:05 +08:00    tqcq

9441
10

977629a34e · Merge branch 'master' into fix-eos · Updated 2023-08-24 03:40:19 +08:00    tqcq

9457
4

66a66a05a8 · readme : add notice about new file format · Updated 2023-08-22 03:42:14 +08:00    tqcq

9486
253

6a9e6375b5 · gguf.py : indentation · Updated 2023-08-18 02:53:15 +08:00    tqcq

9501
205