Douglas Hanley c3ebcfa148 server : ensure batches are either all embed or all completion (#8420) ...

* make sure batches are all embed or all non-embed

* non-embedding batch for sampled tokens; fix unused params warning

2024-07-12 11:14:12 +03:00

..

baby-llama

…

batched

Inference support for T5 and FLAN-T5 model families (#5763)

2024-07-04 15:46:11 +02:00

batched-bench

…

batched.swift

Detokenizer fixes (#8039)

2024-07-05 19:01:35 +02:00

benchmark

…

convert-llama2c-to-ggml

…

cvector-generator

…

deprecation-warning

Deprecation warning to assist with migration to new binary names (#8283)

2024-07-09 11:54:43 -04:00

embedding

Removes multiple newlines at the end of files that is breaking the editorconfig step of CI. (#8258)

2024-07-02 12:18:10 -04:00

eval-callback

examples : sprintf -> snprintf (#8434)

2024-07-12 10:46:14 +03:00

export-lora

…

finetune

py : type-check all Python scripts with Pyright (#8341)

2024-07-07 15:04:39 -04:00

gbnf-validator

…

gguf

…

gguf-hash

examples : sprintf -> snprintf (#8434)

2024-07-12 10:46:14 +03:00

gguf-split

…

gritlm

…

imatrix

…

infill

infill : assert prefix/suffix tokens + remove old space logic (#8351)

2024-07-08 09:34:35 +03:00

jeopardy

…

llama-bench

…

llama.android

…

llama.swiftui

Detokenizer fixes (#8039)

2024-07-05 19:01:35 +02:00

llava

py : type-check all Python scripts with Pyright (#8341)

2024-07-07 15:04:39 -04:00

lookahead

…

lookup

Removes multiple newlines at the end of files that is breaking the editorconfig step of CI. (#8258)

2024-07-02 12:18:10 -04:00

main

Update llama-cli documentation (#8315)

2024-07-07 17:08:28 +02:00

main-cmake-pkg

Removes multiple newlines at the end of files that is breaking the editorconfig step of CI. (#8258)

2024-07-02 12:18:10 -04:00

parallel

…

passkey

passkey : add short intro to README.md [no-ci] (#8317)

2024-07-05 09:14:24 +03:00

perplexity

ppl : fix n_seq_max for perplexity (#8277)

2024-07-03 20:33:31 +03:00

quantize

ggml : add AArch64 optimized GEMV and GEMM Q4 kernels (#5780)

2024-07-10 15:14:51 +03:00

quantize-stats

ggml : minor naming changes (#8433)

2024-07-12 10:46:02 +03:00

retrieval

…

rpc

…

save-load-state

…

server

server : ensure batches are either all embed or all completion (#8420)

2024-07-12 11:14:12 +03:00

simple

…

speculative

…

sycl

Removes multiple newlines at the end of files that is breaking the editorconfig step of CI. (#8258)

2024-07-02 12:18:10 -04:00

tokenize

tokenize : add --no-parse-special option (#8423)

2024-07-11 10:41:48 +03:00

train-text-from-scratch

py : type-check all Python scripts with Pyright (#8341)

2024-07-07 15:04:39 -04:00

base-translate.sh

…

chat-13B.bat

…

chat-13B.sh

…

chat-persistent.sh

…

chat-vicuna.sh

…

chat.sh

…

CMakeLists.txt

gguf-hash: model wide and per tensor hashing using xxhash and sha1 (#8048)

2024-07-07 22:58:43 +10:00

convert_legacy_llama.py

py : type-check all Python scripts with Pyright (#8341)

2024-07-07 15:04:39 -04:00

json_schema_pydantic_example.py

py : type-check all Python scripts with Pyright (#8341)

2024-07-07 15:04:39 -04:00

json_schema_to_grammar.py

py : type-check all Python scripts with Pyright (#8341)

2024-07-07 15:04:39 -04:00

llama.vim

…

llm.vim

…

Miku.sh

…

pydantic_models_to_grammar_examples.py

py : type-check all Python scripts with Pyright (#8341)

2024-07-07 15:04:39 -04:00

pydantic_models_to_grammar.py

py : type-check all Python scripts with Pyright (#8341)

2024-07-07 15:04:39 -04:00

reason-act.sh

…

regex_to_grammar.py

py : switch to snake_case (#8305)

2024-07-05 07:53:33 +03:00

server_embd.py

py : type-check all Python scripts with Pyright (#8341)

2024-07-07 15:04:39 -04:00

server-llama2-13B.sh

…

ts-type-to-grammar.sh

…