tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-06-27 12:05:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
0c4d489e29e53589bf13a801fe7c94b7b546d8f6
llama.cpp/examples/gbnf-validator
History
Olivier Chafik cbaadc9294 grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) (#6609) 
* grammars: reserve rejects & next candidates

* grammars: reuse new_stacks

* grammars: fix missing sig change in llama.h

* grammars: fix test (api changed)

* grammars: update gbnf-validator.cpp

* grammars: simpler syntax (no swap)
2024-04-11 19:47:34 +01:00
..
CMakeLists.txt
examples : add GBNF validator program (#5948)
2024-04-04 10:44:28 +03:00
gbnf-validator.cpp
grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) (#6609)
2024-04-11 19:47:34 +01:00