4 Commits

Author	SHA1	Message	Date
Richard Kiss	9494d7c477	english : use typos to fix comments and logs (#4354)	2023-12-12 11:53:36 +02:00
Georgi Gerganov	1f5cd83275	examples : add readme files	2023-11-29 11:00:17 +02:00
Georgi Gerganov	3e73d31d9c	lookahead : support -n -1 infinite generation	2023-11-26 21:52:23 +02:00
Georgi Gerganov	922754a8d6	lookahead : add example for lookahead decoding (#4207) ... * lookahead : init * lookahead : generate and store n-grams * lookahead : use loop instead recursion to generate n-grams * lookahead : initial working implementation * lookahead : filter repeating n-grams * lookahead : use deterministic init * lookahead : add to Makefile * lookahead : fix a bug in the seq_id of the lookahead tokens * lookahead : add comments --------- Co-authored-by: slaren <slarengh@gmail.com>	2023-11-26 20:33:07 +02:00