12 Commits

Author	SHA1	Message	Date
Diego Devesa	c6a2c9e741	gguf : use ggml log system (#13571) ... * gguf : use ggml log system * llama : remove unnecessary new lines in exception messages	2025-05-15 19:13:11 +02:00
Diego Devesa	b7d2672082	llama : fix quantize with dl backends (#13539)	2025-05-14 16:12:36 +02:00
Johannes Gäßler	10d2af0eaa	llama/ggml: add LLM training support (#10544) ... * llama/ggml: add LLM training support more compact progress bar llama_save_model_to_file llama_opt_param_filter ggml_graph_dup force_grads refactor ggml_opt, fix test-opt * remove logits_all * refactor CUDA implementation for ACC * reset graph at beginning of opt period	2025-05-12 14:44:49 +02:00
Diego Devesa	27ebfcacba	llama : do not crash if there is no CPU backend (#13395) ... * llama : do not crash if there is no CPU backend * add checks to examples	2025-05-09 13:02:07 +02:00
Georgi Gerganov	833e2b7409	model : print tensor size during load (#12711) ... * model : print tensor size during load * cont : fix units MB -> MiB Co-authored-by: Diego Devesa <slarengh@gmail.com> --------- Co-authored-by: Diego Devesa <slarengh@gmail.com>	2025-04-02 16:38:54 +03:00
Diego Devesa	e0e912f49b	llama : add option to override model tensor buffers (#11397) ... * llama : add option to override tensor buffers * ggml : fix possible underflow in ggml_nbytes	2025-04-02 14:52:01 +02:00
jklincn	e39e727e9a	llama : use LLM_KV_GENERAL_FILE_TYPE instead of gguf_find_key (#12672)	2025-04-01 14:54:28 +02:00
lexasub	a5203b4465	llama : minor fixes for up llama load model speed (#11448) ... * impl::load change map bpe_ranks to onordered map for reduce time of impl::load on 30% * llama_model_loader::init_mapping - replace new llama_mmap to std::make_unique<llama_mmap> for clean code & reduce (/2) time of running init_mappings * Update src/llama-vocab.cpp --------- Co-authored-by: lexasub <empty@empty.ru> Co-authored-by: Diego Devesa <slarengh@gmail.com>	2025-01-27 14:42:09 +01:00
Xuan Son Nguyen	681149ced2	llama : add llama_model_load_from_splits (#11255) ... * llama : add `llama_model_load_from_splits` * update	2025-01-16 13:54:08 +01:00
Georgi Gerganov	afa8a9ec9b	llama : add llama_vocab, functions -> methods, naming (#11110) ... * llama : functions -> methods (#11110) * llama : add struct llama_vocab to the API (#11156) ggml-ci * hparams : move vocab params to llama_vocab (#11159) ggml-ci * vocab : more pimpl (#11165) ggml-ci * vocab : minor tokenization optimizations (#11160) ggml-ci Co-authored-by: Diego Devesa <slarengh@gmail.com> * lora : update API names (#11167) ggml-ci * llama : update API names to use correct prefix (#11174) * llama : update API names to use correct prefix ggml-ci * cont ggml-ci * cont ggml-ci * minor [no ci] * vocab : llama_vocab_add_[be]os -> llama_vocab_get_add_[be]os (#11174) ggml-ci * vocab : llama_vocab_n_vocab -> llama_vocab_n_tokens (#11174) ggml-ci --------- Co-authored-by: Diego Devesa <slarengh@gmail.com>	2025-01-12 11:32:42 +02:00
Johannes Gäßler	53ff6b9b9f	GGUF: C++ refactor, backend support, misc fixes (#11030) ... * GGUF: C++ refactor, backend support, misc fixes remove ggml_tensor.backend update CODEOWNERS [no ci] remove gguf_get_data from API revise GGUF API data types	2025-01-07 18:01:58 +01:00
Georgi Gerganov	f66f582927	llama : refactor src/llama.cpp (#10902) ... * llama : scatter llama.cpp into multiple modules (wip) * llama : control-vector -> adapter * llama : arch * llama : mmap ggml-ci * ci : remove BUILD_SHARED_LIBS=OFF ggml-ci * llama : arch (cont) ggml-ci * llama : chat ggml-ci * llama : model ggml-ci * llama : hparams ggml-ci * llama : adapter ggml-ci * examples : fix ggml-ci * rebase ggml-ci * minor * llama : kv cache ggml-ci * llama : impl ggml-ci * llama : batch ggml-ci * cont ggml-ci * llama : context ggml-ci * minor * llama : context (cont) ggml-ci * llama : model loader ggml-ci * common : update lora ggml-ci * llama : quant ggml-ci * llama : quant (cont) ggml-ci * minor [no ci]	2025-01-03 10:18:53 +02:00