12 Commits

Author	SHA1	Message	Date
Xuan-Son Nguyen	71bdbdb587	clip : clip.h become private API (⚠️ breaking change) (#13510)	2025-05-13 17:07:21 +02:00
Xuan-Son Nguyen	b4726345ac	mtmd : remove libllava, remove clip-quantize-cli (⚠️ breaking change) (#13460) ... * mtmd : remove libllava, remove clip-quantize-cli * rm clip_model_quantize	2025-05-13 15:33:58 +02:00
Xuan-Son Nguyen	de4c07f937	clip : cap max image size 1024 for qwen vl model (#13478)	2025-05-12 15:06:51 +02:00
City	c104023994	mtmd : Use RMS norm for InternVL 3 38B and 78B mmproj (#13459)	2025-05-12 00:39:06 +02:00
David Huang	7f323a589f	Add --no-op-offload to improve -ot pp perf in MoE models like llama4 400B (#13386)	2025-05-11 14:18:39 +02:00
City	3eac209319	mtmd : support InternVL 3 38B and 78B mmproj (#13443) ... * Support InternVL 3 38B and 78B mmproj * Swap norms in clip.cpp * Group variables together	2025-05-11 11:35:52 +02:00
Xuan-Son Nguyen	15e6125a39	mtmd : add hard limit on image resolution for qwen2vl / qwen2.5vl (#13434) ... * mtmd : add hard limit on image resolution for qwen2vl / qwen2.5vl * fix typo	2025-05-10 19:57:54 +02:00
Xuan-Son Nguyen	053367d149	mtmd : support InternVL 2.5 and 3 (#13422) ... * convert : internvl support * InternVL3-1B working * fix regression * rm mobilevlm from test * fix conversion * add test for internvl * add to list of pre-quant * restore boi/eoi check * add clarify comment for norm eps	2025-05-10 16:26:42 +02:00
Diego Devesa	27ebfcacba	llama : do not crash if there is no CPU backend (#13395) ... * llama : do not crash if there is no CPU backend * add checks to examples	2025-05-09 13:02:07 +02:00
welix	0ccc121354	mtmd : fix the calculation of n_tokens for smolvlm (#13381) ... Co-authored-by: Taichi Nishimura <Taichi.A.Nishimura@sony.com>	2025-05-08 15:03:53 +02:00
Xuan-Son Nguyen	32916a4907	clip : refactor graph builder (#13321) ... * mtmd : refactor graph builder * fix qwen2vl * clean up siglip cgraph * pixtral migrated * move minicpmv to a dedicated build function * move max_feature_layer to build_llava * use build_attn for minicpm resampler * fix windows build * add comment for batch_size * also support tinygemma3 test model * qwen2vl does not use RMS norm * fix qwen2vl norm (2)	2025-05-06 22:40:24 +02:00
Xuan-Son Nguyen	9b61acf060	mtmd : rename llava directory to mtmd (#13311) ... * mv llava to mtmd * change ref everywhere	2025-05-05 16:02:55 +02:00