tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-11 11:05:39 -04:00
Code Issues Packages Projects Releases Wiki Activity

llama : do not crash if there is no CPU backend (#13395)

Browse Source 
* llama : do not crash if there is no CPU backend

* add checks to examples
This commit is contained in:
Diego Devesa
2025-05-09 13:02:07 +02:00
committed by GitHub
parent 5c86c9ed3e
commit 27ebfcacba
7 changed files with 48 additions and 13 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
tools/mtmd/llava.cpp
View File

@@ -212,6 +212,7 @@ static bool clip_llava_handle_patches(clip_ctx * ctx_clip, std::vector<float *>
ggml_build_forward_expand(gf, flatten);
ggml_backend_ptr backend { ggml_backend_init_by_type(GGML_BACKEND_DEVICE_TYPE_CPU, nullptr) };
GGML_ASSERT(backend != nullptr && "failed to initialize CPU backend");
ggml_backend_graph_compute(backend.get(), gf);
struct ggml_tensor* result = ggml_graph_node(gf, -1);