tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-06-28 12:25:03 +00:00
Code Issues Packages Projects Releases Wiki Activity

rpc : early register backend devices (#11262)

Browse Source 
Early register RPC devices and do not propagate RPC specifics in the
llama model structures.

ref: #10609
This commit is contained in:
Radoslav Gerganov
2025-01-17 10:57:09 +02:00
committed by GitHub
parent a133566d34
commit 667d72846c
10 changed files with 61 additions and 55 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
ggml/src/ggml-backend-impl.h
View File

@ -208,7 +208,6 @@ extern "C" {
// Internal backend registry API
GGML_API void ggml_backend_register(ggml_backend_reg_t reg);
GGML_API void ggml_backend_device_register(ggml_backend_dev_t device);
// Add backend dynamic loading support to the backend