tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-19 22:36:13 -04:00
Code Issues Packages Projects Releases Wiki Activity

server : add lora hotswap endpoint (WIP) (#8857)

Browse Source 
* server : add lora hotswap endpoint

* handle lora_no_apply

* fix build

* updae docs

* clean up struct def

* fix build

* add LoRA test

* fix style
This commit is contained in:
Xuan Son Nguyen
2024-08-06 17:33:39 +02:00
committed by GitHub
parent 641f5dd2a6
commit 1e6f6554aa
9 changed files with 251 additions and 92 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
gguf-py/gguf/metadata.py
View File

@@ -174,7 +174,7 @@ class Metadata:
org_component, model_full_name_component = None, model_id
# Check if we erroneously matched against './' or '../' etc...
if org_component is not None and org_component[0] == '.':
if org_component is not None and len(org_component) > 0 and org_component[0] == '.':
org_component = None
name_parts: list[str] = model_full_name_component.split('-')