tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-20 06:36:48 -04:00
Code Issues Packages Projects Releases Wiki Activity

server : support reading arguments from environment variables (#9105)

Browse Source 
* server : support reading arguments from environment variables

* add -fa and -dt

* readme : specify non-arg env var
This commit is contained in:
Xuan Son Nguyen
2024-08-21 11:04:34 +02:00
committed by GitHub
parent b40eb84895
commit fc54ef0d1c
4 changed files with 80 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
common/common.h
View File

@@ -267,7 +267,7 @@ struct gpt_params {
std::string lora_outfile = "ggml-lora-merged-f16.gguf";
};
void gpt_params_handle_hf_token(gpt_params & params);
void gpt_params_parse_from_env(gpt_params & params);
void gpt_params_handle_model_default(gpt_params & params);
bool gpt_params_parse_ex (int argc, char ** argv, gpt_params & params);