tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-07-02 14:45:43 +00:00
Code Issues Packages Projects Releases Wiki Activity

llama : fix llm_build_k_shift to use correct n_rot (#4889)

Browse Source 
* llama : fix llm_build_k_shift to use correct n_rot

ggml-ci

* llama : always use hparams.n_rot for ggml_rope_custom

ggml-ci

* convert : fix persimmon conversion to write correct n_rot
This commit is contained in:
Georgi Gerganov
2024-01-12 13:01:56 +02:00
committed by GitHub
parent 326b418b59
commit f445c0e68c
4 changed files with 51 additions and 33 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
common/common.cpp
View File

@ -1055,6 +1055,9 @@ struct llama_model_params llama_model_params_from_gpt_params(const gpt_params &
}
static ggml_type kv_cache_type_from_str(const std::string & s) {
if (s == "f32") {
return GGML_TYPE_F32;
}
if (s == "f16") {
return GGML_TYPE_F16;
}