tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-06-30 20:58:45 +00:00
Code Issues Packages Projects Releases Wiki Activity

ggml : remove n_dims from ggml_tensor (#4469)

Browse Source 
ggml-ci
This commit is contained in:
slaren
2023-12-14 16:52:08 +01:00
committed by GitHub
parent c50e400163
commit cafcd4f895
9 changed files with 81 additions and 73 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
llama.cpp
View File

@ -8471,7 +8471,7 @@ static void llama_model_quantize_internal(const std::string & fname_inp, const s
bool quantize = name.rfind("weight") == name.size() - 6; // ends with 'weight'?
// quantize only 2D tensors
quantize &= (tensor->n_dims == 2);
quantize &= (ggml_n_dims(tensor) == 2);
quantize &= params->quantize_output_tensor || name != "output.weight";
quantize &= !params->only_copy;