tqcq/llama.cpp
0
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-08-17 05:25:09 -04:00
Code Issues Packages Projects Releases Wiki Activity

fix typo in readme (#5399)

Browse Source 
Co-authored-by: Ebey Abraham <ebeyabraham@microsoft.com>
This commit is contained in:
Ebey Abraham
2024-02-07 21:11:30 +00:00
committed by GitHub
parent b906596bb7
commit 8c933b70c2
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -680,7 +680,7 @@ python3 -m pip install -r requirements.txt
python3 convert.py models/mymodel/ python3 convert.py models/mymodel/
# [Optional] for models using BPE tokenizers # [Optional] for models using BPE tokenizers
python convert.py models/mymodel/ --vocabtype bpe python convert.py models/mymodel/ --vocab-type bpe
# quantize the model to 4-bits (using Q4_K_M method) # quantize the model to 4-bits (using Q4_K_M method)
./quantize ./models/mymodel/ggml-model-f16.gguf ./models/mymodel/ggml-model-Q4_K_M.gguf Q4_K_M ./quantize ./models/mymodel/ggml-model-f16.gguf ./models/mymodel/ggml-model-Q4_K_M.gguf Q4_K_M