Files
llama.cpp/gguf-py/gguf
Francis Couture-Harpin 0996149911 convert-hf : allow converting the weird BitNet 1.3B
Its FFN size is 5460 which is not convenient.
The offending tensors are kept in F16,
which makes the final model 5.01 bpw.
2024-06-27 02:06:28 -04:00
..