Hugging Face's logo

qwp4w3hyb
/
Meta-Llama-3-8B-Instruct-iMat-GGUF

Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
llama.cpp
imatrix
importance matrix
Inference Endpoints
conversational
Model card Files Community
2
qwp4w3hyb commited on
Commit
eb9f626
·
verified ·
1 Parent(s): 4b61ae5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -19,8 +19,8 @@ license_link: LICENSE
19
 
20
  # Quant Infos
21
 
22
- Quantized with [llama.cpp](https://github.com/ggerganov/llama.cpp) commit with tokenizer fixes from [this](https://github.com/ggerganov/llama.cpp/pull/6745) branch cherry-picked [0d56246f4b9764158525d894b96606f6163c53a8](https://github.com/ggerganov/llama.cpp/commit/0d56246f4b9764158525d894b96606f6163c53a8) (master from 2024-04-18)
23
-
24
  Imatrix dataset was used from [here](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384)
25
 
26
  Using this command to generate the importance matrix from the f16.gguf
 
19
 
20
  # Quant Infos
21
 
22
+ Quantized with [llama.cpp](https://github.com/ggerganov/llama.cpp) commit [0d56246f4b9764158525d894b96606f6163c53a8](https://github.com/ggerganov/llama.cpp/commit/0d56246f4b9764158525d894b96606f6163c53a8) (master from 2024-04-18)
23
+ with tokenizer fixes from [this](https://github.com/ggerganov/llama.cpp/pull/6745) branch cherry-picked
24
  Imatrix dataset was used from [here](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384)
25
 
26
  Using this command to generate the importance matrix from the f16.gguf