Hugging Face's logo

fedric95
/
Qwen2-7B-GGUF

Text Generation
Transformers
GGUF
English
conversational
Inference Endpoints
Model card Files Community
fedric95 commited on
Commit
3bdfcbf
·
verified ·
1 Parent(s): ef01dca

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -20,7 +20,7 @@ Original model: https://huggingface.co/google/Qwen2-7B
20
 
21
  | Filename | Quant type | File Size | Perplexity (wikitext-2-raw-v1.test) |
22
  | -------- | ---------- | --------- | ----------- |
23
- | [Qwen2-7B.FP32.gguf](https://huggingface.co/fedric95/Qwen2-7B-GGUF/blob/main/Qwen2-7B.FP32.gguf) | BF16 | 15.2GB | coming_soon |
24
  | [Qwen2-7B-Q8_0.gguf](https://huggingface.co/fedric95/Qwen2-7B-GGUF/blob/main/Qwen2-7B-Q8_0.gguf) | Q8_0 | 8.1GB | 7.3817 +/- 0.04777 |
25
  | [Qwen2-7B-Q6_K.gguf](https://huggingface.co/fedric95/Qwen2-7B-GGUF/blob/main/Qwen2-7B-Q6_K.gguf) | Q6_K | 6.25GB | 7.3914 +/- 0.04776 |
26
  | [Qwen2-7B-Q5_K_M.gguf](https://huggingface.co/fedric95/Qwen2-7B-GGUF/blob/main/Qwen2-7B-Q5_K_M.gguf) | Q5_K_M | 5.44GB | 7.4067 +/- 0.04794 |
 
20
 
21
  | Filename | Quant type | File Size | Perplexity (wikitext-2-raw-v1.test) |
22
  | -------- | ---------- | --------- | ----------- |
23
+ | [Qwen2-7B.BF16.gguf](https://huggingface.co/fedric95/Qwen2-7B-GGUF/blob/main/Qwen2-7B.BF16.gguf) | BF16 | 15.2GB | coming_soon |
24
  | [Qwen2-7B-Q8_0.gguf](https://huggingface.co/fedric95/Qwen2-7B-GGUF/blob/main/Qwen2-7B-Q8_0.gguf) | Q8_0 | 8.1GB | 7.3817 +/- 0.04777 |
25
  | [Qwen2-7B-Q6_K.gguf](https://huggingface.co/fedric95/Qwen2-7B-GGUF/blob/main/Qwen2-7B-Q6_K.gguf) | Q6_K | 6.25GB | 7.3914 +/- 0.04776 |
26
  | [Qwen2-7B-Q5_K_M.gguf](https://huggingface.co/fedric95/Qwen2-7B-GGUF/blob/main/Qwen2-7B-Q5_K_M.gguf) | Q5_K_M | 5.44GB | 7.4067 +/- 0.04794 |