Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card Files Community
7

[WIP] Upload folder using huggingface_hub (multi-commit 2d8056736266bc17b682ed47876c5b3974767be007a4221afc4e66ad882c0b2a)

#2
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+4
-0
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. Meta-Llama-3.1-8B-Instruct.Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -42,3 +42,4 @@ Meta-Llama-3.1-8B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
  Meta-Llama-3.1-8B-Instruct.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
  Meta-Llama-3.1-8B-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
  Meta-Llama-3.1-8B-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
 
 
42
  Meta-Llama-3.1-8B-Instruct.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
  Meta-Llama-3.1-8B-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
  Meta-Llama-3.1-8B-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Meta-Llama-3.1-8B-Instruct.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3.1-8B-Instruct.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8d608c983b83a1bf28229bc9beb4294c91f5d4cbfe2c1829566b4d7c4693eeb
3
+ size 8540771232