Hugging Face's logo

SpongeEngine
/
BlackSheep-Llama3.2-3B-i1-GGUF

GGUF
English
SpongeQuant
i1-GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
dclipca commited on
Commit
9317651
·
verified ·
1 Parent(s): 2a53c75

Upload folder using huggingface_hub

Browse files
Files changed (24) hide show
  1. .gitattributes +22 -0
  2. BlackSheep-Llama3.2-3B.imatrix.dat +3 -0
  3. README.md +26 -0
  4. blacksheep-llama3.2-3b-i1-IQ2_S.gguf +3 -0
  5. blacksheep-llama3.2-3b-i1-IQ2_XS.gguf +3 -0
  6. blacksheep-llama3.2-3b-i1-IQ2_XXS.gguf +3 -0
  7. blacksheep-llama3.2-3b-i1-IQ3_M.gguf +3 -0
  8. blacksheep-llama3.2-3b-i1-IQ3_S.gguf +3 -0
  9. blacksheep-llama3.2-3b-i1-IQ3_XS.gguf +3 -0
  10. blacksheep-llama3.2-3b-i1-IQ3_XXS.gguf +3 -0
  11. blacksheep-llama3.2-3b-i1-IQ4_NL.gguf +3 -0
  12. blacksheep-llama3.2-3b-i1-IQ4_XS.gguf +3 -0
  13. blacksheep-llama3.2-3b-i1-Q2_K.gguf +3 -0
  14. blacksheep-llama3.2-3b-i1-Q2_K_S.gguf +3 -0
  15. blacksheep-llama3.2-3b-i1-Q3_K_L.gguf +3 -0
  16. blacksheep-llama3.2-3b-i1-Q3_K_M.gguf +3 -0
  17. blacksheep-llama3.2-3b-i1-Q3_K_S.gguf +3 -0
  18. blacksheep-llama3.2-3b-i1-Q4_0.gguf +3 -0
  19. blacksheep-llama3.2-3b-i1-Q4_1.gguf +3 -0
  20. blacksheep-llama3.2-3b-i1-Q4_K_M.gguf +3 -0
  21. blacksheep-llama3.2-3b-i1-Q4_K_S.gguf +3 -0
  22. blacksheep-llama3.2-3b-i1-Q5_K_M.gguf +3 -0
  23. blacksheep-llama3.2-3b-i1-Q5_K_S.gguf +3 -0
  24. blacksheep-llama3.2-3b-i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,25 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ BlackSheep-Llama3.2-3B.imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ blacksheep-llama3.2-3b-i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ blacksheep-llama3.2-3b-i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
39
+ blacksheep-llama3.2-3b-i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ blacksheep-llama3.2-3b-i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ blacksheep-llama3.2-3b-i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ blacksheep-llama3.2-3b-i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ blacksheep-llama3.2-3b-i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
44
+ blacksheep-llama3.2-3b-i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
45
+ blacksheep-llama3.2-3b-i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ blacksheep-llama3.2-3b-i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
47
+ blacksheep-llama3.2-3b-i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
48
+ blacksheep-llama3.2-3b-i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
49
+ blacksheep-llama3.2-3b-i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
50
+ blacksheep-llama3.2-3b-i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ blacksheep-llama3.2-3b-i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
52
+ blacksheep-llama3.2-3b-i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
53
+ blacksheep-llama3.2-3b-i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
54
+ blacksheep-llama3.2-3b-i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
55
+ blacksheep-llama3.2-3b-i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
56
+ blacksheep-llama3.2-3b-i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
57
+ blacksheep-llama3.2-3b-i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
BlackSheep-Llama3.2-3B.imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:179d9f8ba1e20415e53624ca771b4b2276b8e095de2b8434e5f08743dedb2345
3
+ size 2988381
README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: TroyDoesAI/BlackSheep-Llama3.2-3B
3
+ language:
4
+ - en
5
+ license: mit
6
+ quantized_by: SpongeQuant
7
+ tags:
8
+ - SpongeQuant
9
+ - i1-GGUF
10
+ ---
11
+
12
+
13
+ Quantized to `i1-GGUF` using [SpongeQuant](https://github.com/SpongeEngine/SpongeQuant), the Oobabooga of LLM quantization. Chat & support at [Sponge Engine](https://discord.gg/azNmr2Gdgy).
14
+
15
+ <figure>
16
+ <img src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/048.png" alt="48. Autumn Fallen leaves">
17
+ <figcaption>48. Autumn Fallen leaves</figcaption>
18
+ </figure>
19
+
20
+ <figure>
21
+ <audio controls>
22
+ <source src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/025.mp3" type="audio/mp3">
23
+ Your browser does not support the audio element.
24
+ </audio>
25
+ <figcaption>25. The Fairie Round – Early Music Consort of London / David Munrow (Anthony Holborne)</figcaption>
26
+ </figure>
blacksheep-llama3.2-3b-i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0693e874bce786c773f90a0bbff56cd1f2c168cdb91f70f2147d3e4b17b1621
3
+ size 1154320448
blacksheep-llama3.2-3b-i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9bc3b165f39b644dacba953be22d785d441e652c58c16ed2b914c42d3860374
3
+ size 1100548160
blacksheep-llama3.2-3b-i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06aa4bfd0a784758f01ca8323fe910656bd81558c4b52328466adfea5a0c614f
3
+ size 1017579584
blacksheep-llama3.2-3b-i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc6f9a9bc88e5766f81259084bf7f005995964f65feef1637890e95722bda10c
3
+ size 1599668288
blacksheep-llama3.2-3b-i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce4ec3bfc7220b5c939a17ce2c9d3b8be71f048afc75b9c7a822137524064bb7
3
+ size 1542848576
blacksheep-llama3.2-3b-i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea9670c1bad165516b066ac23886caa4679e24ded705715949b91b167ebe5e72
3
+ size 1476788288
blacksheep-llama3.2-3b-i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc9464ffa410718ad1d9aae9a3ea0998100dfed2cbcd363858c936a200c0eb96
3
+ size 1348765760
blacksheep-llama3.2-3b-i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5385a282acbabc2a7f1bec5588060c45a12e0774cbac40fcefbeb19c36989ce3
3
+ size 1917190208
blacksheep-llama3.2-3b-i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ae23b9d7d9417616e98d3b405127771320537efb812cfd351708ced57ee29d1
3
+ size 1829109824
blacksheep-llama3.2-3b-i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ee751f5b18d1c6cd884075f7555b63771500fc7a9074ce55fb08f45545f59e5
3
+ size 1363935296
blacksheep-llama3.2-3b-i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbbe16290559300e70b2a3685ec972d26828a4a61b518ba8f595662fe3933fc0
3
+ size 1274282048
blacksheep-llama3.2-3b-i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c30ea78d2b05b0018c5872ff9576f4726dd1bc86990d7da348bd8915084a86e3
3
+ size 1815347264
blacksheep-llama3.2-3b-i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4cc07f5ea66d37acd9ab2220ca6a5c6e82f2c40ae02a4b36a8138e2960c211e
3
+ size 1687158848
blacksheep-llama3.2-3b-i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0cb87d16d2be0ca3e266f05fe4a24d6749808509aeab689ba0de7c2e21f8c9c9
3
+ size 1542848576
blacksheep-llama3.2-3b-i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d4c95cd1df5efdd15ed22979fed53f7fe07ee8964a1b8e868998752c4c614ff
3
+ size 1921908800
blacksheep-llama3.2-3b-i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d189a5c11ceb5a0bb6b12807995d73da2ad073e37b0d3053762692fcb11dce0
3
+ size 2093350976
blacksheep-llama3.2-3b-i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c177fd7ab6dd5da0b3c534b68a78bf400a700974a7f1ee1378c52475d19902b
3
+ size 2019377216
blacksheep-llama3.2-3b-i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2edef19f395fe69e19d8e6bb140b6b7acef038c400a91f5dae9fc87600f149ca
3
+ size 1928200256
blacksheep-llama3.2-3b-i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9b015eb0856ddbe85d3fa4d9f2e1b37e77edf9a3b666191e314ace61a4fbda4
3
+ size 2322153536
blacksheep-llama3.2-3b-i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6eb2f3bded8de131b1e1c4950e3f0faddfb5c9d0553ba56ee7ce078b1938cd5c
3
+ size 2269511744
blacksheep-llama3.2-3b-i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7d11821a7e42f15ddf1498517af3160224360894f62abcbf9c4a8653e3aa109
3
+ size 2643853376