Hugging Face's logo

SpongeEngine
/
MT-Gen6fix-gemma-2-9B-i1-GGUF

GGUF
English
SpongeQuant
i1-GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
1
dclipca commited on
Commit
575cfea
·
verified ·
1 Parent(s): 2824bb0

Upload folder using huggingface_hub

Browse files
Files changed (22) hide show
  1. .gitattributes +20 -0
  2. MT-Gen6fix-gemma-2-9B.imatrix.dat +3 -0
  3. README.md +26 -0
  4. mt-gen6fix-gemma-2-9b-i1-IQ2_M.gguf +3 -0
  5. mt-gen6fix-gemma-2-9b-i1-IQ2_S.gguf +3 -0
  6. mt-gen6fix-gemma-2-9b-i1-IQ2_XS.gguf +3 -0
  7. mt-gen6fix-gemma-2-9b-i1-IQ2_XXS.gguf +3 -0
  8. mt-gen6fix-gemma-2-9b-i1-IQ3_M.gguf +3 -0
  9. mt-gen6fix-gemma-2-9b-i1-IQ3_S.gguf +3 -0
  10. mt-gen6fix-gemma-2-9b-i1-IQ3_XS.gguf +3 -0
  11. mt-gen6fix-gemma-2-9b-i1-IQ3_XXS.gguf +3 -0
  12. mt-gen6fix-gemma-2-9b-i1-IQ4_NL.gguf +3 -0
  13. mt-gen6fix-gemma-2-9b-i1-IQ4_XS.gguf +3 -0
  14. mt-gen6fix-gemma-2-9b-i1-Q2_K.gguf +3 -0
  15. mt-gen6fix-gemma-2-9b-i1-Q3_K_L.gguf +3 -0
  16. mt-gen6fix-gemma-2-9b-i1-Q3_K_M.gguf +3 -0
  17. mt-gen6fix-gemma-2-9b-i1-Q3_K_S.gguf +3 -0
  18. mt-gen6fix-gemma-2-9b-i1-Q4_K_M.gguf +3 -0
  19. mt-gen6fix-gemma-2-9b-i1-Q4_K_S.gguf +3 -0
  20. mt-gen6fix-gemma-2-9b-i1-Q5_K_M.gguf +3 -0
  21. mt-gen6fix-gemma-2-9b-i1-Q5_K_S.gguf +3 -0
  22. mt-gen6fix-gemma-2-9b-i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,23 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ MT-Gen6fix-gemma-2-9B.imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ mt-gen6fix-gemma-2-9b-i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ mt-gen6fix-gemma-2-9b-i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ mt-gen6fix-gemma-2-9b-i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ mt-gen6fix-gemma-2-9b-i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
41
+ mt-gen6fix-gemma-2-9b-i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ mt-gen6fix-gemma-2-9b-i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ mt-gen6fix-gemma-2-9b-i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
44
+ mt-gen6fix-gemma-2-9b-i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
45
+ mt-gen6fix-gemma-2-9b-i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
46
+ mt-gen6fix-gemma-2-9b-i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ mt-gen6fix-gemma-2-9b-i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
48
+ mt-gen6fix-gemma-2-9b-i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
49
+ mt-gen6fix-gemma-2-9b-i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
50
+ mt-gen6fix-gemma-2-9b-i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ mt-gen6fix-gemma-2-9b-i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
52
+ mt-gen6fix-gemma-2-9b-i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
53
+ mt-gen6fix-gemma-2-9b-i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
54
+ mt-gen6fix-gemma-2-9b-i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
55
+ mt-gen6fix-gemma-2-9b-i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
MT-Gen6fix-gemma-2-9B.imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:087b4a4814d1aa08b62030fe7a1a4b992fed0bdddd761e6f0b9f8ebf3e9eeb35
3
+ size 6116891
README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: zelk12/MT-Gen6fix-gemma-2-9B
3
+ language:
4
+ - en
5
+ license: mit
6
+ quantized_by: SpongeQuant
7
+ tags:
8
+ - SpongeQuant
9
+ - i1-GGUF
10
+ ---
11
+
12
+
13
+ Quantized to `i1-GGUF` using [SpongeQuant](https://github.com/SpongeEngine/SpongeQuant), the Oobabooga of LLM quantization. Chat & support at [Sponge Engine](https://discord.gg/azNmr2Gdgy).
14
+
15
+ <figure>
16
+ <img src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/023.png" alt="23. Anatomy 6 (Muscles front)">
17
+ <figcaption>23. Anatomy 6 (Muscles front)</figcaption>
18
+ </figure>
19
+
20
+ <figure>
21
+ <audio controls>
22
+ <source src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/004.mp3" type="audio/mp3">
23
+ Your browser does not support the audio element.
24
+ </audio>
25
+ <figcaption>4. The Sounds Of Earth</figcaption>
26
+ </figure>
mt-gen6fix-gemma-2-9b-i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9bb054569fd827c86ed3831e951c046ef9ff20d1dc1ec2800c26b85c47913393
3
+ size 3434669824
mt-gen6fix-gemma-2-9b-i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8158cddf10068fa78084d20ab5c528e1219d85faae99e9da76efb7b7842d3f30
3
+ size 3211486976
mt-gen6fix-gemma-2-9b-i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:127cca70a23ce08d61f574cea98f051a6a9f3c36c3d9063c00ff8b1bc029c3f2
3
+ size 3067381504
mt-gen6fix-gemma-2-9b-i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6de2d48dcdc06d06d644f6abfff38a4d20cae47f9f90e3d0979a8c1be90c4b9b
3
+ size 2824931072
mt-gen6fix-gemma-2-9b-i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6121d87dda80397aab7af96aa9e9dc3a42c7bb45c07324442a8331992cab2c30
3
+ size 4494616320
mt-gen6fix-gemma-2-9b-i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38a1816f98b57ef4cab11a3e555d09ba1bd945f457aa0338815a1eb52a6c98ba
3
+ size 4337665792
mt-gen6fix-gemma-2-9b-i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a28f2b388fc5d3fe5dab88837497d51bb3e2f820ed487c200266e277d74701b8
3
+ size 4144989952
mt-gen6fix-gemma-2-9b-i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1519af91749619cd29b7d50a154c46643998caff74ba0ff3ae4a05ed5a8a70aa
3
+ size 3796739840
mt-gen6fix-gemma-2-9b-i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5dc767fd2cabf0388ae4e5c19c162088cdc1c16906369da1f3f06e99089b5f0e
3
+ size 5443143424
mt-gen6fix-gemma-2-9b-i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b5fde4bec41181b15dfc8d7b7925f2d70ae5b83c852d4cfc82c9f032a171f19
3
+ size 5183031040
mt-gen6fix-gemma-2-9b-i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57e50baa444628f37cc4daf25aedabd3b27c4bb70acb8a79bbeb612ba525ecbc
3
+ size 3805398784
mt-gen6fix-gemma-2-9b-i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a933786939cf9a96ff55727bf3600e96348494441bd15458456633afdf7c0414
3
+ size 5132453632
mt-gen6fix-gemma-2-9b-i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44ecce90c0ff0269c1ea39c35af178ba36883dff8d259fad8c3b2a091f2d684a
3
+ size 4761782016
mt-gen6fix-gemma-2-9b-i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53c77c6e63f5181404a7c2f547e9521fe1a0e142b4e6d53a4420694ed2316e2c
3
+ size 4337665792
mt-gen6fix-gemma-2-9b-i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3939b0b18d92a754c0dab66322bd68777981cc66b375e03055133e3298ece5a8
3
+ size 5761058560
mt-gen6fix-gemma-2-9b-i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32114408349bca2c10e7a14e23e8ae63fd13f8626c1d79cd7d86f890d0aee4c7
3
+ size 5478926080
mt-gen6fix-gemma-2-9b-i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7458b6e855f0362a1f86e9d4f72bdd0a77e024b8e3c5fca0e9f701682abdeaa
3
+ size 6647367424
mt-gen6fix-gemma-2-9b-i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2042572f88908341bf7c02f830ecbd06b9a4261c76c07ce4f7332fa009115a8a
3
+ size 6483592960
mt-gen6fix-gemma-2-9b-i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d02a8f67fd2832d7d2f8477217b43a289851ad3d74f0ce5d28927863b12fcbe3
3
+ size 7589070592