GGUF
Inference Endpoints
LoneStriker commited on
Commit
f9f29ea
·
1 Parent(s): fe42e1e

llama.cpp GGUF quantization of LoneStriker/Skywork-13B-airoboros-test

Browse files
Skywork-13B-airoboros-test-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6d3c7b4ec1cc0745d1cf81475f4e3377c21b38c876132f051e7592b72c84c06
3
+ size 6777889504
Skywork-13B-airoboros-test-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a505e176de0f3132207395ade605abf0057f512fb7d7d82d2ae9323f50ebea87
3
+ size 8395803168
Skywork-13B-airoboros-test-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c90d39ebb96879cdc42f66108c68ac8d96535f908a9069f1e75e32d574488f3
3
+ size 11367721792
Skywork-13B-airoboros-test-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c60fd283fef1595a5e677d7491c994678f391e2368529a3bad0f66bed996368
3
+ size 14722897664