Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
orca_mini_v7_72b-i1-GGUF
like
0
Transformers
GGUF
English
Inference Endpoints
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
d94a522
orca_mini_v7_72b-i1-GGUF
1 contributor
History:
22 commits
mradermacher
uploaded from marco
d94a522
verified
22 days ago
.gitattributes
Safe
3.11 kB
uploaded from marco
22 days ago
README.md
Safe
237 Bytes
uploaded from marco
22 days ago
imatrix.dat
25.2 MB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-IQ1_M.gguf
Safe
23.7 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-IQ1_S.gguf
Safe
22.7 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-IQ2_M.gguf
Safe
29.3 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-IQ2_S.gguf
Safe
27.9 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-IQ2_XS.gguf
Safe
27.1 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-IQ2_XXS.gguf
Safe
25.5 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-IQ3_M.gguf
Safe
35.5 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-IQ3_XXS.gguf
Safe
31.8 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-IQ4_XS.gguf
Safe
39.7 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q2_K.gguf
Safe
29.8 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q2_K_S.gguf
Safe
29.6 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q3_K_L.gguf
Safe
39.5 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q3_K_M.gguf
Safe
37.7 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q3_K_S.gguf
Safe
34.5 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q4_K_M.gguf
Safe
47.4 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q4_K_S.gguf
Safe
43.9 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q5_K_M.gguf.part1of2
27.9 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q5_K_M.gguf.part2of2
26.5 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q5_K_S.gguf.part1of2
25.8 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q5_K_S.gguf.part2of2
25.6 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q6_K.gguf.part1of2
32.2 GB
LFS
uploaded from marco
22 days ago
orca_mini_v7_72b.i1-Q6_K.gguf.part2of2
32.1 GB
LFS
uploaded from marco
22 days ago