Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Mistral-7B-Instruct-v0.3-exl3

Model card Files Files and versions Community
Mistral-7B-Instruct-v0.3-exl3 / README.md
turboderp's picture
turboderp
Update README.md
4bb1adf verified about 2 months ago
preview code
|
raw
history blame
1.29 kB
metadata
license: apache-2.0

EXL3 quants of Mistral-7B-Instruct-v0.3

2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight
8.00 bits per weight / H8

image/png