metadata
license: llama3.1
EXL3 quants of Llama-3.1-70B-Instruct
1.60 bits per weight / H3
1.80 bits per weight
2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight
