turboderp
/

Llama-3.1-8B-Instruct-exl3

Model card Files Files and versions Community

EXL3 quants of Llama-3.1-8B-Instruct

2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including turboderp/Llama-3.1-8B-Instruct-exl3

EXL3 models

11 items • Updated about 8 hours ago • 8