EXL2 quants of TinyLlama-1B (1.1B)
These are conversions of the 503B checkpoint at step 240k
2.30 bits per weight
2.40 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight