image/png

Lyra4-Gutenberg2-12B-5bpw-h6-exl2

This is a 5bpw h6 exl2 quant of Lyra4-Gutenberg2-12B

Built-in(default) calibration dataset is used.

Downloads last month
13
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for riveRiPH/Lyra4-Gutenberg2-12B-5bpw-h6-exl2

Quantized
(9)
this model

Collection including riveRiPH/Lyra4-Gutenberg2-12B-5bpw-h6-exl2