README.md

metadata

license: cc-by-nc-4.0
library_name: transformers
base_model:
  - nbeerbower/Lyra4-Gutenberg2-12B

Lyra4-Gutenberg2-12B-6bpw-h8-exl2

This is a 6bpw h8 exl2 quant of Lyra4-Gutenberg2-12B

Built-in(default) calibration dataset is used.