MidnightMiqu

Midnight-Miqu-103B-v1.5-exl2-4.0bpw-rpcal

This is a 4.0bpw EXL2 quant of FluffyKaeloky/Midnight-Miqu-103B-v1.5

The pippa file used for calibration is optimised for roleplay. The measurement file can be found in the files if you want to do your own quants.

Details about the model and the merge info can be found at the fp16 model link above.

Downloads last month
14
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.