ReadyArt
/

QwQ-32B-Snowdrop-v0_EXL2_8.0bpw_H8

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

QwQ-32B-Snowdrop-v0_EXL2_8.0bpw_H8 / README.md

FrenzyBiscuit's picture

Update README.md

6b3423c verified 13 days ago

|

history blame contribute delete

176 Bytes

metadata

base_model:
  - trashpanda-org/QwQ-32B-Snowdrop-v0
library_name: transformers
base_model_relation: quantized

EXL2 Quants by FrenzyBiscuit.

This model is 8.0 BPW EXL2.