waldie
/

Yi-34B-200K-DARE-merge-v7-4.65bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

quant of brucethemoose's Yi-34B-200K-DARE-merge-v7

python3 convert.py \
    -i /input/brucethemoose_Yi-34B-200K-DARE-merge-v7/ \
    -c /input/pippa_cleaned/0000.parquet \
    -o /output/temp/ \
    -cf /output/Yi-34B-200K-DARE-merge-v7-4.65bpw-h6-exl2/ \
    -l 8192 \
    -ml 8192 \
    -b 4.65 \
    -hb 6

Downloads last month: 13

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.