experimental 4-bit dynamic quant using unsloth, these model will be used for inference and RoPE fine-tuning.
huggingkot
huggingkot
AI & ML interests
None yet
Recent Activity
updated
a collection
about 1 month ago
GPT-SoVITS
updated
a model
about 1 month ago
huggingkot/Verina-GPT-SoVITS-v2ProPlus-DPO-EN-JA-ZH
published
a model
about 1 month ago
huggingkot/Verina-GPT-SoVITS-v2ProPlus-DPO-EN-JA-ZH
Organizations
None yet
models
73
huggingkot/Verina-GPT-SoVITS-v2ProPlus-DPO-EN-JA-ZH
Text-to-Speech
•
Updated
huggingkot/Lily-Qwen1.5-0.5B-q4f16_1-MLC
Text Generation
•
Updated
•
4
huggingkot/Lily-Qwen1.5-0.5B-bnb-4bit
0.3B
•
Updated
•
4
huggingkot/Nano_Imp_1B-bnb-4bit
0.8B
•
Updated
•
4
huggingkot/Nano_Imp_1B-q4f16_1-MLC
Text Generation
•
Updated
•
3
•
1
huggingkot/Llama-3-Karamaru-v1-q4f16_1-MLC
Text Generation
•
Updated
•
5
huggingkot/Llama-3-ELYZA-JP-8B-q4f16_1-MLC
Text Generation
•
Updated
•
7
huggingkot/Llama-3-ELYZA-JP-8B-bnb-4bit
5B
•
Updated
•
6
huggingkot/Llama-3-Karamaru-v1-bnb-4bit
5B
•
Updated
•
6
huggingkot/Rei-V2-12B-q4f16_1-MLC
Text Generation
•
Updated
•
2
datasets
0
None public yet