AutoAWQ-INT4-gs64 - a fbaldassarri Collection

fbaldassarri 's Collections

AutoRound-INT4-gs128

AutoGPTQ-INT4-gs128

AutoAWQ-INT4-gs128

AutoAWQ-INT4-gs64

AutoRound-INT8-gs128

AutoGPTQ-INT8-gs128

AutoAWQ-INT4-gs64

updated Jan 8

A collection of models quantized in AutoAWQ format using Intel AutoRound, INT4, groupsize 64

fbaldassarri/HuggingFaceTB_SmolLM2-360M-Instruct-auto_awq-int4-gs64-asym

Text Generation • Updated Jan 4 • 84
fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_awq-int4-gs64-asym

Text Generation • Updated Jan 4 • 84
fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_awq-int4-gs64-sym

Text Generation • Updated Jan 4 • 80
fbaldassarri/HuggingFaceTB_SmolLM2-135M-auto_awq-int4-gs64-asym

Text Generation • Updated Jan 4 • 81
fbaldassarri/HuggingFaceTB_SmolLM2-135M-auto_awq-int4-gs64-sym

Text Generation • Updated Jan 4 • 80
fbaldassarri/HuggingFaceTB_SmolLM2-135M-Instruct-auto_awq-int4-gs64-asym

Text Generation • Updated Jan 4 • 80
fbaldassarri/HuggingFaceTB_SmolLM2-135M-Instruct-auto_awq-int4-gs64-sym

Text Generation • Updated Jan 4 • 81
fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autoawq-int4-gs64-asym

Text Generation • Updated Jan 4 • 7
fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autoawq-int4-gs64-sym

Text Generation • Updated Jan 4 • 5
fbaldassarri/HuggingFaceTB_SmolLM2-360M-Instruct-auto_awq-int4-gs64-sym

Text Generation • Updated Jan 5 • 81