nm-testing
/

TinyLlama-1.1B-Chat-v1.0-sparse2of4_only-e2e

compressed-tensors

Model card Files Files and versions Community

TinyLlama-1.1B-Chat-v1.0-sparse2of4_only-e2e / recipe.yaml

nm-autobot's picture

Upload folder using huggingface_hub

a455c33 verified 16 days ago

history blame contribute delete

164 Bytes

	sparsity_stage:
	sparsity_modifiers:
	SparseGPTModifier:
	sparsity: 0.5
	mask_structure: '2:4'
	targets: [Linear]
	ignore: ['re:.*lm_head']