Spaces:

ggml-org
/

gguf-my-repo

Running on A10G

Model pruning

#179

by Clausss - opened 14 days ago

14 days ago

as far I know(fix me if I am wrong) llama-quantize now supports layer pruning via the --prune-layers flag
so is possible to prune model?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment