nm-testing
/

open_llama_3b-pruned50-quant-ds

Text Generation

Model card Files Files and versions Community

mwitiderrick commited on Dec 5, 2023

Commit

cbaeee2

·

1 Parent(s): 5d772d6

Update README.md

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -48,8 +48,7 @@ For details on how this model was sparsified, see the `recipe.yaml` in this repo
 ```bash
 git clone https://github.com/neuralmagic/sparseml
 pip install -e "sparseml[transformers]"
-wget https://huggingface.co/neuralmagic/TinyLlama-1.1B-Chat-v0.4-pruned50-quant/raw/main/recipe.yaml # download recipe
-python sparseml/src/sparseml/transformers/sparsification/obcq/obcq.py TinyLlama/TinyLlama-1.1B-Chat-v0.4 open_platypus --recipe recipe.yaml --save True
 python sparseml/src/sparseml/transformers/sparsification/obcq/export.py --task text-generation --model_path obcq_deployment
 cp deployment/model.onnx deployment/model-orig.onnx
 ```

 ```bash
 git clone https://github.com/neuralmagic/sparseml
 pip install -e "sparseml[transformers]"
+python sparseml/src/sparseml/transformers/sparsification/obcq/obcq.py openlm-research/open_llama_3b open_platypus --recipe recipe.yaml --save True
 python sparseml/src/sparseml/transformers/sparsification/obcq/export.py --task text-generation --model_path obcq_deployment
 cp deployment/model.onnx deployment/model-orig.onnx
 ```