neuralmagic
/

TinyLlama-1.1B-Chat-v0.4-pruned50-quant-ds

Text Generation

Model card Files Files and versions Community

mwitiderrick commited on Nov 29, 2023

Commit

fc9184a

·

1 Parent(s): af84c8d

Update README.md

Files changed (1) hide show

README.md +2 -4

README.md CHANGED Viewed

@@ -81,10 +81,8 @@ There are many factors to consider when choosing a university. Here are some tip
 ```bash
 git clone https://github.com/neuralmagic/sparseml
 pip install -e "sparseml[transformers]" "torch<2"
-cd sparseml
-git checkout update/onnx_export/duplicate
-python src/sparseml/transformers/sparsification/obcq/obcq.py TinyLlama/TinyLlama-1.1B-Chat-v0.4 open_platypus --recipe recipe.yaml --save True
-python src/sparseml/transformers/sparsification/obcq/export.py --task text-generation --model_path obcq_deployment
 cp deployment/model.onnx deployment/model-orig.onnx
 python onnx_kv_inject.py --input-file deployment/model-orig.onnx --output-file deployment/model.onnx
 ```

 ```bash
 git clone https://github.com/neuralmagic/sparseml
 pip install -e "sparseml[transformers]" "torch<2"
+python sparseml/src/sparseml/transformers/sparsification/obcq/obcq.py TinyLlama/TinyLlama-1.1B-Chat-v0.4 open_platypus --recipe recipe.yaml --save True
+python sparseml/src/sparseml/transformers/sparsification/obcq/export.py --task text-generation --model_path obcq_deployment
 cp deployment/model.onnx deployment/model-orig.onnx
 python onnx_kv_inject.py --input-file deployment/model-orig.onnx --output-file deployment/model.onnx
 ```