RedHatAI
/

mpt-7b-chat-pruned50-quant-ds

Text Generation

Model card Files Files and versions

mgoin commited on Sep 29, 2023

Commit

035d17e

·

1 Parent(s): 2cb3b69

Update README.md

Files changed (1) hide show

README.md +1 -4

README.md CHANGED Viewed

@@ -4,9 +4,6 @@ tags:
 ---
 ```python
 import deepsparse
-from huggingface_hub import snapshot_download
-MODEL_PATH = snapshot_download(repo_id="mgoin/mpt-7b-chat-50pruned-quant")
-model = deepsparse.Pipeline.create(task="text-generation", model_path=MODEL_PATH)
 model(sequences="Tell me a joke.")
 ```

 ---
 ```python
 import deepsparse
+model = deepsparse.Pipeline.create(task="text-generation", model_path="hf:mgoin/mpt-7b-chat-50pruned-quant")
 model(sequences="Tell me a joke.")
 ```