RedHatAI
/

mpt-7b-chat-pruned50-quant-ds

Text Generation

Model card Files Files and versions Community

mgoin commited on Sep 29, 2023

Commit

c0152d0

·

1 Parent(s): 035d17e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -5,5 +5,5 @@ tags:
 ```python
 import deepsparse
 model = deepsparse.Pipeline.create(task="text-generation", model_path="hf:mgoin/mpt-7b-chat-50pruned-quant")
-model(sequences="Tell me a joke.")
 ```

 ```python
 import deepsparse
 model = deepsparse.Pipeline.create(task="text-generation", model_path="hf:mgoin/mpt-7b-chat-50pruned-quant")
+model("Tell me a joke.", max_new_tokens=50)
 ```