Update README.md

README.md

@@ -1,17 +1,17 @@
 ---
-base_model: TinyLlama/TinyLlama-1.1B-Chat-v0.4
+base_model: openlm-research/open_llama_3b
 inference: false
 model_type: llama
 prompt_template: |
-  <|im_start|>user\n
-  {prompt}<|im_end|>\n
-  <|im_start|>assistant\n
+  Q: 
+  {prompt}
+  \nA
 quantized_by: mwitiderrick
 tags:
 - deepsparse
 ---
-## TinyLlama 1.1B Chat 0.4 - DeepSparse
-This repo contains model files for [TinyLlama 1.1B Chat](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v0.4) optimized for [DeepSparse](https://github.com/neuralmagic/deepsparse), a CPU inference runtime for sparse models.
+## OpenLLaMA 3B - DeepSparse
+This repo contains model files for [OpenLLaMA](https://huggingface.co/openlm-research/open_llama_3b) optimized for [DeepSparse](https://github.com/neuralmagic/deepsparse), a CPU inference runtime for sparse models.
 
 This model was quantized and pruned with [SparseGPT](https://arxiv.org/abs/2301.00774), using [SparseML](https://github.com/neuralmagic/sparseml).
 
@@ -24,50 +24,14 @@ Run in a [Python pipeline](https://github.com/neuralmagic/deepsparse/blob/main/d
 ```python
 from deepsparse import TextGeneration
 
-prompt = "How to make banana bread?"
-formatted_prompt =  f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
+prompt = 'Q: What is the largest animal?\nA:'
+formatted_prompt =  f"Q: {prompt}\nA:"
 
-model = TextGeneration(model="hf:neuralmagic/TinyLlama-1.1B-Chat-v0.4-pruned50-quant")
-print(model(formatted_prompt, max_new_tokens=500).generations[0].text)
+model = TextGeneration(model="deployment")
+print(model(formatted_prompt, max_new_tokens=200).generations[0].text)
 
 """
-Banana bread is a delicious and easy-to-make recipe that is sure to please. Here is a recipe for making banana bread:
-
-Ingredients:
-
-    For the Banana Bread:
-
-    - 1 cup of sugar
-    - 1 cup of flour
-    - 1/2 cup of mashed bananas
-    - 1/4 cup of milk
-    - 1/2 cup of melted butter
-    - 1/4 cup of baking powder
-    - 1/4 cup of baking soda
-    - 1/4 cup of eggs
-    - 1/4 cup of milk
-    - 1/4 cup of sugar
-
-
-Instructions:
-
-    1. Preheat the oven to 325°F (160°C).
-    2. In a large bowl, combine the sugar and flour.
-    3. In a separate bow, combine the mashed bananas, milk, butter, baking powder, baking soda, milk, sugar.
-    4. Add the bananas and milk into the flour-sugar mixture.
-    5. Pour the milk into the bowl of the flour-sugar mixture.
-    6. Pour the baking powder into the bowl of the flour-sugar mixture.
-    7. Pour the mashed bananas into the bowl of the flour-sugar mixture.
-    8. Add the eggs into the bowl of the flour-sugar mixture.
-    9. Stir the mixture until it becomes a dough.
-    10. Grease a 9-inch (23 cm) square pan.
-    11. Pour the mixture into the pan.
-    12. Bake the banana bread in the oven for 40 minutes.
-    13. Remove the banana bread from the oven and cool it.
-    14. Cut the bread into 16 pieces.
-    15. Make the glaze:
-    16. Sprinkle the sugar over the bread.
-    17. Bake the bread in the oven for 30 minutes.
+the in the  in in the   in  in in in in the in the the in in the in in the the the the the in the the in the the in the the in the in the the in the the in the the in in the the the the in in in the the the the in the in in the the the the in the the in the the in the the the the the the the in the the the in the the the the in the the the the in in the the the the the the the in the the the the in the the the in the the in the the the in the the the the the in the the the the the the the the the in the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the
 """
 ```
 ## Prompt template