nm-testing
/

open-llama-3b-v2-instruct-pruned50-quant-ds

Text Generation

Model card Files Files and versions Community

mwitiderrick commited on Jan 10, 2024

Commit

6350b85

·

1 Parent(s): 01a8101

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -29,7 +29,7 @@ user_message = 'How many days are there in a leap year?'
 formatted_prompt = f'### System:\n{system_message}<|endoftext|>\n### User:\n{user_message}<|endoftext|>\n### Assistant:\n'
-model = TextGeneration(model_path="hf:nm-testing/open_llama_3b-pruned-quant-50")
 print(model(formatted_prompt, max_new_tokens=200,repetition_penalty=1.05).generations[0].text)
 """

 formatted_prompt = f'### System:\n{system_message}<|endoftext|>\n### User:\n{user_message}<|endoftext|>\n### Assistant:\n'
+model = TextGeneration(model_path="hf:nm-testing/open-llama-3b-v2-instruct-pruned50-quant-ds")
 print(model(formatted_prompt, max_new_tokens=200,repetition_penalty=1.05).generations[0].text)
 """