Commit
·
4c4c31f
1
Parent(s):
3759066
Update README.md
Browse files
README.md
CHANGED
@@ -28,18 +28,15 @@ There are several factors to consider when choosing a university:
|
|
28 |
|
29 |
```python
|
30 |
from deepsparse import TextGeneration
|
31 |
-
|
32 |
generation_config = {
|
33 |
"repetition_penalty": 1.1,
|
34 |
"do_sample": True,
|
35 |
"max_new_tokens": 500,
|
36 |
}
|
37 |
-
|
38 |
prompt = "How to get in a good university?"
|
39 |
formatted_prompt = f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
|
40 |
|
41 |
model = TextGeneration(model="hf:nm-testing/TinyLlama-1.1B-Chat-v0.4-pruned60-quant")
|
42 |
-
|
43 |
print(model(formatted_prompt, generation_config=generation_config,).generations[0].text)
|
44 |
"""
|
45 |
The university is one of the best options for students. It provides the right atmosphere for studying. The
|
|
|
28 |
|
29 |
```python
|
30 |
from deepsparse import TextGeneration
|
|
|
31 |
generation_config = {
|
32 |
"repetition_penalty": 1.1,
|
33 |
"do_sample": True,
|
34 |
"max_new_tokens": 500,
|
35 |
}
|
|
|
36 |
prompt = "How to get in a good university?"
|
37 |
formatted_prompt = f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
|
38 |
|
39 |
model = TextGeneration(model="hf:nm-testing/TinyLlama-1.1B-Chat-v0.4-pruned60-quant")
|
|
|
40 |
print(model(formatted_prompt, generation_config=generation_config,).generations[0].text)
|
41 |
"""
|
42 |
The university is one of the best options for students. It provides the right atmosphere for studying. The
|