Update README.md
Browse files
README.md
CHANGED
@@ -23,8 +23,10 @@ Note: To compile the mistralai/Mistral-7B-Instruct-v0.2 on Inf2, you need to upd
|
|
23 |
>>> from optimum.neuron import pipeline
|
24 |
|
25 |
>>> p = pipeline('text-generation', 'davidshtian/Mistral-7B-Instruct-v0.2-neuron-1x2048-2-cores')
|
26 |
-
>>> p("My favorite place on earth is", max_new_tokens=
|
27 |
-
[{'generated_text': 'My favorite place on earth is
|
|
|
|
|
28 |
```
|
29 |
|
30 |
This repository contains tags specific to versions of `neuronx`. When using with 🤗 `optimum-neuron`, use the repo revision specific to the version of `neuronx` you are using, to load the right serialized checkpoints.
|
|
|
23 |
>>> from optimum.neuron import pipeline
|
24 |
|
25 |
>>> p = pipeline('text-generation', 'davidshtian/Mistral-7B-Instruct-v0.2-neuron-1x2048-2-cores')
|
26 |
+
>>> p("My favorite place on earth is", max_new_tokens=64, do_sample=True, top_k=50)
|
27 |
+
[{'generated_text': 'My favorite place on earth is Hawaii,” she said, her voice bright and clear despite her quietness.
|
28 |
+
“That place, and the ocean. But it’s hard to ever live there permanently. The ocean is there and it calls to me, but
|
29 |
+
it’s big and vast and doesn’t allow me a lot of freedom.”'}]
|
30 |
```
|
31 |
|
32 |
This repository contains tags specific to versions of `neuronx`. When using with 🤗 `optimum-neuron`, use the repo revision specific to the version of `neuronx` you are using, to load the right serialized checkpoints.
|