Update README.md
Browse files
README.md
CHANGED
|
@@ -60,9 +60,12 @@ We release DiscoLeo-8B in the following configurations:
|
|
| 60 |
Here's how to use the model with transformers:
|
| 61 |
```python
|
| 62 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
|
|
|
|
|
|
|
|
| 63 |
|
| 64 |
model = AutoModelForCausalLM.from_pretrained(
|
| 65 |
-
"DiscoResearch/Llama3-DiscoLeo-Instruct-8B-v0.1",
|
| 66 |
torch_dtype="auto",
|
| 67 |
device_map="auto"
|
| 68 |
)
|
|
|
|
| 60 |
Here's how to use the model with transformers:
|
| 61 |
```python
|
| 62 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 63 |
+
import torch
|
| 64 |
+
|
| 65 |
+
device="cuda"
|
| 66 |
|
| 67 |
model = AutoModelForCausalLM.from_pretrained(
|
| 68 |
+
"DiscoResearch/Llama3-DiscoLeo-Instruct-8B-32k-v0.1",
|
| 69 |
torch_dtype="auto",
|
| 70 |
device_map="auto"
|
| 71 |
)
|