Update README.md
Browse files
README.md
CHANGED
|
@@ -18,7 +18,7 @@ license_link: LICENSE
|
|
| 18 |
---
|
| 19 |
|
| 20 |
## Note about eos token
|
| 21 |
-
It seems llama 3 uses different eos tokens depending if it is in instruct mode.
|
| 22 |
The initial upload had some issues with this as it uses the "default" eos token of 128001, but when in instruct mode llama only outputs 128009 as eos token which causes it to ramble on and on without stopping.
|
| 23 |
|
| 24 |
I have uploaded fixed quants with the eos token id manually set to 128009.
|
|
|
|
| 18 |
---
|
| 19 |
|
| 20 |
## Note about eos token
|
| 21 |
+
It seems llama 3 uses a different eos tokens depending if it is in instruct mode.
|
| 22 |
The initial upload had some issues with this as it uses the "default" eos token of 128001, but when in instruct mode llama only outputs 128009 as eos token which causes it to ramble on and on without stopping.
|
| 23 |
|
| 24 |
I have uploaded fixed quants with the eos token id manually set to 128009.
|