Update README.md
Browse files
README.md
CHANGED
|
@@ -81,6 +81,8 @@ Another thing I noticed, while I tuned a few other bases, is that this one is ex
|
|
| 81 |
|
| 82 |
There's some slop in the base, whispers, shivers, all the usual offenders. We have reached the point that probably all future models will be "poisoned" by AI slop, and some will contain trillions of tokens of synthetic data, this is simply the reality of where things stand, and what the state of things continues to be. Already there are ways around it with various samplers, DPO, etc etc... It is what it is.
|
| 83 |
|
|
|
|
|
|
|
| 84 |
After feedback, testing, and UGI eval, I concluded that this is not exactly a "base model." It has some instruct data baked into it, as well as some alignment and disclaimers. Is it perfect? No. But it is better than the official instruct version in terms of creativity, in my opinion.
|
| 85 |
|
| 86 |
## Enjoy the model :)
|
|
|
|
| 81 |
|
| 82 |
There's some slop in the base, whispers, shivers, all the usual offenders. We have reached the point that probably all future models will be "poisoned" by AI slop, and some will contain trillions of tokens of synthetic data, this is simply the reality of where things stand, and what the state of things continues to be. Already there are ways around it with various samplers, DPO, etc etc... It is what it is.
|
| 83 |
|
| 84 |
+
**Update after testing:**
|
| 85 |
+
|
| 86 |
After feedback, testing, and UGI eval, I concluded that this is not exactly a "base model." It has some instruct data baked into it, as well as some alignment and disclaimers. Is it perfect? No. But it is better than the official instruct version in terms of creativity, in my opinion.
|
| 87 |
|
| 88 |
## Enjoy the model :)
|