Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,9 @@ This is the 26 categorical finetune of nomic-bert-2048's encoder.
|
|
| 14 |
|
| 15 |
453,800,000 - 385-512 token samples with 30% mask rate
|
| 16 |
|
| 17 |
-
|
|
|
|
|
|
|
| 18 |
|
| 19 |
The model has learned to categorize certain masked patterns with their categories and special tokens.
|
| 20 |
|
|
|
|
| 14 |
|
| 15 |
453,800,000 - 385-512 token samples with 30% mask rate
|
| 16 |
|
| 17 |
+
227,328,000 - 1024 token samples with 30% mask rate
|
| 18 |
+
|
| 19 |
+
Total samples; 1,456,128,000
|
| 20 |
|
| 21 |
The model has learned to categorize certain masked patterns with their categories and special tokens.
|
| 22 |
|