Update README.md
Browse files
README.md
CHANGED
@@ -70,7 +70,7 @@ print(tokenizer.decode(output))
|
|
70 |
## Model Details
|
71 |
|
72 |
- **Model type:** Transformer-based Language Model
|
73 |
-
- **Total seen tokens
|
74 |
|
75 |
|Params|Layers|Hidden size|Heads|Context length|Embedding parameters|Non-embedding parameters|
|
76 |
|:---:|:---:|:---:|:---:|:---:|:---:|:---:|
|
|
|
70 |
## Model Details
|
71 |
|
72 |
- **Model type:** Transformer-based Language Model
|
73 |
+
- **Total seen tokens:** 2.1T tokens
|
74 |
|
75 |
|Params|Layers|Hidden size|Heads|Context length|Embedding parameters|Non-embedding parameters|
|
76 |
|:---:|:---:|:---:|:---:|:---:|:---:|:---:|
|