Update README.md
Browse files
README.md
CHANGED
@@ -1,15 +1,14 @@
|
|
1 |
|
2 |
-
Training Metrics
|
3 |
-
Dataset Information
|
4 |
|
5 |
-
|
6 |
-
|
7 |
-
|
|
|
8 |
|
9 |
-
Training Results
|
10 |
-
Epoch 3 Performance
|
11 |
-
|
12 |
-
|
13 |
-
Perplexity: 14.71
|
14 |
|
15 |

|
|
|
1 |
|
2 |
+
# Training Metrics
|
|
|
3 |
|
4 |
+
## Dataset Information
|
5 |
+
- Training data per epoch: 1 GB
|
6 |
+
- Total tokens trained: 48,261,120
|
7 |
+
- No sythetic data
|
8 |
|
9 |
+
## Training Results
|
10 |
+
### Epoch 3 Performance
|
11 |
+
- Average Loss: 2.6883
|
12 |
+
- Perplexity: 14.71
|
|
|
13 |
|
14 |

|