File size: 497 Bytes
4c7c723 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |
# Shakespeare GPT Model
This is a GPT model trained on Shakespeare's text. The model has the following specifications:
- Vocabulary Size: 65
- Number of Layers: 12
- Number of Heads: 16
- Embedding Dimension: 1024
- Context Length: 256
- Total Parameters: 151.37M
## Usage
```python
from transformers import AutoModel
model = AutoModel.from_pretrained("jatingocodeo/shakespeare-decoder")
```
## Training
This model was trained on Shakespeare's text with a target loss of < 0.099999.
|