π Scaling Laws with Vocabulary
Collection
Increase your vocabulary size when you scale up your language model
β’
5 items
β’
Updated
β’
6
The trained BPE tokenziers with various vocabulary sizes, which uses to study how the vocabulary size affects the performance of language models.