π Scaling Laws with Vocabulary
Collection
Increase your vocabulary size when you scale up your language model β’ 5 items β’ Updated β’ 7
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
The trained BPE tokenziers with various vocabulary sizes, which uses to study how the vocabulary size affects the performance of language models.