Context size
#1
by swtb - opened
What's the recommended context limit for this model? Any benchmarks for long contexts?
You can generally find context windows for HF models in their config.json file.
One of these two:
"max_position_embeddings": 8194
"max_length": 512
8194 is correct