Context size

#1
by swtb - opened

What's the recommended context limit for this model? Any benchmarks for long contexts?

You can generally find context windows for HF models in their config.json file.

One of these two:
"max_position_embeddings": 8194
"max_length": 512

8194 is correct

Sign up or log in to comment