Model dimension
#2
by wilfredomartel - opened
If this model inherits modernBert dimension, does that means that the hidden size is 768, right ?
Hi @wilfredomartel , if you check the config.json, you'll see that all our models use a hidden size of 768, consistent with the ModernBERT dimension.
dtamayo changed discussion status to closed