Fill-Mask
Transformers
PyTorch
Joblib
Safetensors
DNA
biology
genomics
custom_code

output embedding-dim erro

#2
by junru030103 - opened

“In the hyperparameter dictionary of the 100M model, emb-dim is set to 512, but the final extracted embedding dimension is 1024.”
like:
]$ python 0_example_run.py
Downloading model's hyperparameters json file...
Downloaded model's hyperparameters.
Downloading model's weights...
Downloaded model's weights...
WARNING:2025-12-02 19:30:21,374:jax._src.xla_bridge:864: An NVIDIA GPU may be present on this machine, but a CUDA-enabled jaxlib is not installed. Falling back to cpu.
(2, 32, 1024)

Sign up or log in to comment