Issue to download MLM enabled Ab-Roberta
Hi,
I only could download the version without MLM head. When i ran model = AutoModelForMaskedLM.from_pretrained("mogam-ai/Ab-RoBERTa"), it gave me "Some weights of RobertaForMaskedLM were not initialized from the model checkpoint at mogam-ai/Ab-RoBERTa and are newly initialized: ['lm_head.bias', 'lm_head.decoder.bias', 'lm_head.dense.bias', 'lm_head.dense.weight', 'lm_head.layer_norm.bias', 'lm_head.layer_norm.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference."
Could you please help me to figure this out?
Thanks
Sorry for the late response.
For broader usages and to better support your application, we have re-uploaded the model with the MLM layer included. We hope this helps with your study.
If you have any other problems, please feel free to contact us.