Papers
arxiv:2204.03951
RuBioRoBERTa: a pre-trained biomedical language model for Russian language biomedical text mining
Published on Apr 8, 2022
Authors:
Abstract
BERT-based models, RuBioBERT and RuBioRoBERTa, pre-trained on Russian biomedical texts achieve top performance on diverse RuMedBench tasks.
AI-generated summary
This paper presents several BERT-based models for Russian language biomedical text mining (RuBioBERT, RuBioRoBERTa). The models are pre-trained on a corpus of freely available texts in the Russian biomedical domain. With this pre-training, our models demonstrate state-of-the-art results on RuMedBench - Russian medical language understanding benchmark that covers a diverse set of tasks, including text classification, question answering, natural language inference, and named entity recognition.
Get this paper in your agent:
hf papers read 2204.03951 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 2
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2204.03951 in a dataset README.md to link it from this page.
Spaces citing this paper 1
Collections including this paper 0
No Collection including this paper
Add this paper to a collection to link it from this page.