Fill-Mask
Transformers
Safetensors
French
modernbert
biomedical
clinical
encoder
Eval Results (legacy)
Instructions to use almanach/ModernCamemBERT-bio-large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use almanach/ModernCamemBERT-bio-large with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="almanach/ModernCamemBERT-bio-large")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("almanach/ModernCamemBERT-bio-large") model = AutoModelForMaskedLM.from_pretrained("almanach/ModernCamemBERT-bio-large") - Notebooks
- Google Colab
- Kaggle
Update citation with arXiv ID 2605.12438
Browse files
README.md
CHANGED
|
@@ -243,11 +243,14 @@ Apache 2.0
|
|
| 243 |
## Citation
|
| 244 |
|
| 245 |
```bibtex
|
| 246 |
-
@
|
| 247 |
-
|
| 248 |
-
|
| 249 |
-
|
| 250 |
-
|
|
|
|
|
|
|
|
|
|
| 251 |
}
|
| 252 |
```
|
| 253 |
|
|
|
|
| 243 |
## Citation
|
| 244 |
|
| 245 |
```bibtex
|
| 246 |
+
@misc{touchent2026causallanguagemodelingdetour,
|
| 247 |
+
title={A Causal Language Modeling Detour Improves Encoder Continued Pretraining},
|
| 248 |
+
author={Rian Touchent and Eric de la Clergerie},
|
| 249 |
+
year={2026},
|
| 250 |
+
eprint={2605.12438},
|
| 251 |
+
archivePrefix={arXiv},
|
| 252 |
+
primaryClass={cs.CL},
|
| 253 |
+
url={https://arxiv.org/abs/2605.12438},
|
| 254 |
}
|
| 255 |
```
|
| 256 |
|