DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domains
Yanis Labrak, Adrien Bazoge, Richard Dufour, Mickaël Rouvier, Emmanuel Morin, Béatrice Daille, Pierre‐Antoine Gourraud
This paper introduces DrBERT, a French biomedical pre-trained language model trained on both public and private medical data, showing improved performance through further pre-training on targeted data.
bioRxiv · Apr 3, 2023 · PreprintBioinformatics