BioWiC: An Evaluation Benchmark for Biomedical Concept Representation
Hossein Rouhizadeh, Irina Nikishina, Anthony Yazdani, Alban Bornet, Boya Zhang, Julien Ehrsam, Christophe Gaudet-Blavignac, Nona Naderi, Douglas Teodoro
The paper introduces BioWiC, a benchmark to evaluate how well language models represent biomedical concepts in context, and establishes baselines using various large language models.
bioRxiv · Nov 8, 2023 · PreprintBioinformatics