Systematic benchmarking demonstrates large language models have not reached the diagnostic accuracy of traditional rare-disease decision support tools
Justin Reese, Leonardo Chimirri, Yasemin Bridges, Daniel Danis, John Harry Caufield, Michael A. Gargano, Carlo Kroll, Andrew W. Schmeder, Fengchen Liu, Kyran Wissink, Julie A. McMurry, Adam S L Graefe, Enock Niyonkuru, Daniel Korn, Elena Casiraghi, , Peter N. Robinson
This study benchmarks large language models against a traditional diagnostic tool for genetic disease diagnosis using 5,213 case reports, finding LLMs lag behind in accuracy.
European Journal of Human Genetics · Feb 24, 2026Peer-reviewedGenetic & Genomic Medicine