Evaluating disease similarity using latent Dirichlet allocation
Abstract
Measures of similarity between diseases have been used for applications from discovering drug-target interactions to identifying disease-gene relationships. It is challenging to quantitatively compare diseases because much of what we know about them is captured in free text descriptions. Here we present an application of Latent Dirichlet Allocation as a way to measure similarity between diseases using textual descriptions. We learn latent topic representations of text from Online Mendelian Inheritance in Man records and use them to compute similarity. We assess the performance of this approach by comparing our results to manually curated relationships from the Disease Ontology. Despite being unsupervised, our model recovers a records curated Disease Ontology relations with a mean Receiver Operating Characteristic Area Under the Curve of 0.80. With low dimensional models, topics tend to represent higher level information about affected organ systems, while higher dimensional models capture more granular genetic and phenotypic information. We examine topic representations of diseases for mapping concepts between ontologies and for tagging existing text with concepts. We conclude topic modeling on disease text leads to a robust approach to computing similarity that does not depend on keywords or ontology.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Ontology-based similarity calculations with an improved annotation model
Sebastian Köhler·DatabasePeer-reviewed·Jan 1, 2018
- Towards Similarity-based Differential Diagnostics For Common Diseases
Luke T. Slater, Andreas Karwath, … Georgios V. Gkoutos·Computers in Biology and MedicinePeer-reviewed·Apr 1, 2021
- Analysis of new nosological models from disease similarities using clustering
Lucia Prieto Santamaría, Eduardo P. García del Valle, … Gandhi Hernández-Chan·Proceedings - IEEE Symposium on Computer-Based Medical SystemsPeer-reviewed·Jul 1, 2020
- Semantic Disease Gene Embeddings (SmuDGE): phenotype-based disease gene prioritization without phenotypes
Mona Alshahrani, Robert Hoehndorf·BioinformaticsPeer-reviewed·Jul 5, 2018
- Identification of disease mechanisms and novel disease genes using clinical concept embeddings learned from massive amounts of biomedical data.
Andrej E. Bugrim·bioRxiv·Apr 27, 2023
- Performance of Information Theory Derived Semantic Similarity Algorithms for Differential Diagnosis and Clustering
Ben D Coleman, Daniel Daniš, … Peter N. Robinson·bioRxiv·Nov 17, 2025