Taking a Dive: Experiments in Deep Learning for Automatic Ontology-based Annotation of Scientific Literature
Abstract
I.Text mining approaches for automated ontology-based curation of biological and biomedical literature have largely focused on syntactic and lexical analysis along with machine learning. Recent advances in deep learning have shown increased accuracy for textual data annotation. However, the application of deep learning for ontology-based curation is a relatively new area and prior work has focused on a limited set of models.\n\nHere, we introduce a new deep learning model/architecture based on combining multiple Gated Recurrent Units (GRU) with a character+word based input. We use data from five ontologies in the CRAFT corpus as a Gold Standard to evaluate our models performance. We also compare our model to seven models from prior work. We use four metrics - Precision, Recall, F1 score, and a semantic similarity metric (Jaccard similarity) to compare our models output to the Gold Standard. Our model resulted in a 84% Precision, 84% Recall, 83% F1, and a 84% Jaccard similarity. Results show that our GRU-based model outperforms prior models across all five ontologies. We also observed that character+word inputs result in a higher performance across models as compared to word only inputs.\n\nThese findings indicate that deep learning algorithms are a promising avenue to be explored for automated ontology-based curation of data. This study also serves as a formal comparison and guideline for building and selecting deep learning models and architectures for ontology-based curation.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Biomedical Concept Recognition Using Deep Neural Sequence Models
Negacy Hailu, Michael A. Bada, … Lawrence Hunter·bioRxiv·Jan 25, 2019
- A pan-ontology view of machine-derived knowledge representations and feedback mechanisms for curation
Tomasz Konopka, Damian P. Smedley·bioRxiv·Mar 2, 2021
- BO-LSTM: Classifying relations via long short-term memory networks along biomedical ontologies
André Lamúrias, Diana Sousa, … Francisco M. Couto·BMC BioinformaticsPeer-reviewed·Jan 7, 2019
- Ontology-Aware Biomedical Relation Extraction
Ahmad Aghaebrahimian, Maria O. Anisimova, Manuel Gil·bioRxiv·Mar 22, 2022
- Self-normalizing learning on biomedical ontologies using a deep Siamese neural network
Fatima Zohra Smaili, Xin Gao, Robert Hoehndorf·bioRxiv·Apr 23, 2020
- Using distant supervision to augment manually annotated data for relation extraction
Peng Su, Gang Li, … K. Vijay‐Shanker·PLoS ONEPeer-reviewed·Jul 30, 2019