bioRxivBioinformaticsPreprint
AI-readiness criteria for biomedical data
Timothy ClarkiD, John Harry CaufieldiD, Jillian A. ParkeriD, Mohammad Sadnan Al ManiriD, Edilberto AmorimiD, James A. EddyiD, Nayoon GimiD, Brian J. GowiD, Wesley GoariD, Jan N. HanseniD, Nomi HarrisiD, Henning HermjakobiD, Marcin JoachimiakiD, Gianna JordaniD, In‐Hee LeeiD, Shannon K. McWeeneyiD, Camille NebekeriD, Milen NikoloviD, Sarah J. RatcliffeiD, Justin ReeseiD, Jamie ShafferiD, Nathan C. SheffieldiD, Gloria SheynkmaniD, James StevensoniD, Jake Y. CheniD, , Monica C. Muñoz-TorresiD
Abstract
Biomedical research is rapidly adopting artificial intelligence (AI). Yet the inherent complexity of biomedical data preparation requires implementing actionable, robust criteria for ethical and explainable AI (XAI) at the "pre-model" stage, encompassing data acquisition, detailed transformations, and ethical governance. Simple conformance to FAIR (Findable, Accessible, Interoperable, Reusable) Principles is insufficient. Here, we define criteria and practices for reliable AI-readiness of biomedical data, developed by the NIH Bridge to Artificial Intelligence (Bridge2AI) Standards Working Group across seven core dimensions of dataset AI-readiness: FAIRness, Provenance, Characterization, Ethics, Pre-model Explainability, Sustainability, and Computability. Conformance to these criteria provides a basis for pre-model scientific rigor and ethical integrity, mitigating downstream risks of bias and error prior to AI modeling. We apply and evaluate these standards across all four Bridge2AI flagship datasets, spanning functional genomics to clinical medicine, and encode them in machine-actionable metadata bound to the datasets. This framework sets a benchmark for preparing ethical, reusable datasets in biomedical AI and provides standardized methods for reliable pre-model data evaluation.
- research focus: benchmarking
- research focus: database / resource
- research focus: software / tool
- approach: benchmark study
- Citations
- 32
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- The FAIRSCAPE AI-readiness Framework for Biomedical Research
Mohammad Sadnan Al Manir, Melanie Levinson, … Timothy Clark·bioRxiv·Dec 23, 2024
- A tool for assessing alignment of biomedical data repositories with open, FAIR, citation and trustworthy principles
F. Murphy, M. Bar-Sinai, M. E. Martone·bioRxiv·Jan 19, 2021
- ClaroAI-Bench: Evaluating Agentic Scientific Reproducibility on Real Biomedical Papers
Kyle A. O’Connell·bioRxiv·May 12, 2026
- Dataset Documentation for Responsible AI: Analysis of Suitability and Usage for Health Datasets
Anna Heinke, Lingling Huang, … Majid Rodger·npj Digital MedicinePeer-reviewed·May 9, 2026
- BioSharing: Harnessing Metadata Standards For The Data Commons
Susanna-Assunta Sansone, Alejandra Gonzalez-Beltran, … Milo Thurston·bioRxiv·May 31, 2017
- Bio-medical Big Data Operating System (Bio-OS): An Integrated Data Mining Environment for Data Intensive Scientific Research
Ji‐Long Liu, Liguang Yang, … Yixue Li·bioRxiv·Oct 17, 2024