bioRxivBioinformaticsPreprint
The FAIRSCAPE AI-readiness Framework for Biomedical Research
Mohammad Sadnan Al ManiriD, Melanie LevinsoniD, Justin C. NiestroyiD, Christopher ChurasiD, Nathan C. SheffieldiD, Brynne SullivaniD, Karen FairchildiD, Monica Munoz-TorresiD, Sarah J. RatcliffeiD, Jillian A. ParkeriD, Trey E. IdekeriD, Timothy ClarkiD
Abstract
ObjectiveBiomedical datasets intended for use in AI applications require packaging with rich pre-model metadata to support model development that is explainable, ethical, epistemically grounded and FAIR (Findable, Accessible, Interoperable, Reusable). MethodsWe developed FAIRSCAPE, a digital commons environment, using agile methods, in close alignment with the team developing the AI-readiness criteria and with the Bridge2AI data production teams. Work was initially based on an existing provenance-aware framework for clinical machine learning. We incrementally added RO-Crate data+metadata packaging and exchange methods, client-side packaging support, provenance visualization, and support metadata mapped to the AI-readiness criteria, with automated AI-readiness evaluation. LinkML semantic enrichment and Croissant ML-ecosystem translations were also incorporated. ResultsThe FAIRSCAPE framework generates, packages, evaluates, and manages critical pre-model AI-readiness and explainability information with descriptive metadata and deep provenance graphs for biomedical datasets. It provides ethical, schema, statistical, and semantic characterization of dataset releases, licensing and availability information, and an automated AI-readiness evaluation across all 28 AI-readiness criteria. We applied this framework to successive, large-scale releases of multimodal datasets, progressively increasing dataset AI-readiness to full compliance. ConclusionFAIRSCAPE enables AI-readiness in biomedical datasets using standard metadata components and has been used to establish this pattern across a major, multimodal NIH data generation program. It eliminates early-stage opacity apparent in many biomedical AI applications and provides a basis for establishing end-to-end AI explainability.
- Citations
- 2
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- AI-readiness criteria for biomedical data
Timothy Clark, John Harry Caufield, … Monica C. Muñoz-Torres·bioRxiv·Oct 23, 2024
- FAIRSCAPE: A Framework for FAIR and Reproducible Biomedical Analytics
Maxwell Adam Levinson, Justin C. Niestroy, … Timothy Clark·NeuroinformaticsPeer-reviewed·Jul 15, 2021
- Developing a standardized but extendable framework to increase the findability of infectious disease datasets
Ginger Tsueng, Marco Alvarado Cano, … Serdar Turkarslan·Scientific DataPeer-reviewed·Feb 23, 2023
- Two real use cases of FAIR maturity indicators in the life sciences
Ammar Ammar, Serena Bonaretti, … Egon Willighagen·NanomaterialsPeer-reviewed·Oct 20, 2020
- FAIRshake: toolkit to evaluate the findability, accessibility, interoperability, and reusability of research digital resources
Daniel J. B. Clarke, Lily Wang, … Avi Ma’ayan·Cell SystemsPeer-reviewed·Nov 1, 2019
- A design framework and exemplar metrics for FAIRness
M. D. Wilkinson, S.-A. Sansone, … M. Dumontier·bioRxiv·Dec 1, 2017