Biomarker Fidelity Score - A Quantitative Framework for Individual-Level Validation of Explainability Methods in 3D Alzheimer's Disease MRI Classification
Dawa Chyophel LepchaiD, Aaliya AliiD, Sophie MartiniD, Shabbir Syed-AbduliD
Abstract
Explainability methods applied to deep learning models for Alzheimer's disease neuroimaging produce attribution maps that vary substantially across methods and architectures, yet no validated quantitative framework exists for determining which method most faithfully localises attribution signal within established AD biomarker anatomy at the individual subject level. Existing validation approaches rely on group-level comparisons or qualitative visual inspection, leaving individual-level biomarker alignment uncharacterised. We introduce the Biomarker Fidelity Score (BFS), a quantitative tool measuring spatial overlap between individual-level 3D explainability attention maps and atlas-registered AD-relevant neuroimaging ROIs across thirteen anatomically defined structures including hippocampus, entorhinal cortex, amygdala, and parahippocampal gyrus. Five explainability methods (GradCAM++, Integrated Gradients, DeepSHAP, LRP, ScoreCAM) were benchmarked across three volumetric architectures (3D ResNet-18, DenseNet-121, Swin-UNETR) on 327 balanced ADNI-3 subjects. Integrated Gradients achieved the highest BFS across all architectures while GradCAM++ consistently showed the lowest biomarker alignment (all p<0.001, Friedman test). The complete BFS pipeline replicated these rankings without retraining on 207 independent OASIS-3 subjects, with maximum absolute difference of 0.0005 across all fifteen method-architecture combinations and Spearman rank correlation of 0.964 between cohort rankings. By offering an externally validated, individual-level, biomarker-grounded quantitative standard, BFS equips clinicians and AI developers with practical guidance for selecting trustworthy explainability methods in AD neuroimaging.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Comparison of Explainable AI Models for MRI-based Alzheimer's Disease Classification
Tamoghna Chattopadhyay, Neha Ann Joshy, … Paul M. Thompson·International Symposium on Medical Information Processing and Analysis (SIPAIM)Peer-reviewed·Nov 13, 2024
- Multimodal Hippocampal Subfield Grading For Alzheimer’s Disease Classification
Kilian Hett, Vinh‐Thong Ta, … Randall Griffith·Scientific ReportsPeer-reviewed·Sep 25, 2019
- A machine-learning approach for detection of local brain networks and marginally weak signals identifies novel AD/MCI differentiating connectomic neuroimaging biomarkers
Yanming Li, Jian Kang, … Alzheimer’s Disease Neuroimaging Initiative·bioRxiv·Jul 29, 2021
- Frequency-Aware Interpretable Deep Learning Framework for Alzheimer's Disease Classification Using rs-fMRI
Yutong Gao, Robyn L. Miller, Vince D. Calhoun·bioRxiv·Sep 18, 2025
- Deep learning detection of informative features in tau PET for Alzheimer' s disease classification
Taeho Jo, Kwangsik T. Nho, … Alzheimer’s Disease Neuroimaging Initiative·BMC BioinformaticsPeer-reviewed·Dec 1, 2020
- Assessing the Influence of Tractography Methods on Detected White Matter Microstructure in Alzheimer's disease
Yuhan Shuai, Yixue Feng, … Bramsh Q. Chandio·IEEE International Symposium on Biomedical Imaging (ISBI)Peer-reviewed·Apr 8, 2026