Synthesizing Images of Tau Pathology from Cross-modal Neuroimaging using Deep Learning

Given the prevalence of dementia and the development of pathology-specific disease modifying therapies, high-value biomarker strategies to inform medical decision making are critical. In-vivo tau positron emission tomography (PET) is an ideal target as a biomarker for Alzheimers disease diagnosis and treatment outcome measure. However, tau PET is not currently widely accessible to patients compared to other neuroimaging methods. In this study, we present a convolutional neural network (CNN) model that impute tau PET images from more widely-available cross-modality imaging inputs. Participants (n=1,192) with brain MRI, fluorodeoxyglucose (FDG) PET, amyloid PET, and tau PET were included. We found that a CNN model can impute tau PET images with high accuracy, the highest being for the FDG-based model followed by amyloid PET and MRI. In testing implications of AI-imputed tau PET, only the FDG-based model showed a significant improvement of performance in classifying tau positivity and diagnostic groups compared to the original input data, suggesting that application of the model could enhance the utility of the metabolic images. The interpretability experiment revealed that the FDG- and MRI-based models utilized the non-local input from physically remote ROIs to estimate the tau PET, but this was not the case for the PiB-based model. This implies that the model can learn the distinct biological relationship between FDG PET, MRI, and tau PET from the relationship between amyloid PET and tau PET. Our study suggests that extending neuroimagings use with artificial intelligence to predict protein specific pathologies has great potential to inform emerging care models.