Using Diffusion Transformers to Generate Synthetic Diffusion Scalar Maps for Data Augmentation

Abstract

Generation of high-quality synthetic brain MRI data could be beneficial for advancing neuroimaging research, particularly when access to large-scale, labeled datasets is limited. In this work, we leverage a pretrained Diffusion Transformer (DiT) architecture to synthesize 3D mean diffusivity (MD) scalar maps from the Cam-CAN dataset. To adapt the DiT model--originally trained on 2D natural images--for 3D neuroimaging data, we implemented a preprocessing strategy that tiles 2D slices from 3D volumes into composite 2D images, enabling effective finetuning. The quality of the generated synthetic images was evaluated using Multi-Scale Structural Similarity (MS-SSIM) and Maximum Mean Discrepancy (MMD) metrics, demonstrating high fidelity and anatomical coherence. To assess the utility of synthetic data in downstream tasks, we conducted transfer learning experiments for dementia classification on the ADNI dataset. A sex classification model, trained on both real and synthetic Cam-CAN data, was repurposed for this task, showing that synthetic samples can enhance model performance. These results highlight the potential of diffusion-based generative models for augmenting neuroimaging datasets and supporting clinical applications.