bioRxivNeurosciencePreprint
A transformer model for predicting cognitive impairment from sleep
Tzu-An SongiD, Masoud MalekzadehiD, Richa SaxenaiD, Shaun PurcelliD, Joyita DuttaiD
Abstract
Sleep disturbances are known to be aggravated with normal aging. Additionally, sleep disruptions have a potentially bidirectional causal relationship with dementia due to neurodegenerative diseases like Alzheimers disease. Predictive techniques that can automatically detect cognitive impairment from an individuals sleep data have broad clinical and biological significance. Here, we present a deep learning approach based on a transformer architecture to predict cognitive status from sleep electroencephalography (EEG) data. This work uses data from N = 1, 502 subjects from the Multi-Ethnic Study of Atherosclerosis (MESA) cohort. Our transformer model achieves 70.22% accuracy at the binary classification task for distinguishing cognitively normal and impaired subjects based on their sleep EEG. Our method outperforms traditional feature handcrafting, which has an overall accuracy of 57.61% for the same task. We use a sparse regression model to understand and interpret the information captured by each learned feature from our transformer model. To our knowledge, this is the first effort to use deep learning to predict cognitive impairment from sleep metrics.
- organism: human
- assay: electronic health records
- research focus: differential expression
- approach: deep learning
- Citations
- 2
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Self-Supervised Transformer Model Training for a Sleep-EEG Foundation Model
Mattson Ogg, William G. Coon·Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)Peer-reviewed·Jul 15, 2024
- Laying the Foundation: Modern Transformers for Gold-Standard Sleep Analysis and Beyond
William G. Coon, Mattson Ogg·Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)Peer-reviewed·Jul 15, 2024
- TRUSTWORTHY SLEEP STAGING FROM EEG: DEEP ENSEMBLES, MCDROPOUT, AND PREDICTIVE CALIBRATION
Samiksha BC, Dana Vrajitoru·bioRxiv·Aug 23, 2025
- Learning Residual-based Biomarkers of Cognitive Health via Self-Supervised Learning on EEG State Transitions
Thomas Tveitstøl, Mats Tveter, … Ira Haraldsen·bioRxiv·Sep 21, 2025
- SiamEEGNet: Siamese Neural Network-Based EEG Decoding for Drowsiness Detection
Li-Jen Chang, Hsi-An Chen, … Chun-Shu Wei·bioRxiv·Oct 23, 2023
- Multivariate prediction of cognitive performance from the sleep electroencephalogram
Péter P. Ujma, Róbert Bódizs, … Susan S Redline·NeuroImagePeer-reviewed·Aug 11, 2023