Cerebral CortexNeurosciencePeer-reviewed journal article
Evaluating fMRI-Based Estimation of Eye Gaze during Naturalistic Viewing
Jake J. SoniD, Lei AiiD, Ryan Woei-Sheng LimiD, Ting XuiD, Stanley J. ColcombeiD, Alexandre R. FrancoiD, Jessica Cloud, Stephen M. LaConteiD, Jonathan M. LisinskiiD, Arno KleiniD, Richard Cameron CraddockiD, Michael Peter MilhamiD
Abstract
The collection of eye gaze information during functional magnetic resonance imaging (fMRI) is important for monitoring variations in attention and task compliance, particularly for naturalistic viewing paradigms (e.g., movies). However, the complexity and setup requirements of current in-scanner eye-tracking solutions can preclude many researchers from accessing such information. Predictive eye estimation regression (PEER) is a previously developed support vector regression-based method for retrospectively estimating eye gaze from the fMRI signal in the eyes orbit using a 1.5-minute calibration scan. Here, we provide confirmatory validation of the PEER methods ability to infer eye gaze on a TR-by-TR basis during movie viewing, using simultaneously acquired eye tracking data in five individuals (median angular deviation < 2{degrees}). Then, we examine variations in the predictive validity of PEER models across individuals in a subset of data (n=448) from the Child Mind Institute Healthy Brain Network Biobank, identifying head motion as a primary determinant. Finally, we accurately classify which of two movies is being watched based on the predicted eye gaze patterns (area under the curve = .90 {+/-} .02) and map the neural correlates of eye movements derived from PEER. PEER is a freely available and easy-to-use tool for determining eye fixations during naturalistic viewing.
- Citations
- 37
- FWCI
- 4.49
- Field percentile
- top 6%
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- fMRI-Based Prediction of Eye Gaze During Naturalistic Movie Viewing Reveals Eye-Movement-Related Brain Activity
Le Gao, Zhi Wei, … Xin Di·PsychoradiologyPeer-reviewed·Jan 1, 2026
- MR-based camera-less eye tracking using deep neural networks
Markus Frey, Matthias Nau, Christian F. Doeller·bioRxiv·Nov 30, 2020
- Template-based prediction of vigilance fluctuations in resting-state fMRI
Maryam Falahpour, Catie E. Chang, … Thomas T. Liu·NeuroImagePeer-reviewed·Mar 18, 2018
- Optimizing MR-based gaze-decoding for eyes-closed eye-tracking in fMRI
Sina M Kling, Uriel Lascombes, … Martin Szinte·bioRxiv·Sep 22, 2026
- Simultaneous fMRI and eye gaze recordings during prolonged natural stimulation -- a studyforrest extension
Michael Hanke, Nico Adelhöfer, … Jörg Stadler·bioRxiv·Mar 31, 2016
- Predicting whole-brain neural dynamics from prefrontal cortex fNIRS signal during movie-watching
Shan Gao, Ryleigh Nash, … Yuan Chang Leong·Social Cognitive and Affective NeurosciencePeer-reviewed·Jan 1, 2025