An enhanced inverted encoding model for neural reconstructions
Abstract
Here we present a more interpretable and versatile approach for reconstructing the contents of perception, attention, and memory from neuroimaging data. Our enhanced inverted encoding model (eIEM) incorporates theoretical and methodological improvements including proper accounting of population-level tuning functions and a trial-by-trial prediction error-based metric where reconstruction quality is measured in meaningful units. Added functionality and improved flexibility is further gained via eIEMs novel goodness-of-fit feature: for trial-by-trial reconstructions, goodness-of-fits are obtained independently (non-circularly) to prediction error and can be applied to any IEM procedure or decoding metric, resulting in improved reconstruction quality and brain-behavior correlations, and more creative applications. We validate eIEM from methodological principles, simulated neuroimaging datasets, and three pre-existing fMRI datasets spanning perception, attention, and working memory. Notably, eIEM is easy to apply and broadly accessible - our Python package (https://pypi.org/project/inverted-encoding) implements eIEM in one line of code - and is easily modifiable to compare performance metrics and/or scale up to more complex models.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 7
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Inverse Transformed Encoding Models - a solution to the problem of correlated trial-by-trial parameter estimates in fMRI decoding
Joram Soch, Carsten Allefeld, John–Dylan Haynes·NeuroImagePeer-reviewed·Dec 19, 2019
- Mapping multidimensional content representations to neural and behavioral expressions of episodic memory
Yingying Wang, Hongmi Lee, Brice A. Kuhl·NeuroImagePeer-reviewed·Jun 15, 2023
- Mental image reconstruction from human brain activity
Naoko Koide‐Majima, Shinji Nishimoto, Kei Majima·Neural NetworksPeer-reviewed·Nov 9, 2023
- Improving classification and reconstruction of imagined images from EEG signals
Hirokatsu Shimizu, Ramesh Srinivasan·PLoS ONEPeer-reviewed·Sep 21, 2022
- Inverted encoding models estimate sensible channel responses for sensible models
Thomas C. Sprague, Geoffrey M. Boynton, John T. Serences·bioRxiv·May 21, 2019
- Human brain activity during mental imagery exhibits signatures of inference in a hierarchical generative model
Jesse L. Breedlove, Ghislain St-Yves, … Thomas Naselaris·bioRxiv·Nov 10, 2018