Noise ceiling on the crossvalidated performance of reweighted models of representational dissimilarity: Addendum to Khaligh-Razavi & Kriegeskorte (2014)
Katherine R. StorrsiD, Seyed‐Mahdi Khaligh‐RazaviiD, Nikolaus KriegeskorteiD
Abstract
An error was made in including noise ceilings for human data in Khaligh-Razavi and Kriegeskorte (2014). For comparability with the macaque data, human data were averaged across participants before analysis. Therefore the noise ceilings indicating variability across human participants do not accurately depict the upper bounds of possible model performance and should not have been shown. Creating noise ceilings appropriate for the fitted models is not trivial. Below we present a method for doing this, and the results obtained with this new method. The corrected results differ from the original results in that the best-performing model (weighted combination of AlexNet layers and category readouts) does not reach the lower bound of the noise ceiling. However, the best-performing model is not significantly below the lower bound of the noise ceiling. The claim that the model "fully explains" the human IT data appears overstated. All other claims of the paper are unaffected.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 17
- Organism
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Beyond accuracy: Measures for assessing machine learning models, pitfalls and guidelines
Richard Dinga, Brenda W.J.H. Penninx, … André F. Marquand·bioRxiv·Aug 22, 2019
- Flexible compression of sensory evidence makes human decisions more resilient to noisy neural computations
Julie Drevet, Lucas Benjamin, … Valentin Wyart·bioRxiv·Oct 28, 2026
- From sound to source: Human and model recognition of environmental sounds
Sagarika Alavilli, Josh H. McDermott·bioRxiv·Aug 1, 2026
- Aligning Model and Macaque Inferior Temporal Cortex Representations Improves Model-to-Human Behavioral Alignment and Adversarial Robustness
Joel Dapello, Kohitij Kar, … James J. DiCarlo·bioRxiv·Jul 1, 2022
- Extreme Value Theory for Modeling Category Decision Boundaries in Visual Recognition
Jin Huang, Deeksha Arun, … Walter J. Scheirer·Journal of VisionPeer-reviewed·Jul 15, 2025
- Humans adaptively select different computational strategies in different learning environments.
Pieter Verbeke, Tom Verguts·Psychological ReviewPeer-reviewed·Apr 15, 2024