Standardized human tests show that most vision models are face-blind
Kushal Reddy DudipalaiD, Florencia Martinez AddiegoiD, Dobromir RahneviD, Brad DuchaineiD, N. Apurva Ratan MurtyiD
Abstract
Face recognition ability varies enormously across humans. Individuals with face-blindness (prosopagnosia) struggle to recognize even close family members while super-recognizers can identify strangers with exceptional accuracy. Where do ANNs fall within the human face recognition spectrum? Here, we administered the standardized tests used to characterize human face recognition ability to a diverse set of models, allowing us to contextualize a model's performance within the distribution of human behavior. We found that the majority 55% of models to be classified as face-blind and that even the best face-trained models do not cross the human threshold to be considered a super-recognizer. Interrogating the internal representations of these models showed that models that performed well on standardized face recognition tasks were more identity-selective and viewpoint-invariant. We also found that low-performing models did contain some identity information in independent representational subspaces. Removing viewpoint-dependent subspace improved face recognition abilities in 49 of the 53 models tested. Targeted unit ablations further identified opposing contributions, with viewpoint-dependent units disrupting identity coding and viewpoint-tolerant units supporting it. Together, our results show that most AI models are face-blind with worse face recognition ability than humans, and demonstrate how differences across AI models can be used generate testable hypotheses about the computational basis of human face recognition in humans which can then be probed in future studies.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Decoding face recognition abilities in the human brain
Simon Faghel-Soubeyrand, Meike Ramon, … Ian Charest·PNAS NexusPeer-reviewed·Feb 29, 2024
- Face identity selectivity in the deep neural network and human brain
Jinge Wang, Runnan Cao, … Shuo Wang·bioRxiv·May 12, 2021
- How Visual Experience Shapes Face Processing: Divergent Representational Strategies Emerge from Specialized and Diverse Visual Diets in Artificial Neural Networks
- Mooney Face Image Processing in Deep Convolutional Neural Networks Compared to Humans
Astrid A. Zeman, Tim Leers, Hans Op de Beeck·bioRxiv·Mar 21, 2022
- Behavioral signatures of face perception emerge in deep neural networks optimized for face recognition
Katharina Dobs, Joanne Yuan, … Nancy Kanwisher·Proceedings of the National Academy of SciencesPeer-reviewed·Jul 31, 2023
- Robust neural face identity codes in the Super-Recogniser brain
Martina Ventura, Tijl Grootswagers, … Genevieve L. Quek·bioRxiv·Jun 26, 2026