A Deep Neural Network Model of Audiovisual Speech Recognition Reports the McGurk Effect
Haotian Ma, Zhengjia Wang, Xiang Zhang…·Michael S. Beauchamp
The paper demonstrates that a deep neural network model, AVHuBERT, can replicate the McGurk effect, showing similar perceptual responses to humans when exposed to audiovisual speech stimuli.