Revisiting the Kuleshov effect with authentic films: A behavioral and fMRI study

Abstract

As a fundamental film theory, montage theory posits that film editing significantly influences the viewers perception. The Kuleshov effect, a central concept in montage theory, proposes that the emotional interpretation of neutral facial expressions is influenced by the accompanying emotional scene in a face-scene-face sequence. However, concerns persist regarding the validity of previous studies, often employing inauthentic film materials like static images, leaving the question of its existence in authentic films unanswered. This study addresses these concerns by utilizing authentic films in two experiments. In Experiment 1, multiple film clips were captured under the guidance of a professional film director and seamlessly integrated into authentic film sequences. A total of 59 participants viewed these face-scene-face film sequences and were tasked with rating the valence of neutral faces. The findings revealed that the interpretation of emotion in neutral faces is significantly influenced by the accompanying fearful or happy scene, eliciting perceptions of negative or positive emotion from the neutral face. These results affirm the existence of the Kuleshov effect within authentic film sequences. In Experiment 2, 31 participants engaged in a similar task under functional magnetic resonance imaging (fMRI). The results revealed neural correlates supporting the existence of the Kuleshov effect at a neural level. These correlates include the cuneus, precuneus, hippocampus, parahippocampal gyrus, post cingulate gyrus, orbitofrontal cortex, fusiform gyrus, and insula. These findings also underscore the contextual framing inherent in the Kuleshov effect. By seamlessly integrating film theory and cognitive neuroscience experiments, this comprehensive study provides robust evidence supporting the existence of the Kuleshov effect. It significantly enhances our understanding of film editing and its profound impact on viewers perception.