Multisensory perception and integration

Multisensory integration across reference frames with additive feed-forward networks

This paper introduces a feed-forward neural network model for multisensory integration across reference frames, showing it can approximate Bayesian inference without explicit divisive normalization.

Visual speech enhances auditory onset timing and envelope tracking through distinct mechanisms

This study investigates how visual speech enhances auditory speech processing by altering theta band power and phase in different brain regions through distinct mechanisms.

Stability of cross-sensory input to primary somatosensory cortex across experience

The paper investigates auditory influences on mouse primary somatosensory cortex and finds that cross-modal responses are sparse, non-specific, and stable across experience.

Bayesian Causal Inference Accounts for Multisensory Filling-In at the Blind Spot

The paper investigates multisensory perception at the blind spot using a Bayesian Causal Inference model, finding preserved integration and flexible parameter adaptation.

Whisker stimulation with different frequencies reveals non-uniform modulation of functional magnetic resonance imaging signal across sensory systems in awake rats

This study uses fMRI to show that whisker stimulation in awake rats activates multiple sensory systems, with distinct responses in core and non-core brain regions, and that anesthesia obscures high-order processing.

Direct piriform-to-auditory cortical projections shape auditory-olfactory integration

This study identifies a direct piriform-to-auditory cortical circuit that modulates auditory responses to odors in mice.

Perception - action dissociations depend on factors that affect multisensory processing

The paper investigates how multisensory processing factors influence perception-action dissociations using the Uznadze illusion in visual and visuomotor tasks.

Vicarious Somatotopic Maps Tile Visual Cortex

The paper maps somatosensory and visual field tuning in the brain, showing aligned somatotopic body maps in the visual cortex during movie watching.

Top-down feedback matters: Functional impact of brainlike connectivity motifs on audiovisual integration

This study shows that incorporating top-down feedback in neural networks mimics human brain architecture and introduces a visual bias in audiovisual tasks without impairing performance.

Feeling Senseless Sensations: A Crossmodal study of mismatching tactile and virtual visual experience

This study evaluates visual-tactile synchronization in VR by analyzing EEG responses to mismatched sensory inputs, finding distinct ERP patterns associated with mismatches.

Human medial pulvinar is involved in face and tactile processing and dynamically adjusts its cortical connectivity based on ongoing stimulation

This study uses fMRI to show that the medial pulvinar is involved in face and tactile processing and adjusts its connectivity based on sensory input.

Listening to music modulates visual perception of paintings during binocular rivalry

This study investigates how sad or lively Chinese folk music influences visual perception of traditional Chinese paintings during binocular rivalry, finding that sad music enhances bleak paintings and lively music increases switching rates.

A comparison of EEG encoding models using audiovisual stimuli and their unimodal counterparts

The paper compares EEG encoding models using audiovisual stimuli and their unimodal counterparts, finding that visual information has a stronger influence on EEG than auditory information.

Network state changes in sensory thalamus represent learned outcomes.

The paper identifies flexible network states in auditory thalamus that predict task outcomes during cross-modal learning in mice.

Distinct neural manifolds and critical roles of primate caudate nucleus in multimodal decision-making

This study shows the primate caudate nucleus has distinct neural representations and causal roles in multimodal decision-making compared to cortical areas.

Region-specific auditory and visual plasticity in mouse visual cortex after early visual deprivation

This study maps auditory and visual plasticity in mouse visual cortex after early visual deprivation, showing increased auditory responses and decreased visual responses in dorsal stream areas.

Olfactory facilitation of visual categorization in the 4-month-old brain depends on visual demand

This study shows that maternal body odor enhances visual face categorization in 4-month-olds only when visual demand is high, supporting inverse effectiveness in olfactory-to-visual facilitation.

Interaction of spatial attention and the associated reward value of audiovisual stimuli

The paper investigates how reward value and spatial attention interact in processing audiovisual stimuli, finding that auditory reward modulates attention more strongly than visual reward.

Auditory cortex encodes lipreading information through spatially distributed activity

The paper investigates how the auditory system encodes lipreading information using fMRI and intracranial recordings, finding that lipread words are decoded earlier and through spatially distributed activity in auditory cortex.

Neuronal basis of audio-tactile speech perception

This study shows that audio-tactile speech training improves speech understanding in noise and activates brain regions similar to those used in audio-visual speech processing.

Different sensory information is used for state estimation when stationary or moving

The paper shows that different sensory feedback is used for limb state estimation when stationary versus moving, with multisensory integration occurring in static cases and single-sensory reliance in dynamic cases.

Crossmodal Hierarchical Predictive Coding for Audiovisual Sequences in Human Brain

This study investigates crossmodal predictive coding in the human brain using EEG during an audiovisual oddball paradigm, finding that audiovisual integration occurs at both local and global levels.

Tool-sensed object information effectively supports vision for multisensory grasping

High segregation and diminished global integration in large-scale brain functional networks enhances the perceptual binding of cross-modal stimuli

The paper shows that increased segregation and reduced integration in brain networks enhance perceptual binding of cross-modal stimuli using fMRI and computational analysis.

Statistical learning of incidental perceptual regularities induces sensory conditioned cortical responses

This study shows that statistical learning of non-relevant audio-visual stimuli induces predictive neural responses and error signals in the brain.

Abnormal multisensory facilitation patterns relate to disorganized thinking severity and cognitive decline in schizophrenia

This study examines multisensory integration in schizophrenia patients, finding greater facilitation in synchronous conditions and heterogeneous patterns linked to cognitive decline and disorganization.

Correlated spontaneous activity sets up multi-sensory integration in the developing higher-order cortex

The paper investigates how spontaneous activity guides the development of multisensory integration in the developing higher-order cortex by establishing co-aligned topographic projections.

The impact of face masks on face-to-face neural tracking of speech: auditory and visual obstacles

This study examines how face masks affect neural tracking of speech by comparing auditory and visual obstacles in three conditions: no-mask, virtual mask, and real mask.

Olfactory-to-visual facilitation in the infant brain declines gradually from 4 to 12 months

The paper shows that the facilitative effect of maternal odor on face categorization in infants decreases from 4 to 12 months, correlating with improved visual processing.

We see what we hear: dissonant music engages early visual processing.

This study shows that dissonant music affects early visual processing by engaging the primary visual cortex through auditory-visual interactions during film viewing.