Visuo-tactile integration in texture perception: A replication and extension study

Abstract

Employing a sensory conflict paradigm, previous research has found that vision and touch contribute, on average, equally to the visuo-tactile perception of surface texture. Our study aimed to, firstly, replicate the original findings using a comparable setup and stimulus set; secondly, examine whether equal modality contributions can also be observed on an individual basis (using a within-subject design); and thirdly, explore how visuo-tactile integration is affected by illumination angle (top vs. oblique). Participants explored a discrepant standard consisting of different abrasive papers by vision, touch, and using both modalities simultaneously, and subsequently had to find the closest visual, tactile, and visuo-tactile match from a set of matching stimuli. We replicated equal contribution from vision and touch across the whole sample in both illumination conditions. We also found considerable inter-individual variations in the modality contributions when the stimuli were illuminated from the top. Interestingly, this variation decreased under oblique illumination, with most participants showing an about-equal contribution from both modalities to the combined texture percept. These findings are consistent with the assumption that the perceived discrepancy between vision and touch was reduced under oblique illumination suggesting overall that visual and tactile information are only weighted equally within a certain range of experienced discrepancy. Outside this individual range, one of the modalities is weighted higher with no clear preference for either modality.