Accessibility navigation


Perception of temporal synchrony not a prerequisite for multisensory integration

Jertberg, R. M., Begeer, S., Geurts, H. M., Chakrabarti, B. ORCID: https://orcid.org/0000-0002-6649-7895 and Van der Burg, E. (2024) Perception of temporal synchrony not a prerequisite for multisensory integration. Scientific Reports, 14. 4982. ISSN 2045-2322

[img]
Preview
Text (Open Access) - Published Version
· Available under License Creative Commons Attribution.
· Please see our End User Agreement before downloading.

1MB

It is advisable to refer to the publisher's version if you intend to cite from this work. See Guidance on citing.

To link to this item DOI: 10.1038/s41598-024-55572-x

Abstract/Summary

Temporal alignment is often viewed as the most essential cue the brain can use to integrate information from across sensory modalities. However, the importance of conscious perception of synchrony to multisensory integration is a controversial topic. Conversely, the influence of cross-modal incongruence of higher level stimulus features such as phonetics on temporal processing is poorly understood. To explore the nuances of this relationship between temporal processing and multisensory integration, we presented 101 participants (ranging from 19 to 73 years of age) with stimuli designed to elicit the McGurk/MacDonald illusion (either matched or mismatched pairs of phonemes and visemes) with varying degrees of stimulus onset asynchrony between the visual and auditory streams. We asked them to indicate which syllable they perceived and whether the video and audio were synchronized on each trial. We found that participants often experienced the illusion despite not perceiving the stimuli as synchronous, and the same phonetic incongruence that produced the illusion also led to significant interference in simultaneity judgments. These findings challenge the longstanding assumption that perception of synchrony is a prerequisite to multisensory integration, support a more flexible view of multisensory integration, and suggest a complex, reciprocal relationship between temporal and multisensory processing.

Item Type:Article
Refereed:Yes
Divisions:Interdisciplinary Research Centres (IDRCs) > Centre for Integrative Neuroscience and Neurodynamics (CINN)
Interdisciplinary centres and themes > ASD (Autism Spectrum Disorders) Research Network
Life Sciences > School of Psychology and Clinical Language Sciences > Department of Psychology
Interdisciplinary Research Centres (IDRCs) > Centre for Cognition Research (CCR)
Life Sciences > School of Psychology and Clinical Language Sciences > Psychopathology and Affective Neuroscience
ID Code:115601
Publisher:Nature Publishing Group

Downloads

Downloads per month over past year

University Staff: Request a correction | Centaur Editors: Update this record

Page navigation