Visual and Auditory Components in the Perception of Asynchronous Audiovisual Speech



Downloads per month over past year

García Pérez, Miguel Ángel and Alcalá Quintana, Rocío (2015) Visual and Auditory Components in the Perception of Asynchronous Audiovisual Speech. i-Perception, 6 (6). pp. 1-20. ISSN 20416695

[thumbnail of i-Perception-2015-García-Pérez-.pdf]
Creative Commons Attribution.


Official URL:


Research on asynchronous audiovisual speech perception manipulates experimental conditions to observe their effects on synchrony judgments. Probabilistic models establish a link between the sensory and decisional processes underlying such judgments and the observed data, via interpretable parameters that allow testing hypotheses and making inferences about how experimental manipulations affect such processes. Two models of this type have recently been proposed, one based on independent channels and the other using a Bayesian approach. Both models are fitted here to a common data set, with a subsequent analysis of the interpretation they provide about how experimental manipulations affected the processes underlying perceived synchrony. The data consist of synchrony judgments as a function of audiovisual offset in a speech stimulus, under four within-subjects manipulations of the quality of the visual component. The Bayesian model could not accommodate asymmetric data, was rejected by goodness-of-fit statistics for 8/16 observers, and was found to be nonidentifiable, which renders uninterpretable parameter estimates. The independent-channels model captured asymmetric data, was rejected for only 1/16 observers, and identified how sensory and decisional processes mediating asynchronous audiovisual speech perception are affected by manipulations that only alter the quality of the visual component of the speech signal.

Item Type:Article
Uncontrolled Keywords:Synchrony judgments, Perceived onset, Audiovisual speech, Multisensory integration
Subjects:Medical sciences > Psychology > Experimental psychology
Medical sciences > Psychology > Cognitive psychology
Medical sciences > Psychology > Perception
ID Code:35136
Deposited On:21 Jan 2016 08:57
Last Modified:20 Jul 2016 08:44

Origin of downloads

Repository Staff Only: item control page