The roles of physical and physiological simultaneity in audiovisual multisensory facilitation

Lynnette M. Leone, Mark E. McCourt

Research output: Contribution to journalArticle

17 Citations (Scopus)

Abstract

A series of experiments measured the audiovisual stimulus onset asynchrony (SOAAV), yielding facilitative multisensory integration. We evaluated (1) the range of SOAAV over which facilitation occurred when unisensory stimuli were weak; (2) whether the range of SOAAV producing facilitation supported the hypothesis that physiological simultaneity of unisensory activity governs multisensory facilitation; and (3) whether AV multisensory facilitation depended on relative stimulus intensity. We compared response-time distributions to unisensory auditory (A) and visual (V) stimuli with those to AV stimuli over a wide range (300 and 20 ms increments) of SOAAV, across four conditions of varying stimulus intensity. In condition 1, the intensity of unisensory stimuli was adjusted such that d' ≈ 2. In condition 2, V stimulus intensity was increased (d'>4), while A stimulus intensity was as in condition 1. In condition 3, A stimulus intensity was increased (d>4) while V stimulus intensity was as in condition 1. In condition 4, both A and V stimulus intensities were increased to clearly suprathreshold levels (d'>4). Across all conditions of stimulus intensity, significant multisensory facilitation occurred exclusively for simultaneously presented A and V stimuli. In addition, facilitation increased as stimulus intensity increased, in disagreement with inverse effectiveness. These results indicate that the requirements for facilitative multisensory integration include both physical and physiological simultaneity.

Original languageEnglish (US)
Pages (from-to)213-228
Number of pages16
Journali-Perception
Volume4
Issue number4
DOIs
StatePublished - Jun 25 2013

Fingerprint

Reaction Time
Experiments

Keywords

  • D'
  • Inverse effectiveness
  • Multisensory integration
  • Neural coactivation
  • Race model
  • Reaction time
  • Simultaneity

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Ophthalmology
  • Sensory Systems
  • Artificial Intelligence

Cite this

The roles of physical and physiological simultaneity in audiovisual multisensory facilitation. / Leone, Lynnette M.; McCourt, Mark E.

In: i-Perception, Vol. 4, No. 4, 25.06.2013, p. 213-228.

Research output: Contribution to journalArticle

@article{08afa6d9a802498ea7afdc7c45703c4d,
title = "The roles of physical and physiological simultaneity in audiovisual multisensory facilitation",
abstract = "A series of experiments measured the audiovisual stimulus onset asynchrony (SOAAV), yielding facilitative multisensory integration. We evaluated (1) the range of SOAAV over which facilitation occurred when unisensory stimuli were weak; (2) whether the range of SOAAV producing facilitation supported the hypothesis that physiological simultaneity of unisensory activity governs multisensory facilitation; and (3) whether AV multisensory facilitation depended on relative stimulus intensity. We compared response-time distributions to unisensory auditory (A) and visual (V) stimuli with those to AV stimuli over a wide range (300 and 20 ms increments) of SOAAV, across four conditions of varying stimulus intensity. In condition 1, the intensity of unisensory stimuli was adjusted such that d' ≈ 2. In condition 2, V stimulus intensity was increased (d'>4), while A stimulus intensity was as in condition 1. In condition 3, A stimulus intensity was increased (d>4) while V stimulus intensity was as in condition 1. In condition 4, both A and V stimulus intensities were increased to clearly suprathreshold levels (d'>4). Across all conditions of stimulus intensity, significant multisensory facilitation occurred exclusively for simultaneously presented A and V stimuli. In addition, facilitation increased as stimulus intensity increased, in disagreement with inverse effectiveness. These results indicate that the requirements for facilitative multisensory integration include both physical and physiological simultaneity.",
keywords = "D', Inverse effectiveness, Multisensory integration, Neural coactivation, Race model, Reaction time, Simultaneity",
author = "Leone, {Lynnette M.} and McCourt, {Mark E.}",
year = "2013",
month = "6",
day = "25",
doi = "10.1068/i0532",
language = "English (US)",
volume = "4",
pages = "213--228",
journal = "i-Perception",
issn = "2041-6695",
publisher = "Pion Ltd.",
number = "4",

}

TY - JOUR

T1 - The roles of physical and physiological simultaneity in audiovisual multisensory facilitation

AU - Leone, Lynnette M.

AU - McCourt, Mark E.

PY - 2013/6/25

Y1 - 2013/6/25

N2 - A series of experiments measured the audiovisual stimulus onset asynchrony (SOAAV), yielding facilitative multisensory integration. We evaluated (1) the range of SOAAV over which facilitation occurred when unisensory stimuli were weak; (2) whether the range of SOAAV producing facilitation supported the hypothesis that physiological simultaneity of unisensory activity governs multisensory facilitation; and (3) whether AV multisensory facilitation depended on relative stimulus intensity. We compared response-time distributions to unisensory auditory (A) and visual (V) stimuli with those to AV stimuli over a wide range (300 and 20 ms increments) of SOAAV, across four conditions of varying stimulus intensity. In condition 1, the intensity of unisensory stimuli was adjusted such that d' ≈ 2. In condition 2, V stimulus intensity was increased (d'>4), while A stimulus intensity was as in condition 1. In condition 3, A stimulus intensity was increased (d>4) while V stimulus intensity was as in condition 1. In condition 4, both A and V stimulus intensities were increased to clearly suprathreshold levels (d'>4). Across all conditions of stimulus intensity, significant multisensory facilitation occurred exclusively for simultaneously presented A and V stimuli. In addition, facilitation increased as stimulus intensity increased, in disagreement with inverse effectiveness. These results indicate that the requirements for facilitative multisensory integration include both physical and physiological simultaneity.

AB - A series of experiments measured the audiovisual stimulus onset asynchrony (SOAAV), yielding facilitative multisensory integration. We evaluated (1) the range of SOAAV over which facilitation occurred when unisensory stimuli were weak; (2) whether the range of SOAAV producing facilitation supported the hypothesis that physiological simultaneity of unisensory activity governs multisensory facilitation; and (3) whether AV multisensory facilitation depended on relative stimulus intensity. We compared response-time distributions to unisensory auditory (A) and visual (V) stimuli with those to AV stimuli over a wide range (300 and 20 ms increments) of SOAAV, across four conditions of varying stimulus intensity. In condition 1, the intensity of unisensory stimuli was adjusted such that d' ≈ 2. In condition 2, V stimulus intensity was increased (d'>4), while A stimulus intensity was as in condition 1. In condition 3, A stimulus intensity was increased (d>4) while V stimulus intensity was as in condition 1. In condition 4, both A and V stimulus intensities were increased to clearly suprathreshold levels (d'>4). Across all conditions of stimulus intensity, significant multisensory facilitation occurred exclusively for simultaneously presented A and V stimuli. In addition, facilitation increased as stimulus intensity increased, in disagreement with inverse effectiveness. These results indicate that the requirements for facilitative multisensory integration include both physical and physiological simultaneity.

KW - D'

KW - Inverse effectiveness

KW - Multisensory integration

KW - Neural coactivation

KW - Race model

KW - Reaction time

KW - Simultaneity

UR - http://www.scopus.com/inward/record.url?scp=84879163716&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84879163716&partnerID=8YFLogxK

U2 - 10.1068/i0532

DO - 10.1068/i0532

M3 - Article

C2 - 24349682

AN - SCOPUS:84879163716

VL - 4

SP - 213

EP - 228

JO - i-Perception

JF - i-Perception

SN - 2041-6695

IS - 4

ER -