Accumulation and decay of visual capture and the ventriloquism aftereffect caused by brief audio-visual disparities

Adam K Bosen, Justin T. Fleming, Paul D. Allen, William E. O‘Neill, Gary D. Paige

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Visual capture and the ventriloquism aftereffect resolve spatial disparities of incongruent auditory visual (AV) objects by shifting auditory spatial perception to align with vision. Here, we demonstrated the distinct temporal characteristics of visual capture and the ventriloquism aftereffect in response to brief AV disparities. In a set of experiments, subjects localized either the auditory component of AV targets (A within AV) or a second sound presented at varying delays (1–20 s) after AV exposure (A2 after AV). AV targets were trains of brief presentations (1 or 20), covering a ±30° azimuthal range, and with ±8° (R or L) disparity. We found that the magnitude of visual capture generally reached its peak within a single AV pair and did not dissipate with time, while the ventriloquism aftereffect accumulated with repetitions of AV pairs and dissipated with time. Additionally, the magnitude of the auditory shift induced by each phenomenon was uncorrelated across listeners and visual capture was unaffected by subsequent auditory targets, indicating that visual capture and the ventriloquism aftereffect are separate mechanisms with distinct effects on auditory spatial perception. Our results indicate that visual capture is a ‘sample-and-hold’ process that binds related objects and stores the combined percept in memory, whereas the ventriloquism aftereffect is a ‘leaky integrator’ process that accumulates with experience and decays with time to compensate for cross-modal disparities.

Original languageEnglish (US)
Pages (from-to)585-595
Number of pages11
JournalExperimental Brain Research
Volume235
Issue number2
DOIs
StatePublished - Feb 1 2017
Externally publishedYes

Fingerprint

Vision Disparity
Auditory Perception
varespladib methyl

Keywords

  • Auditory
  • Cross-modal
  • Ventriloquism
  • Ventriloquism aftereffect
  • Visual
  • Visual capture

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Accumulation and decay of visual capture and the ventriloquism aftereffect caused by brief audio-visual disparities. / Bosen, Adam K; Fleming, Justin T.; Allen, Paul D.; O‘Neill, William E.; Paige, Gary D.

In: Experimental Brain Research, Vol. 235, No. 2, 01.02.2017, p. 585-595.

Research output: Contribution to journalArticle

Bosen, Adam K ; Fleming, Justin T. ; Allen, Paul D. ; O‘Neill, William E. ; Paige, Gary D. / Accumulation and decay of visual capture and the ventriloquism aftereffect caused by brief audio-visual disparities. In: Experimental Brain Research. 2017 ; Vol. 235, No. 2. pp. 585-595.
@article{bef838963af94d2e80ca444236923f9b,
title = "Accumulation and decay of visual capture and the ventriloquism aftereffect caused by brief audio-visual disparities",
abstract = "Visual capture and the ventriloquism aftereffect resolve spatial disparities of incongruent auditory visual (AV) objects by shifting auditory spatial perception to align with vision. Here, we demonstrated the distinct temporal characteristics of visual capture and the ventriloquism aftereffect in response to brief AV disparities. In a set of experiments, subjects localized either the auditory component of AV targets (A within AV) or a second sound presented at varying delays (1–20 s) after AV exposure (A2 after AV). AV targets were trains of brief presentations (1 or 20), covering a ±30° azimuthal range, and with ±8° (R or L) disparity. We found that the magnitude of visual capture generally reached its peak within a single AV pair and did not dissipate with time, while the ventriloquism aftereffect accumulated with repetitions of AV pairs and dissipated with time. Additionally, the magnitude of the auditory shift induced by each phenomenon was uncorrelated across listeners and visual capture was unaffected by subsequent auditory targets, indicating that visual capture and the ventriloquism aftereffect are separate mechanisms with distinct effects on auditory spatial perception. Our results indicate that visual capture is a ‘sample-and-hold’ process that binds related objects and stores the combined percept in memory, whereas the ventriloquism aftereffect is a ‘leaky integrator’ process that accumulates with experience and decays with time to compensate for cross-modal disparities.",
keywords = "Auditory, Cross-modal, Ventriloquism, Ventriloquism aftereffect, Visual, Visual capture",
author = "Bosen, {Adam K} and Fleming, {Justin T.} and Allen, {Paul D.} and O‘Neill, {William E.} and Paige, {Gary D.}",
year = "2017",
month = "2",
day = "1",
doi = "10.1007/s00221-016-4820-4",
language = "English (US)",
volume = "235",
pages = "585--595",
journal = "Experimental Brain Research",
issn = "0014-4819",
publisher = "Springer Verlag",
number = "2",

}

TY - JOUR

T1 - Accumulation and decay of visual capture and the ventriloquism aftereffect caused by brief audio-visual disparities

AU - Bosen, Adam K

AU - Fleming, Justin T.

AU - Allen, Paul D.

AU - O‘Neill, William E.

AU - Paige, Gary D.

PY - 2017/2/1

Y1 - 2017/2/1

N2 - Visual capture and the ventriloquism aftereffect resolve spatial disparities of incongruent auditory visual (AV) objects by shifting auditory spatial perception to align with vision. Here, we demonstrated the distinct temporal characteristics of visual capture and the ventriloquism aftereffect in response to brief AV disparities. In a set of experiments, subjects localized either the auditory component of AV targets (A within AV) or a second sound presented at varying delays (1–20 s) after AV exposure (A2 after AV). AV targets were trains of brief presentations (1 or 20), covering a ±30° azimuthal range, and with ±8° (R or L) disparity. We found that the magnitude of visual capture generally reached its peak within a single AV pair and did not dissipate with time, while the ventriloquism aftereffect accumulated with repetitions of AV pairs and dissipated with time. Additionally, the magnitude of the auditory shift induced by each phenomenon was uncorrelated across listeners and visual capture was unaffected by subsequent auditory targets, indicating that visual capture and the ventriloquism aftereffect are separate mechanisms with distinct effects on auditory spatial perception. Our results indicate that visual capture is a ‘sample-and-hold’ process that binds related objects and stores the combined percept in memory, whereas the ventriloquism aftereffect is a ‘leaky integrator’ process that accumulates with experience and decays with time to compensate for cross-modal disparities.

AB - Visual capture and the ventriloquism aftereffect resolve spatial disparities of incongruent auditory visual (AV) objects by shifting auditory spatial perception to align with vision. Here, we demonstrated the distinct temporal characteristics of visual capture and the ventriloquism aftereffect in response to brief AV disparities. In a set of experiments, subjects localized either the auditory component of AV targets (A within AV) or a second sound presented at varying delays (1–20 s) after AV exposure (A2 after AV). AV targets were trains of brief presentations (1 or 20), covering a ±30° azimuthal range, and with ±8° (R or L) disparity. We found that the magnitude of visual capture generally reached its peak within a single AV pair and did not dissipate with time, while the ventriloquism aftereffect accumulated with repetitions of AV pairs and dissipated with time. Additionally, the magnitude of the auditory shift induced by each phenomenon was uncorrelated across listeners and visual capture was unaffected by subsequent auditory targets, indicating that visual capture and the ventriloquism aftereffect are separate mechanisms with distinct effects on auditory spatial perception. Our results indicate that visual capture is a ‘sample-and-hold’ process that binds related objects and stores the combined percept in memory, whereas the ventriloquism aftereffect is a ‘leaky integrator’ process that accumulates with experience and decays with time to compensate for cross-modal disparities.

KW - Auditory

KW - Cross-modal

KW - Ventriloquism

KW - Ventriloquism aftereffect

KW - Visual

KW - Visual capture

UR - http://www.scopus.com/inward/record.url?scp=84994713144&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84994713144&partnerID=8YFLogxK

U2 - 10.1007/s00221-016-4820-4

DO - 10.1007/s00221-016-4820-4

M3 - Article

VL - 235

SP - 585

EP - 595

JO - Experimental Brain Research

JF - Experimental Brain Research

SN - 0014-4819

IS - 2

ER -