Auditory capture of visual motion

Effects on perception and discrimination

Mark McCourt, Lynnette M. Leone

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

We asked whether the perceived direction of visual motion and contrast thresholds for motion discrimination are influenced by the concurrent motion of an auditory sound source. Visual motion stimuli were counterphasing Gabor patches, whose net motion energy was manipulated by adjusting the contrast of the leftward-moving and rightward-moving components. The presentation of these visual stimuli was paired with the simultaneous presentation of auditory stimuli, whose apparent motion in 3D auditory space (rightward, leftward, static, no sound) was manipulated using interaural time and intensity differences, and Doppler cues. In experiment 1, observers judged whether the Gabor visual stimulus appeared to move rightward or leftward. In experiment 2, contrast discrimination thresholds for detecting the interval containing unequal (rightward or leftward) visual motion energy were obtained under the same auditory conditions. Experiment 1 showed that the perceived direction of ambiguous visual motion is powerfully influenced by concurrent auditory motion, such that auditory motion 'captured' ambiguous visual motion. Experiment 2 showed that this interaction occurs at a sensory stage of processing as visual contrast discrimination thresholds (a criterion-free measure of sensitivity) were significantly elevated when paired with congruent auditory motion. These results suggest that auditory and visual motion signals are integrated and combined into a supramodal (audiovisual) representation of motion.

Original languageEnglish (US)
Pages (from-to)1095-1100
Number of pages6
JournalNeuroReport
Volume27
Issue number14
DOIs
StatePublished - Sep 1 2016
Externally publishedYes

Fingerprint

Discrimination (Psychology)
Cues
Direction compound

Keywords

  • auditory
  • motion processing
  • multisensory
  • visual

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Auditory capture of visual motion : Effects on perception and discrimination. / McCourt, Mark; Leone, Lynnette M.

In: NeuroReport, Vol. 27, No. 14, 01.09.2016, p. 1095-1100.

Research output: Contribution to journalArticle

McCourt, Mark ; Leone, Lynnette M. / Auditory capture of visual motion : Effects on perception and discrimination. In: NeuroReport. 2016 ; Vol. 27, No. 14. pp. 1095-1100.
@article{a02ae0baf7024f3492f6363c240ff0b9,
title = "Auditory capture of visual motion: Effects on perception and discrimination",
abstract = "We asked whether the perceived direction of visual motion and contrast thresholds for motion discrimination are influenced by the concurrent motion of an auditory sound source. Visual motion stimuli were counterphasing Gabor patches, whose net motion energy was manipulated by adjusting the contrast of the leftward-moving and rightward-moving components. The presentation of these visual stimuli was paired with the simultaneous presentation of auditory stimuli, whose apparent motion in 3D auditory space (rightward, leftward, static, no sound) was manipulated using interaural time and intensity differences, and Doppler cues. In experiment 1, observers judged whether the Gabor visual stimulus appeared to move rightward or leftward. In experiment 2, contrast discrimination thresholds for detecting the interval containing unequal (rightward or leftward) visual motion energy were obtained under the same auditory conditions. Experiment 1 showed that the perceived direction of ambiguous visual motion is powerfully influenced by concurrent auditory motion, such that auditory motion 'captured' ambiguous visual motion. Experiment 2 showed that this interaction occurs at a sensory stage of processing as visual contrast discrimination thresholds (a criterion-free measure of sensitivity) were significantly elevated when paired with congruent auditory motion. These results suggest that auditory and visual motion signals are integrated and combined into a supramodal (audiovisual) representation of motion.",
keywords = "auditory, motion processing, multisensory, visual",
author = "Mark McCourt and Leone, {Lynnette M.}",
year = "2016",
month = "9",
day = "1",
doi = "10.1097/WNR.0000000000000664",
language = "English (US)",
volume = "27",
pages = "1095--1100",
journal = "NeuroReport",
issn = "0959-4965",
publisher = "Lippincott Williams and Wilkins",
number = "14",

}

TY - JOUR

T1 - Auditory capture of visual motion

T2 - Effects on perception and discrimination

AU - McCourt, Mark

AU - Leone, Lynnette M.

PY - 2016/9/1

Y1 - 2016/9/1

N2 - We asked whether the perceived direction of visual motion and contrast thresholds for motion discrimination are influenced by the concurrent motion of an auditory sound source. Visual motion stimuli were counterphasing Gabor patches, whose net motion energy was manipulated by adjusting the contrast of the leftward-moving and rightward-moving components. The presentation of these visual stimuli was paired with the simultaneous presentation of auditory stimuli, whose apparent motion in 3D auditory space (rightward, leftward, static, no sound) was manipulated using interaural time and intensity differences, and Doppler cues. In experiment 1, observers judged whether the Gabor visual stimulus appeared to move rightward or leftward. In experiment 2, contrast discrimination thresholds for detecting the interval containing unequal (rightward or leftward) visual motion energy were obtained under the same auditory conditions. Experiment 1 showed that the perceived direction of ambiguous visual motion is powerfully influenced by concurrent auditory motion, such that auditory motion 'captured' ambiguous visual motion. Experiment 2 showed that this interaction occurs at a sensory stage of processing as visual contrast discrimination thresholds (a criterion-free measure of sensitivity) were significantly elevated when paired with congruent auditory motion. These results suggest that auditory and visual motion signals are integrated and combined into a supramodal (audiovisual) representation of motion.

AB - We asked whether the perceived direction of visual motion and contrast thresholds for motion discrimination are influenced by the concurrent motion of an auditory sound source. Visual motion stimuli were counterphasing Gabor patches, whose net motion energy was manipulated by adjusting the contrast of the leftward-moving and rightward-moving components. The presentation of these visual stimuli was paired with the simultaneous presentation of auditory stimuli, whose apparent motion in 3D auditory space (rightward, leftward, static, no sound) was manipulated using interaural time and intensity differences, and Doppler cues. In experiment 1, observers judged whether the Gabor visual stimulus appeared to move rightward or leftward. In experiment 2, contrast discrimination thresholds for detecting the interval containing unequal (rightward or leftward) visual motion energy were obtained under the same auditory conditions. Experiment 1 showed that the perceived direction of ambiguous visual motion is powerfully influenced by concurrent auditory motion, such that auditory motion 'captured' ambiguous visual motion. Experiment 2 showed that this interaction occurs at a sensory stage of processing as visual contrast discrimination thresholds (a criterion-free measure of sensitivity) were significantly elevated when paired with congruent auditory motion. These results suggest that auditory and visual motion signals are integrated and combined into a supramodal (audiovisual) representation of motion.

KW - auditory

KW - motion processing

KW - multisensory

KW - visual

UR - http://www.scopus.com/inward/record.url?scp=84981516988&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84981516988&partnerID=8YFLogxK

U2 - 10.1097/WNR.0000000000000664

DO - 10.1097/WNR.0000000000000664

M3 - Article

VL - 27

SP - 1095

EP - 1100

JO - NeuroReport

JF - NeuroReport

SN - 0959-4965

IS - 14

ER -