Infant-directed visual prosody: Mothers' head movements and speech acoustics

Nicholas A. Smith, Heather L. Strader

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

Acoustical changes in the prosody of mothers' speech to infants are distinct and near universal. However, less is known about the visible properties of mothers' infant-directed (ID) speech, and their relation to speech acoustics. Mothers' head movements were tracked as they interacted with their infants using ID speech, and compared to movements accompanying their adult-directed (AD) speech. Movement measures along three dimensions of head translation, and three axes of head rotation were calculated. Overall, more head movement was found for ID than AD speech, suggesting that mothers exaggerate their visual prosody in a manner analogous to the acoustical exaggerations in their speech. Regression analyses examined the relation between changing head position and changing acoustical pitch (F0) over time. Head movements and voice pitch were more strongly related in ID speech than in AD speech. When these relations were examined across time windows of different durations, stronger relations were observed for shorter time windows (< 5 sec). However, the particular form of these more local relations did not extend or generalize to longer time windows. This suggests that the multimodal correspondences in speech prosody are variable in form, and occur within limited time spans.

Original languageEnglish (US)
Pages (from-to)38-54
Number of pages17
JournalInteraction Studies
Volume15
Issue number1
DOIs
StatePublished - 2014

Fingerprint

acoustics
infant
Acoustics
Prosody
Head Movement
Speech Acoustics
time
Infant-directed Speech
regression
duration

ASJC Scopus subject areas

  • Communication
  • Language and Linguistics
  • Animal Science and Zoology
  • Linguistics and Language
  • Human-Computer Interaction

Cite this

Infant-directed visual prosody : Mothers' head movements and speech acoustics. / Smith, Nicholas A.; Strader, Heather L.

In: Interaction Studies, Vol. 15, No. 1, 2014, p. 38-54.

Research output: Contribution to journalArticle

Smith, Nicholas A. ; Strader, Heather L. / Infant-directed visual prosody : Mothers' head movements and speech acoustics. In: Interaction Studies. 2014 ; Vol. 15, No. 1. pp. 38-54.
@article{13fea8c3833f4de18bb0bd121758abcd,
title = "Infant-directed visual prosody: Mothers' head movements and speech acoustics",
abstract = "Acoustical changes in the prosody of mothers' speech to infants are distinct and near universal. However, less is known about the visible properties of mothers' infant-directed (ID) speech, and their relation to speech acoustics. Mothers' head movements were tracked as they interacted with their infants using ID speech, and compared to movements accompanying their adult-directed (AD) speech. Movement measures along three dimensions of head translation, and three axes of head rotation were calculated. Overall, more head movement was found for ID than AD speech, suggesting that mothers exaggerate their visual prosody in a manner analogous to the acoustical exaggerations in their speech. Regression analyses examined the relation between changing head position and changing acoustical pitch (F0) over time. Head movements and voice pitch were more strongly related in ID speech than in AD speech. When these relations were examined across time windows of different durations, stronger relations were observed for shorter time windows (< 5 sec). However, the particular form of these more local relations did not extend or generalize to longer time windows. This suggests that the multimodal correspondences in speech prosody are variable in form, and occur within limited time spans.",
author = "Smith, {Nicholas A.} and Strader, {Heather L.}",
year = "2014",
doi = "10.1075/is.15.1.02smi",
language = "English (US)",
volume = "15",
pages = "38--54",
journal = "Interaction Studies",
issn = "1572-0373",
publisher = "John Benjamins Publishing Company",
number = "1",

}

TY - JOUR

T1 - Infant-directed visual prosody

T2 - Mothers' head movements and speech acoustics

AU - Smith, Nicholas A.

AU - Strader, Heather L.

PY - 2014

Y1 - 2014

N2 - Acoustical changes in the prosody of mothers' speech to infants are distinct and near universal. However, less is known about the visible properties of mothers' infant-directed (ID) speech, and their relation to speech acoustics. Mothers' head movements were tracked as they interacted with their infants using ID speech, and compared to movements accompanying their adult-directed (AD) speech. Movement measures along three dimensions of head translation, and three axes of head rotation were calculated. Overall, more head movement was found for ID than AD speech, suggesting that mothers exaggerate their visual prosody in a manner analogous to the acoustical exaggerations in their speech. Regression analyses examined the relation between changing head position and changing acoustical pitch (F0) over time. Head movements and voice pitch were more strongly related in ID speech than in AD speech. When these relations were examined across time windows of different durations, stronger relations were observed for shorter time windows (< 5 sec). However, the particular form of these more local relations did not extend or generalize to longer time windows. This suggests that the multimodal correspondences in speech prosody are variable in form, and occur within limited time spans.

AB - Acoustical changes in the prosody of mothers' speech to infants are distinct and near universal. However, less is known about the visible properties of mothers' infant-directed (ID) speech, and their relation to speech acoustics. Mothers' head movements were tracked as they interacted with their infants using ID speech, and compared to movements accompanying their adult-directed (AD) speech. Movement measures along three dimensions of head translation, and three axes of head rotation were calculated. Overall, more head movement was found for ID than AD speech, suggesting that mothers exaggerate their visual prosody in a manner analogous to the acoustical exaggerations in their speech. Regression analyses examined the relation between changing head position and changing acoustical pitch (F0) over time. Head movements and voice pitch were more strongly related in ID speech than in AD speech. When these relations were examined across time windows of different durations, stronger relations were observed for shorter time windows (< 5 sec). However, the particular form of these more local relations did not extend or generalize to longer time windows. This suggests that the multimodal correspondences in speech prosody are variable in form, and occur within limited time spans.

UR - http://www.scopus.com/inward/record.url?scp=84902253670&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84902253670&partnerID=8YFLogxK

U2 - 10.1075/is.15.1.02smi

DO - 10.1075/is.15.1.02smi

M3 - Article

C2 - 25242907

AN - SCOPUS:84902253670

VL - 15

SP - 38

EP - 54

JO - Interaction Studies

JF - Interaction Studies

SN - 1572-0373

IS - 1

ER -