Processing F0 with cochlear implants

Modulation frequency discrimination and speech intonation recognition

Monita Chatterjee, Shu Chen Peng

Research output: Contribution to journalArticle

94 Citations (Scopus)

Abstract

Fundamental frequency (F0) processing by cochlear implant (CI) listeners was measured using a psychophysical task and a speech intonation recognition task. Listeners' Weber fractions for modulation frequency discrimination were measured using an adaptive, 3-interval, forced-choice paradigm: stimuli were presented through a custom research interface. In the speech intonation recognition task, listeners were asked to indicate whether resynthesized bisyllabic words, when presented in the free field through the listeners' everyday speech processor, were question-like or statement-like. The resynthesized tokens were systematically manipulated to have different initial-F0s to represent male vs. female voices, and different F0 contours (i.e. falling, flat, and rising) Although the CI listeners showed considerable variation in performance on both tasks, significant correlations were observed between the CI listeners' sensitivity to modulation frequency in the psychophysical task and their performance in intonation recognition. Consistent with their greater reliance on temporal cues, the CI listeners' performance in the intonation recognition task was significantly poorer with the higher initial-F0 stimuli than with the lower initial-F0 stimuli. Similar results were obtained with normal hearing listeners attending to noiseband-vocoded CI simulations with reduced spectral resolution.

Original languageEnglish (US)
Pages (from-to)143-156
Number of pages14
JournalHearing Research
Volume235
Issue number1-2
DOIs
StatePublished - Jan 1 2008

Fingerprint

Speech Perception
Cochlear Implants
Task Performance and Analysis
Hearing
Cues
Recognition (Psychology)
Research

Keywords

  • Cochlear implants
  • Modulation frequency discrimination
  • Prosody
  • Speech intonation
  • Voice pitch

ASJC Scopus subject areas

  • Sensory Systems

Cite this

Processing F0 with cochlear implants : Modulation frequency discrimination and speech intonation recognition. / Chatterjee, Monita; Peng, Shu Chen.

In: Hearing Research, Vol. 235, No. 1-2, 01.01.2008, p. 143-156.

Research output: Contribution to journalArticle

@article{52d09bd4cf4041ac805adf209a6cd3c5,
title = "Processing F0 with cochlear implants: Modulation frequency discrimination and speech intonation recognition",
abstract = "Fundamental frequency (F0) processing by cochlear implant (CI) listeners was measured using a psychophysical task and a speech intonation recognition task. Listeners' Weber fractions for modulation frequency discrimination were measured using an adaptive, 3-interval, forced-choice paradigm: stimuli were presented through a custom research interface. In the speech intonation recognition task, listeners were asked to indicate whether resynthesized bisyllabic words, when presented in the free field through the listeners' everyday speech processor, were question-like or statement-like. The resynthesized tokens were systematically manipulated to have different initial-F0s to represent male vs. female voices, and different F0 contours (i.e. falling, flat, and rising) Although the CI listeners showed considerable variation in performance on both tasks, significant correlations were observed between the CI listeners' sensitivity to modulation frequency in the psychophysical task and their performance in intonation recognition. Consistent with their greater reliance on temporal cues, the CI listeners' performance in the intonation recognition task was significantly poorer with the higher initial-F0 stimuli than with the lower initial-F0 stimuli. Similar results were obtained with normal hearing listeners attending to noiseband-vocoded CI simulations with reduced spectral resolution.",
keywords = "Cochlear implants, Modulation frequency discrimination, Prosody, Speech intonation, Voice pitch",
author = "Monita Chatterjee and Peng, {Shu Chen}",
year = "2008",
month = "1",
day = "1",
doi = "10.1016/j.heares.2007.11.004",
language = "English (US)",
volume = "235",
pages = "143--156",
journal = "Hearing Research",
issn = "0378-5955",
publisher = "Elsevier",
number = "1-2",

}

TY - JOUR

T1 - Processing F0 with cochlear implants

T2 - Modulation frequency discrimination and speech intonation recognition

AU - Chatterjee, Monita

AU - Peng, Shu Chen

PY - 2008/1/1

Y1 - 2008/1/1

N2 - Fundamental frequency (F0) processing by cochlear implant (CI) listeners was measured using a psychophysical task and a speech intonation recognition task. Listeners' Weber fractions for modulation frequency discrimination were measured using an adaptive, 3-interval, forced-choice paradigm: stimuli were presented through a custom research interface. In the speech intonation recognition task, listeners were asked to indicate whether resynthesized bisyllabic words, when presented in the free field through the listeners' everyday speech processor, were question-like or statement-like. The resynthesized tokens were systematically manipulated to have different initial-F0s to represent male vs. female voices, and different F0 contours (i.e. falling, flat, and rising) Although the CI listeners showed considerable variation in performance on both tasks, significant correlations were observed between the CI listeners' sensitivity to modulation frequency in the psychophysical task and their performance in intonation recognition. Consistent with their greater reliance on temporal cues, the CI listeners' performance in the intonation recognition task was significantly poorer with the higher initial-F0 stimuli than with the lower initial-F0 stimuli. Similar results were obtained with normal hearing listeners attending to noiseband-vocoded CI simulations with reduced spectral resolution.

AB - Fundamental frequency (F0) processing by cochlear implant (CI) listeners was measured using a psychophysical task and a speech intonation recognition task. Listeners' Weber fractions for modulation frequency discrimination were measured using an adaptive, 3-interval, forced-choice paradigm: stimuli were presented through a custom research interface. In the speech intonation recognition task, listeners were asked to indicate whether resynthesized bisyllabic words, when presented in the free field through the listeners' everyday speech processor, were question-like or statement-like. The resynthesized tokens were systematically manipulated to have different initial-F0s to represent male vs. female voices, and different F0 contours (i.e. falling, flat, and rising) Although the CI listeners showed considerable variation in performance on both tasks, significant correlations were observed between the CI listeners' sensitivity to modulation frequency in the psychophysical task and their performance in intonation recognition. Consistent with their greater reliance on temporal cues, the CI listeners' performance in the intonation recognition task was significantly poorer with the higher initial-F0 stimuli than with the lower initial-F0 stimuli. Similar results were obtained with normal hearing listeners attending to noiseband-vocoded CI simulations with reduced spectral resolution.

KW - Cochlear implants

KW - Modulation frequency discrimination

KW - Prosody

KW - Speech intonation

KW - Voice pitch

UR - http://www.scopus.com/inward/record.url?scp=37549071064&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=37549071064&partnerID=8YFLogxK

U2 - 10.1016/j.heares.2007.11.004

DO - 10.1016/j.heares.2007.11.004

M3 - Article

VL - 235

SP - 143

EP - 156

JO - Hearing Research

JF - Hearing Research

SN - 0378-5955

IS - 1-2

ER -