Predicting users' perceived trust in Embodied Conversational Agents using vocal dynamics

Aaron C. Elkins, Douglas C Derrick, Judee K. Burgoon, Jay F. Nunamaker

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

One of the major challenges facing neurophysiological HCI design is to determine the systems and sensors that accurately and noninvasively measure human cognitive processes. Specifically, it is a significant undertaking to integrate sensors and measurements into an information system and accurately measure and interpret the human state. Using an experimental design this study explores the use of unobtrusive sensors based on behavioral and neurophysiological responses to predict human trust using the voice. Participants (N=88) completed a face-to-face interview with an Embodied Conversational Agent (ECA) and reported their perceptions of the ECA. They reported three dimensions consistent with the Mayer model of perceived trustworthiness. During the interaction, the demeanor and gender of the avatar was manipulated and these manipulations affected the reported measures of trustworthiness. Using growth modeling and multilevel analysis of covariance methods, a model was developed that could predict human trust during the interaction using the voice, time, and demographics.

Original languageEnglish (US)
Title of host publicationProceedings of the 45th Annual Hawaii International Conference on System Sciences, HICSS-45
PublisherIEEE Computer Society
Pages579-588
Number of pages10
ISBN (Print)9780769545257
DOIs
StatePublished - Jan 1 2012
Event2012 45th Hawaii International Conference on System Sciences, HICSS 2012 - Maui, HI, United States
Duration: Jan 4 2012Jan 7 2012

Publication series

NameProceedings of the Annual Hawaii International Conference on System Sciences
ISSN (Print)1530-1605

Conference

Conference2012 45th Hawaii International Conference on System Sciences, HICSS 2012
CountryUnited States
CityMaui, HI
Period1/4/121/7/12

Fingerprint

Sensors
Human computer interaction
Design of experiments
Information systems

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Elkins, A. C., Derrick, D. C., Burgoon, J. K., & Nunamaker, J. F. (2012). Predicting users' perceived trust in Embodied Conversational Agents using vocal dynamics. In Proceedings of the 45th Annual Hawaii International Conference on System Sciences, HICSS-45 (pp. 579-588). [6148598] (Proceedings of the Annual Hawaii International Conference on System Sciences). IEEE Computer Society. https://doi.org/10.1109/HICSS.2012.483

Predicting users' perceived trust in Embodied Conversational Agents using vocal dynamics. / Elkins, Aaron C.; Derrick, Douglas C; Burgoon, Judee K.; Nunamaker, Jay F.

Proceedings of the 45th Annual Hawaii International Conference on System Sciences, HICSS-45. IEEE Computer Society, 2012. p. 579-588 6148598 (Proceedings of the Annual Hawaii International Conference on System Sciences).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Elkins, AC, Derrick, DC, Burgoon, JK & Nunamaker, JF 2012, Predicting users' perceived trust in Embodied Conversational Agents using vocal dynamics. in Proceedings of the 45th Annual Hawaii International Conference on System Sciences, HICSS-45., 6148598, Proceedings of the Annual Hawaii International Conference on System Sciences, IEEE Computer Society, pp. 579-588, 2012 45th Hawaii International Conference on System Sciences, HICSS 2012, Maui, HI, United States, 1/4/12. https://doi.org/10.1109/HICSS.2012.483
Elkins AC, Derrick DC, Burgoon JK, Nunamaker JF. Predicting users' perceived trust in Embodied Conversational Agents using vocal dynamics. In Proceedings of the 45th Annual Hawaii International Conference on System Sciences, HICSS-45. IEEE Computer Society. 2012. p. 579-588. 6148598. (Proceedings of the Annual Hawaii International Conference on System Sciences). https://doi.org/10.1109/HICSS.2012.483
Elkins, Aaron C. ; Derrick, Douglas C ; Burgoon, Judee K. ; Nunamaker, Jay F. / Predicting users' perceived trust in Embodied Conversational Agents using vocal dynamics. Proceedings of the 45th Annual Hawaii International Conference on System Sciences, HICSS-45. IEEE Computer Society, 2012. pp. 579-588 (Proceedings of the Annual Hawaii International Conference on System Sciences).
@inproceedings{1cee24faae9e4814b18f3a1252e60002,
title = "Predicting users' perceived trust in Embodied Conversational Agents using vocal dynamics",
abstract = "One of the major challenges facing neurophysiological HCI design is to determine the systems and sensors that accurately and noninvasively measure human cognitive processes. Specifically, it is a significant undertaking to integrate sensors and measurements into an information system and accurately measure and interpret the human state. Using an experimental design this study explores the use of unobtrusive sensors based on behavioral and neurophysiological responses to predict human trust using the voice. Participants (N=88) completed a face-to-face interview with an Embodied Conversational Agent (ECA) and reported their perceptions of the ECA. They reported three dimensions consistent with the Mayer model of perceived trustworthiness. During the interaction, the demeanor and gender of the avatar was manipulated and these manipulations affected the reported measures of trustworthiness. Using growth modeling and multilevel analysis of covariance methods, a model was developed that could predict human trust during the interaction using the voice, time, and demographics.",
author = "Elkins, {Aaron C.} and Derrick, {Douglas C} and Burgoon, {Judee K.} and Nunamaker, {Jay F.}",
year = "2012",
month = "1",
day = "1",
doi = "10.1109/HICSS.2012.483",
language = "English (US)",
isbn = "9780769545257",
series = "Proceedings of the Annual Hawaii International Conference on System Sciences",
publisher = "IEEE Computer Society",
pages = "579--588",
booktitle = "Proceedings of the 45th Annual Hawaii International Conference on System Sciences, HICSS-45",

}

TY - GEN

T1 - Predicting users' perceived trust in Embodied Conversational Agents using vocal dynamics

AU - Elkins, Aaron C.

AU - Derrick, Douglas C

AU - Burgoon, Judee K.

AU - Nunamaker, Jay F.

PY - 2012/1/1

Y1 - 2012/1/1

N2 - One of the major challenges facing neurophysiological HCI design is to determine the systems and sensors that accurately and noninvasively measure human cognitive processes. Specifically, it is a significant undertaking to integrate sensors and measurements into an information system and accurately measure and interpret the human state. Using an experimental design this study explores the use of unobtrusive sensors based on behavioral and neurophysiological responses to predict human trust using the voice. Participants (N=88) completed a face-to-face interview with an Embodied Conversational Agent (ECA) and reported their perceptions of the ECA. They reported three dimensions consistent with the Mayer model of perceived trustworthiness. During the interaction, the demeanor and gender of the avatar was manipulated and these manipulations affected the reported measures of trustworthiness. Using growth modeling and multilevel analysis of covariance methods, a model was developed that could predict human trust during the interaction using the voice, time, and demographics.

AB - One of the major challenges facing neurophysiological HCI design is to determine the systems and sensors that accurately and noninvasively measure human cognitive processes. Specifically, it is a significant undertaking to integrate sensors and measurements into an information system and accurately measure and interpret the human state. Using an experimental design this study explores the use of unobtrusive sensors based on behavioral and neurophysiological responses to predict human trust using the voice. Participants (N=88) completed a face-to-face interview with an Embodied Conversational Agent (ECA) and reported their perceptions of the ECA. They reported three dimensions consistent with the Mayer model of perceived trustworthiness. During the interaction, the demeanor and gender of the avatar was manipulated and these manipulations affected the reported measures of trustworthiness. Using growth modeling and multilevel analysis of covariance methods, a model was developed that could predict human trust during the interaction using the voice, time, and demographics.

UR - http://www.scopus.com/inward/record.url?scp=84857941095&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84857941095&partnerID=8YFLogxK

U2 - 10.1109/HICSS.2012.483

DO - 10.1109/HICSS.2012.483

M3 - Conference contribution

SN - 9780769545257

T3 - Proceedings of the Annual Hawaii International Conference on System Sciences

SP - 579

EP - 588

BT - Proceedings of the 45th Annual Hawaii International Conference on System Sciences, HICSS-45

PB - IEEE Computer Society

ER -