The effect of cati questions, respondents, and interviewers on response time

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

In this paper, we evaluate the joint effects of question, respondent, and interviewer characteristics on response time in a telephone survey. We include question features traditionally examined, such as the length of the question and format of response options, and features that have yet to be examined that are related to the layout and format of interviewer administered questions. We examine how these question features affect the time to ask and answer survey questions and how different interviewers vary in their administration of these questions. This paper uses paradata from the Work and Leisure Today survey and uses cross-classified random effects models. Overall, most of the variation in response time is due to question characteristics, rather than respondent or interviewer attributes. Additionally, we find that question characteristics related to necessary survey design features and respondent confusion are the primary predictors of response time, with little effect of visual design features of the question. We also find modest differences in the effects of question characteristics by interviewer experience.

Original languageEnglish (US)
Pages (from-to)361-396
Number of pages36
JournalJournal of Survey Statistics and Methodology
Volume3
Issue number3
DOIs
StatePublished - Jan 1 2015

Fingerprint

Response Time
interview
Survey Design
Random Effects Model
Telephone
Layout
Predictors
layout
Attribute
Vary
telephone
Necessary
time
Response time
Evaluate
experience

Keywords

  • CATI surveys
  • Questionnaire design
  • Response latency

ASJC Scopus subject areas

  • Statistics and Probability
  • Social Sciences (miscellaneous)
  • Statistics, Probability and Uncertainty
  • Applied Mathematics

Cite this

@article{212272a9ca59401f9ff4e468d59fd6de,
title = "The effect of cati questions, respondents, and interviewers on response time",
abstract = "In this paper, we evaluate the joint effects of question, respondent, and interviewer characteristics on response time in a telephone survey. We include question features traditionally examined, such as the length of the question and format of response options, and features that have yet to be examined that are related to the layout and format of interviewer administered questions. We examine how these question features affect the time to ask and answer survey questions and how different interviewers vary in their administration of these questions. This paper uses paradata from the Work and Leisure Today survey and uses cross-classified random effects models. Overall, most of the variation in response time is due to question characteristics, rather than respondent or interviewer attributes. Additionally, we find that question characteristics related to necessary survey design features and respondent confusion are the primary predictors of response time, with little effect of visual design features of the question. We also find modest differences in the effects of question characteristics by interviewer experience.",
keywords = "CATI surveys, Questionnaire design, Response latency",
author = "Kristen Olson and Smyth, {Jolene D.}",
year = "2015",
month = "1",
day = "1",
doi = "10.1093/jssam/smv021",
language = "English (US)",
volume = "3",
pages = "361--396",
journal = "Journal of Survey Statistics and Methodology",
issn = "2325-0984",
publisher = "Oxford University Press",
number = "3",

}

TY - JOUR

T1 - The effect of cati questions, respondents, and interviewers on response time

AU - Olson, Kristen

AU - Smyth, Jolene D.

PY - 2015/1/1

Y1 - 2015/1/1

N2 - In this paper, we evaluate the joint effects of question, respondent, and interviewer characteristics on response time in a telephone survey. We include question features traditionally examined, such as the length of the question and format of response options, and features that have yet to be examined that are related to the layout and format of interviewer administered questions. We examine how these question features affect the time to ask and answer survey questions and how different interviewers vary in their administration of these questions. This paper uses paradata from the Work and Leisure Today survey and uses cross-classified random effects models. Overall, most of the variation in response time is due to question characteristics, rather than respondent or interviewer attributes. Additionally, we find that question characteristics related to necessary survey design features and respondent confusion are the primary predictors of response time, with little effect of visual design features of the question. We also find modest differences in the effects of question characteristics by interviewer experience.

AB - In this paper, we evaluate the joint effects of question, respondent, and interviewer characteristics on response time in a telephone survey. We include question features traditionally examined, such as the length of the question and format of response options, and features that have yet to be examined that are related to the layout and format of interviewer administered questions. We examine how these question features affect the time to ask and answer survey questions and how different interviewers vary in their administration of these questions. This paper uses paradata from the Work and Leisure Today survey and uses cross-classified random effects models. Overall, most of the variation in response time is due to question characteristics, rather than respondent or interviewer attributes. Additionally, we find that question characteristics related to necessary survey design features and respondent confusion are the primary predictors of response time, with little effect of visual design features of the question. We also find modest differences in the effects of question characteristics by interviewer experience.

KW - CATI surveys

KW - Questionnaire design

KW - Response latency

UR - http://www.scopus.com/inward/record.url?scp=85013862857&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85013862857&partnerID=8YFLogxK

U2 - 10.1093/jssam/smv021

DO - 10.1093/jssam/smv021

M3 - Article

AN - SCOPUS:85013862857

VL - 3

SP - 361

EP - 396

JO - Journal of Survey Statistics and Methodology

JF - Journal of Survey Statistics and Methodology

SN - 2325-0984

IS - 3

ER -