Examining changes of interviewlength over the course of the field period

Antje Kirchner, Kristen Olson

Research output: Contribution to journalArticle

Abstract

It is well established that interviewers learn behaviors both during training and on the job. How this learning occurs has received surprisingly little empirical attention: Is it driven by the interviewer herself or by the respondents she interviews? There are two competing hypotheses about what happens during field data collection: (1) interviewers learn behaviors from their previous interviews, and thus change their behavior in reaction to the behaviors previously encountered; and (2) interviewers encounter different types of and, especially, less cooperative respondents (i.e., nonresponse propensity affecting the measurement error situation), leading to changes in interview behaviors over the course of the field period. We refer to these hypotheses as the experience and response propensity hypotheses, respectively. This paper examines the relationship between proxy indicators for the experience and response propensity hypotheses on interview length using data and paradata from two telephone surveys. Our results indicate that both interviewer-driven experience and respondent-driven response propensity are associated with the length of interview. While general interviewing experience is nonsignificant, within-study experience decreases interview length significantly, even when accounting for changes in sample composition. Interviewers with higher cooperation rates have significantly shorter interviews in study one; however, this effect is mediated by the number of words spoken by the interviewer. We find that older respondents and male respondents have longer interviews despite controlling for the number of words spoken, as do respondents who complete the survey at first contact. Not surprisingly, interviews are significantly longer the more words interviewers and respondents speak.

Original languageEnglish (US)
Article numbersmw031
Pages (from-to)84-108
Number of pages25
JournalJournal of Survey Statistics and Methodology
Volume5
Issue number1
DOIs
StatePublished - Mar 1 2017

Fingerprint

interview
Measurement errors
Telephone
Chemical analysis
Non-response
Measurement Error
Experience
Contact
Decrease
experience
response behavior
Propensity
telephone
contact
Relationships
Learning
Training
learning

Keywords

  • Interviewer experience
  • Interviewer learning
  • Paradata
  • Response propensity

ASJC Scopus subject areas

  • Statistics and Probability
  • Social Sciences (miscellaneous)
  • Statistics, Probability and Uncertainty
  • Applied Mathematics

Cite this

Examining changes of interviewlength over the course of the field period. / Kirchner, Antje; Olson, Kristen.

In: Journal of Survey Statistics and Methodology, Vol. 5, No. 1, smw031, 01.03.2017, p. 84-108.

Research output: Contribution to journalArticle

@article{1e70c186a4b7422b81845cedb80f4ec0,
title = "Examining changes of interviewlength over the course of the field period",
abstract = "It is well established that interviewers learn behaviors both during training and on the job. How this learning occurs has received surprisingly little empirical attention: Is it driven by the interviewer herself or by the respondents she interviews? There are two competing hypotheses about what happens during field data collection: (1) interviewers learn behaviors from their previous interviews, and thus change their behavior in reaction to the behaviors previously encountered; and (2) interviewers encounter different types of and, especially, less cooperative respondents (i.e., nonresponse propensity affecting the measurement error situation), leading to changes in interview behaviors over the course of the field period. We refer to these hypotheses as the experience and response propensity hypotheses, respectively. This paper examines the relationship between proxy indicators for the experience and response propensity hypotheses on interview length using data and paradata from two telephone surveys. Our results indicate that both interviewer-driven experience and respondent-driven response propensity are associated with the length of interview. While general interviewing experience is nonsignificant, within-study experience decreases interview length significantly, even when accounting for changes in sample composition. Interviewers with higher cooperation rates have significantly shorter interviews in study one; however, this effect is mediated by the number of words spoken by the interviewer. We find that older respondents and male respondents have longer interviews despite controlling for the number of words spoken, as do respondents who complete the survey at first contact. Not surprisingly, interviews are significantly longer the more words interviewers and respondents speak.",
keywords = "Interviewer experience, Interviewer learning, Paradata, Response propensity",
author = "Antje Kirchner and Kristen Olson",
year = "2017",
month = "3",
day = "1",
doi = "10.1093/jssam/smw031",
language = "English (US)",
volume = "5",
pages = "84--108",
journal = "Journal of Survey Statistics and Methodology",
issn = "2325-0984",
publisher = "Oxford University Press",
number = "1",

}

TY - JOUR

T1 - Examining changes of interviewlength over the course of the field period

AU - Kirchner, Antje

AU - Olson, Kristen

PY - 2017/3/1

Y1 - 2017/3/1

N2 - It is well established that interviewers learn behaviors both during training and on the job. How this learning occurs has received surprisingly little empirical attention: Is it driven by the interviewer herself or by the respondents she interviews? There are two competing hypotheses about what happens during field data collection: (1) interviewers learn behaviors from their previous interviews, and thus change their behavior in reaction to the behaviors previously encountered; and (2) interviewers encounter different types of and, especially, less cooperative respondents (i.e., nonresponse propensity affecting the measurement error situation), leading to changes in interview behaviors over the course of the field period. We refer to these hypotheses as the experience and response propensity hypotheses, respectively. This paper examines the relationship between proxy indicators for the experience and response propensity hypotheses on interview length using data and paradata from two telephone surveys. Our results indicate that both interviewer-driven experience and respondent-driven response propensity are associated with the length of interview. While general interviewing experience is nonsignificant, within-study experience decreases interview length significantly, even when accounting for changes in sample composition. Interviewers with higher cooperation rates have significantly shorter interviews in study one; however, this effect is mediated by the number of words spoken by the interviewer. We find that older respondents and male respondents have longer interviews despite controlling for the number of words spoken, as do respondents who complete the survey at first contact. Not surprisingly, interviews are significantly longer the more words interviewers and respondents speak.

AB - It is well established that interviewers learn behaviors both during training and on the job. How this learning occurs has received surprisingly little empirical attention: Is it driven by the interviewer herself or by the respondents she interviews? There are two competing hypotheses about what happens during field data collection: (1) interviewers learn behaviors from their previous interviews, and thus change their behavior in reaction to the behaviors previously encountered; and (2) interviewers encounter different types of and, especially, less cooperative respondents (i.e., nonresponse propensity affecting the measurement error situation), leading to changes in interview behaviors over the course of the field period. We refer to these hypotheses as the experience and response propensity hypotheses, respectively. This paper examines the relationship between proxy indicators for the experience and response propensity hypotheses on interview length using data and paradata from two telephone surveys. Our results indicate that both interviewer-driven experience and respondent-driven response propensity are associated with the length of interview. While general interviewing experience is nonsignificant, within-study experience decreases interview length significantly, even when accounting for changes in sample composition. Interviewers with higher cooperation rates have significantly shorter interviews in study one; however, this effect is mediated by the number of words spoken by the interviewer. We find that older respondents and male respondents have longer interviews despite controlling for the number of words spoken, as do respondents who complete the survey at first contact. Not surprisingly, interviews are significantly longer the more words interviewers and respondents speak.

KW - Interviewer experience

KW - Interviewer learning

KW - Paradata

KW - Response propensity

UR - http://www.scopus.com/inward/record.url?scp=85017219215&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85017219215&partnerID=8YFLogxK

U2 - 10.1093/jssam/smw031

DO - 10.1093/jssam/smw031

M3 - Article

AN - SCOPUS:85017219215

VL - 5

SP - 84

EP - 108

JO - Journal of Survey Statistics and Methodology

JF - Journal of Survey Statistics and Methodology

SN - 2325-0984

IS - 1

M1 - smw031

ER -