Effect of interviewer experience on interview pace and interviewer attitudes

Kristen Olson, Andy Peytchev

Research output: Contribution to journalArticle

44 Citations (Scopus)

Abstract

Traditional statistical analyses of interviewer effects on survey data do not examine whether these effects change over a field period. However, the nature of the survey interview is dynamic. Interviewers' behaviors and perceptions may evolve as they gain experience, thus potentially affecting data quality. This paper looks at how interview length and interviewer evaluations of respondents change over interviewers' workloads. Multilevel models with random interviewer effects are used to account for the clustering of cases within interviewers and individual interviewer characteristics in the 1984, 1988, and 2000 National Election Studies. The 1984 and 1988 NES released sample in four replicates, minimizing the confound between order in an interviewers' workload and sample composition. We find that over the course of the studies, both measures change significantly. Interviewer prior survey experience also was significantly negatively related to the length of the interview. These findings have implications for interviewer training prior to and during studies, as well as suggesting future research to reveal why these behaviors and perceptions change.

Original languageEnglish (US)
Pages (from-to)273-286
Number of pages14
JournalPublic Opinion Quarterly
Volume71
Issue number2
DOIs
StatePublished - Jun 1 2007

Fingerprint

interview
experience
reactivity effect
workload
Chemical analysis
election research
data quality
Length
Workload
Change Perception
Elections
Survey Data
Evaluation
Random Effects
evaluation

ASJC Scopus subject areas

  • Communication
  • History
  • Sociology and Political Science
  • Social Sciences(all)
  • History and Philosophy of Science

Cite this

Effect of interviewer experience on interview pace and interviewer attitudes. / Olson, Kristen; Peytchev, Andy.

In: Public Opinion Quarterly, Vol. 71, No. 2, 01.06.2007, p. 273-286.

Research output: Contribution to journalArticle

@article{b488047295794f899dbc584059933391,
title = "Effect of interviewer experience on interview pace and interviewer attitudes",
abstract = "Traditional statistical analyses of interviewer effects on survey data do not examine whether these effects change over a field period. However, the nature of the survey interview is dynamic. Interviewers' behaviors and perceptions may evolve as they gain experience, thus potentially affecting data quality. This paper looks at how interview length and interviewer evaluations of respondents change over interviewers' workloads. Multilevel models with random interviewer effects are used to account for the clustering of cases within interviewers and individual interviewer characteristics in the 1984, 1988, and 2000 National Election Studies. The 1984 and 1988 NES released sample in four replicates, minimizing the confound between order in an interviewers' workload and sample composition. We find that over the course of the studies, both measures change significantly. Interviewer prior survey experience also was significantly negatively related to the length of the interview. These findings have implications for interviewer training prior to and during studies, as well as suggesting future research to reveal why these behaviors and perceptions change.",
author = "Kristen Olson and Andy Peytchev",
year = "2007",
month = "6",
day = "1",
doi = "10.1093/poq/nfm007",
language = "English (US)",
volume = "71",
pages = "273--286",
journal = "Public Opinion Quarterly",
issn = "0033-362X",
publisher = "Oxford University Press",
number = "2",

}

TY - JOUR

T1 - Effect of interviewer experience on interview pace and interviewer attitudes

AU - Olson, Kristen

AU - Peytchev, Andy

PY - 2007/6/1

Y1 - 2007/6/1

N2 - Traditional statistical analyses of interviewer effects on survey data do not examine whether these effects change over a field period. However, the nature of the survey interview is dynamic. Interviewers' behaviors and perceptions may evolve as they gain experience, thus potentially affecting data quality. This paper looks at how interview length and interviewer evaluations of respondents change over interviewers' workloads. Multilevel models with random interviewer effects are used to account for the clustering of cases within interviewers and individual interviewer characteristics in the 1984, 1988, and 2000 National Election Studies. The 1984 and 1988 NES released sample in four replicates, minimizing the confound between order in an interviewers' workload and sample composition. We find that over the course of the studies, both measures change significantly. Interviewer prior survey experience also was significantly negatively related to the length of the interview. These findings have implications for interviewer training prior to and during studies, as well as suggesting future research to reveal why these behaviors and perceptions change.

AB - Traditional statistical analyses of interviewer effects on survey data do not examine whether these effects change over a field period. However, the nature of the survey interview is dynamic. Interviewers' behaviors and perceptions may evolve as they gain experience, thus potentially affecting data quality. This paper looks at how interview length and interviewer evaluations of respondents change over interviewers' workloads. Multilevel models with random interviewer effects are used to account for the clustering of cases within interviewers and individual interviewer characteristics in the 1984, 1988, and 2000 National Election Studies. The 1984 and 1988 NES released sample in four replicates, minimizing the confound between order in an interviewers' workload and sample composition. We find that over the course of the studies, both measures change significantly. Interviewer prior survey experience also was significantly negatively related to the length of the interview. These findings have implications for interviewer training prior to and during studies, as well as suggesting future research to reveal why these behaviors and perceptions change.

UR - http://www.scopus.com/inward/record.url?scp=34547792264&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34547792264&partnerID=8YFLogxK

U2 - 10.1093/poq/nfm007

DO - 10.1093/poq/nfm007

M3 - Article

AN - SCOPUS:34547792264

VL - 71

SP - 273

EP - 286

JO - Public Opinion Quarterly

JF - Public Opinion Quarterly

SN - 0033-362X

IS - 2

ER -