Assessing potential errors in level-of-effort paradata using GPS data

James Wagner, Kristen Olson, Minako Edgar

Research output: Contribution to journalArticle

Abstract

Surveys are a critical resource for social, economic, and health research. The ability to effciently collect these data and develop accurate post-survey adjustments depends upon reliable data about effort required to recruit sampled units. Level-of-effort paradata are data generated by interviewers during the process of collecting data in surveys. These data are often used as predictors in nonresponse adjustment models or to guide data collection efforts. However, recent research has found that these data may include measurement errors, which would lead to inaccurate decisions in the field or reduced effectiveness for adjustment purposes (Biemer, Chen, & Wang, 2013; West, 2013). In order to assess whether errors occur in level-of-effort paradata for in-person surveys, we introduce a new source of data - Global Positioning System (GPS) data generated by smartphones carried by interviewers. We examine the quality of the GPS data. We also link the GPS data with the interviewer-reported call records in order to identify potential errors in the call records. Specifically, we examine the question of whether there may be missing call records. Given the lack of a gold standard, we perform a sensitivity analysis under various assumptions to see how these would change our conclusions.

Original languageEnglish (US)
Pages (from-to)219-233
Number of pages15
JournalSurvey Research Methods
Volume11
Issue number3 Special Issue
DOIs
StatePublished - Jan 1 2017

Fingerprint

interview
response behavior
gold standard
social economics
human being
lack
ability
health
resources

Keywords

  • Call records
  • In person surveys
  • Measurement error
  • Paradata

ASJC Scopus subject areas

  • Education

Cite this

Assessing potential errors in level-of-effort paradata using GPS data. / Wagner, James; Olson, Kristen; Edgar, Minako.

In: Survey Research Methods, Vol. 11, No. 3 Special Issue, 01.01.2017, p. 219-233.

Research output: Contribution to journalArticle

Wagner, James ; Olson, Kristen ; Edgar, Minako. / Assessing potential errors in level-of-effort paradata using GPS data. In: Survey Research Methods. 2017 ; Vol. 11, No. 3 Special Issue. pp. 219-233.
@article{8114d4533be4401eab23e07b673f0e11,
title = "Assessing potential errors in level-of-effort paradata using GPS data",
abstract = "Surveys are a critical resource for social, economic, and health research. The ability to effciently collect these data and develop accurate post-survey adjustments depends upon reliable data about effort required to recruit sampled units. Level-of-effort paradata are data generated by interviewers during the process of collecting data in surveys. These data are often used as predictors in nonresponse adjustment models or to guide data collection efforts. However, recent research has found that these data may include measurement errors, which would lead to inaccurate decisions in the field or reduced effectiveness for adjustment purposes (Biemer, Chen, & Wang, 2013; West, 2013). In order to assess whether errors occur in level-of-effort paradata for in-person surveys, we introduce a new source of data - Global Positioning System (GPS) data generated by smartphones carried by interviewers. We examine the quality of the GPS data. We also link the GPS data with the interviewer-reported call records in order to identify potential errors in the call records. Specifically, we examine the question of whether there may be missing call records. Given the lack of a gold standard, we perform a sensitivity analysis under various assumptions to see how these would change our conclusions.",
keywords = "Call records, In person surveys, Measurement error, Paradata",
author = "James Wagner and Kristen Olson and Minako Edgar",
year = "2017",
month = "1",
day = "1",
doi = "10.18148/srm/2017.v11i3.6794",
language = "English (US)",
volume = "11",
pages = "219--233",
journal = "Survey Research Methods",
issn = "1864-3361",
publisher = "European Survey Research Association",
number = "3 Special Issue",

}

TY - JOUR

T1 - Assessing potential errors in level-of-effort paradata using GPS data

AU - Wagner, James

AU - Olson, Kristen

AU - Edgar, Minako

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Surveys are a critical resource for social, economic, and health research. The ability to effciently collect these data and develop accurate post-survey adjustments depends upon reliable data about effort required to recruit sampled units. Level-of-effort paradata are data generated by interviewers during the process of collecting data in surveys. These data are often used as predictors in nonresponse adjustment models or to guide data collection efforts. However, recent research has found that these data may include measurement errors, which would lead to inaccurate decisions in the field or reduced effectiveness for adjustment purposes (Biemer, Chen, & Wang, 2013; West, 2013). In order to assess whether errors occur in level-of-effort paradata for in-person surveys, we introduce a new source of data - Global Positioning System (GPS) data generated by smartphones carried by interviewers. We examine the quality of the GPS data. We also link the GPS data with the interviewer-reported call records in order to identify potential errors in the call records. Specifically, we examine the question of whether there may be missing call records. Given the lack of a gold standard, we perform a sensitivity analysis under various assumptions to see how these would change our conclusions.

AB - Surveys are a critical resource for social, economic, and health research. The ability to effciently collect these data and develop accurate post-survey adjustments depends upon reliable data about effort required to recruit sampled units. Level-of-effort paradata are data generated by interviewers during the process of collecting data in surveys. These data are often used as predictors in nonresponse adjustment models or to guide data collection efforts. However, recent research has found that these data may include measurement errors, which would lead to inaccurate decisions in the field or reduced effectiveness for adjustment purposes (Biemer, Chen, & Wang, 2013; West, 2013). In order to assess whether errors occur in level-of-effort paradata for in-person surveys, we introduce a new source of data - Global Positioning System (GPS) data generated by smartphones carried by interviewers. We examine the quality of the GPS data. We also link the GPS data with the interviewer-reported call records in order to identify potential errors in the call records. Specifically, we examine the question of whether there may be missing call records. Given the lack of a gold standard, we perform a sensitivity analysis under various assumptions to see how these would change our conclusions.

KW - Call records

KW - In person surveys

KW - Measurement error

KW - Paradata

UR - http://www.scopus.com/inward/record.url?scp=85032671001&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85032671001&partnerID=8YFLogxK

U2 - 10.18148/srm/2017.v11i3.6794

DO - 10.18148/srm/2017.v11i3.6794

M3 - Article

AN - SCOPUS:85032671001

VL - 11

SP - 219

EP - 233

JO - Survey Research Methods

JF - Survey Research Methods

SN - 1864-3361

IS - 3 Special Issue

ER -