Memory gaps in the american time use survey. Investigating the role of retrieval cues and respondents’ level of effort

Antje Kirchner, Ana Lucía Córdova-Cazar, Robert F. Belli, Caitlin E. Deal

Research output: Contribution to journalArticle

Abstract

Unaccounted respondent memory gaps – i.e., those activity gaps that are attributed by interviewers to respondents’ memory failure – have serious implications for data quality. We contribute to the existing literature by investigating interviewing dynamics using paradata, distinguishing temporary memory gaps, which can be resolved during the interview, from enduring memory gaps, which cannot be resolved. We investigate factors that are associated with both kinds of memory gaps and how different response strategies are associated with data quality. We investigate two hypotheses that are associated with temporary and enduring memory gaps. The motivated cuing hypothesis posits that respondents who display more behaviors related to the presence and use of retrieval cues throughout the survey will resolve temporary memory gaps more successfully compared to respondents displaying fewer such behaviors. This should result in overall lower levels of enduring memory gaps. The lack of effort hypothesis suggests that respondent who are less eager to participate in the survey will expend less cognitive effort to resolve temporary memory gaps compared to more motivated respondents. This should then result in a positive association with enduring memory gaps and no association with temporary memory gaps. Using survey and paradata from the 2010 ATUS, our analyses indicate that, as hypothesized, behaviors indicating the use of retrieval cues are positively associated with temporary memory gaps and negatively associated with enduring memory gaps. Motivated respondents experiencing memory difficulties overcome what otherwise would result in enduring memory gaps more successfully compared to other respondents. Indicators of lack of effort, such as whether or not the respondent initially refused to participate in the survey, are positively associated with enduring memory gaps suggesting that reluctant respondents do not resolve memory gaps. The paper concludes with a discussion of implications for survey research.

Original languageEnglish (US)
Pages (from-to)231-245
Number of pages15
JournalSurvey Research Methods
Volume12
Issue number3
DOIs
StatePublished - Jan 1 2018

Fingerprint

time
data quality
lack
survey research
interview
literature

Keywords

  • American time use survey
  • Memory gaps
  • Paradata
  • Response strategy

ASJC Scopus subject areas

  • Education

Cite this

Memory gaps in the american time use survey. Investigating the role of retrieval cues and respondents’ level of effort. / Kirchner, Antje; Córdova-Cazar, Ana Lucía; Belli, Robert F.; Deal, Caitlin E.

In: Survey Research Methods, Vol. 12, No. 3, 01.01.2018, p. 231-245.

Research output: Contribution to journalArticle

Kirchner, Antje ; Córdova-Cazar, Ana Lucía ; Belli, Robert F. ; Deal, Caitlin E. / Memory gaps in the american time use survey. Investigating the role of retrieval cues and respondents’ level of effort. In: Survey Research Methods. 2018 ; Vol. 12, No. 3. pp. 231-245.
@article{303f71ba3c3d4e0d8913ac7a203813d0,
title = "Memory gaps in the american time use survey. Investigating the role of retrieval cues and respondents’ level of effort",
abstract = "Unaccounted respondent memory gaps – i.e., those activity gaps that are attributed by interviewers to respondents’ memory failure – have serious implications for data quality. We contribute to the existing literature by investigating interviewing dynamics using paradata, distinguishing temporary memory gaps, which can be resolved during the interview, from enduring memory gaps, which cannot be resolved. We investigate factors that are associated with both kinds of memory gaps and how different response strategies are associated with data quality. We investigate two hypotheses that are associated with temporary and enduring memory gaps. The motivated cuing hypothesis posits that respondents who display more behaviors related to the presence and use of retrieval cues throughout the survey will resolve temporary memory gaps more successfully compared to respondents displaying fewer such behaviors. This should result in overall lower levels of enduring memory gaps. The lack of effort hypothesis suggests that respondent who are less eager to participate in the survey will expend less cognitive effort to resolve temporary memory gaps compared to more motivated respondents. This should then result in a positive association with enduring memory gaps and no association with temporary memory gaps. Using survey and paradata from the 2010 ATUS, our analyses indicate that, as hypothesized, behaviors indicating the use of retrieval cues are positively associated with temporary memory gaps and negatively associated with enduring memory gaps. Motivated respondents experiencing memory difficulties overcome what otherwise would result in enduring memory gaps more successfully compared to other respondents. Indicators of lack of effort, such as whether or not the respondent initially refused to participate in the survey, are positively associated with enduring memory gaps suggesting that reluctant respondents do not resolve memory gaps. The paper concludes with a discussion of implications for survey research.",
keywords = "American time use survey, Memory gaps, Paradata, Response strategy",
author = "Antje Kirchner and C{\'o}rdova-Cazar, {Ana Luc{\'i}a} and Belli, {Robert F.} and Deal, {Caitlin E.}",
year = "2018",
month = "1",
day = "1",
doi = "10.18148/srm/2018.v12i3.7257",
language = "English (US)",
volume = "12",
pages = "231--245",
journal = "Survey Research Methods",
issn = "1864-3361",
publisher = "European Survey Research Association",
number = "3",

}

TY - JOUR

T1 - Memory gaps in the american time use survey. Investigating the role of retrieval cues and respondents’ level of effort

AU - Kirchner, Antje

AU - Córdova-Cazar, Ana Lucía

AU - Belli, Robert F.

AU - Deal, Caitlin E.

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Unaccounted respondent memory gaps – i.e., those activity gaps that are attributed by interviewers to respondents’ memory failure – have serious implications for data quality. We contribute to the existing literature by investigating interviewing dynamics using paradata, distinguishing temporary memory gaps, which can be resolved during the interview, from enduring memory gaps, which cannot be resolved. We investigate factors that are associated with both kinds of memory gaps and how different response strategies are associated with data quality. We investigate two hypotheses that are associated with temporary and enduring memory gaps. The motivated cuing hypothesis posits that respondents who display more behaviors related to the presence and use of retrieval cues throughout the survey will resolve temporary memory gaps more successfully compared to respondents displaying fewer such behaviors. This should result in overall lower levels of enduring memory gaps. The lack of effort hypothesis suggests that respondent who are less eager to participate in the survey will expend less cognitive effort to resolve temporary memory gaps compared to more motivated respondents. This should then result in a positive association with enduring memory gaps and no association with temporary memory gaps. Using survey and paradata from the 2010 ATUS, our analyses indicate that, as hypothesized, behaviors indicating the use of retrieval cues are positively associated with temporary memory gaps and negatively associated with enduring memory gaps. Motivated respondents experiencing memory difficulties overcome what otherwise would result in enduring memory gaps more successfully compared to other respondents. Indicators of lack of effort, such as whether or not the respondent initially refused to participate in the survey, are positively associated with enduring memory gaps suggesting that reluctant respondents do not resolve memory gaps. The paper concludes with a discussion of implications for survey research.

AB - Unaccounted respondent memory gaps – i.e., those activity gaps that are attributed by interviewers to respondents’ memory failure – have serious implications for data quality. We contribute to the existing literature by investigating interviewing dynamics using paradata, distinguishing temporary memory gaps, which can be resolved during the interview, from enduring memory gaps, which cannot be resolved. We investigate factors that are associated with both kinds of memory gaps and how different response strategies are associated with data quality. We investigate two hypotheses that are associated with temporary and enduring memory gaps. The motivated cuing hypothesis posits that respondents who display more behaviors related to the presence and use of retrieval cues throughout the survey will resolve temporary memory gaps more successfully compared to respondents displaying fewer such behaviors. This should result in overall lower levels of enduring memory gaps. The lack of effort hypothesis suggests that respondent who are less eager to participate in the survey will expend less cognitive effort to resolve temporary memory gaps compared to more motivated respondents. This should then result in a positive association with enduring memory gaps and no association with temporary memory gaps. Using survey and paradata from the 2010 ATUS, our analyses indicate that, as hypothesized, behaviors indicating the use of retrieval cues are positively associated with temporary memory gaps and negatively associated with enduring memory gaps. Motivated respondents experiencing memory difficulties overcome what otherwise would result in enduring memory gaps more successfully compared to other respondents. Indicators of lack of effort, such as whether or not the respondent initially refused to participate in the survey, are positively associated with enduring memory gaps suggesting that reluctant respondents do not resolve memory gaps. The paper concludes with a discussion of implications for survey research.

KW - American time use survey

KW - Memory gaps

KW - Paradata

KW - Response strategy

UR - http://www.scopus.com/inward/record.url?scp=85061481421&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85061481421&partnerID=8YFLogxK

U2 - 10.18148/srm/2018.v12i3.7257

DO - 10.18148/srm/2018.v12i3.7257

M3 - Article

AN - SCOPUS:85061481421

VL - 12

SP - 231

EP - 245

JO - Survey Research Methods

JF - Survey Research Methods

SN - 1864-3361

IS - 3

ER -