Memory, communication, and data quality in calendar interviews

Robert F. Belli, Ipek Bilgen, Tarek Al Baghal

Research output: Contribution to journalReview article

14 Citations (Scopus)

Abstract

Calendar instruments are hypothesized to promote data quality through the increased use of retrieval cues and conversational probes intended to clarify meanings. This research explores these hypotheses by examining the associations between retrieval and conversational verbal behaviors and data-quality measures. A verbal behavior coding scheme was applied to transcripts of 165 calendar interviews that collected life-course information on residence, marriage, employment, and unemployment from respondents in the Panel Study of Income Dynamics (PSID). Confirmatory factor analyses revealed three latent factors for interviewers (retrieval probes, rapport behaviors, and conversational behaviors intended to satisfy questionnaire objective) and three latent factors for respondents (retrieval strategies, rapport, and conversational behaviors indicative of difficulty being interviewed). Ratios of discrepancies in annual totals between retrospective calendar reports and reports collected for up to thirty years in the PSID over the total number of available years were used as measures of data quality. Regression analyses show that the level of behavior and the level of experiential complexity interact in their effect on data quality. Both interviewer and respondent retrieval behaviors are associated with better data quality when the retrieval task is more difficult but poorer accuracy when experiential complexity is low. Both interviewer and respondent rapport behaviors are associated with reduced error for complex employment histories but convey mixed results with marriage and unemployment histories. Patterns of results for interviewer conversational and respondent difficulty being interviewed behaviors are likewise inconsistent. Results do not completely confirm hypotheses but nevertheless have implications regarding interviewing practice and suggest directions for future research.

Original languageEnglish (US)
Pages (from-to)194-219
Number of pages26
JournalPublic Opinion Quarterly
Volume77
Issue numberS1
DOIs
StatePublished - Apr 4 2013

Fingerprint

data quality
Data storage equipment
communication
Communication
interview
language behavior
unemployment
marriage
employment history
income
Calendar
coding
regression
questionnaire
history
Rapport

ASJC Scopus subject areas

  • Communication
  • History
  • Sociology and Political Science
  • Social Sciences(all)
  • History and Philosophy of Science

Cite this

Memory, communication, and data quality in calendar interviews. / Belli, Robert F.; Bilgen, Ipek; Al Baghal, Tarek.

In: Public Opinion Quarterly, Vol. 77, No. S1, 04.04.2013, p. 194-219.

Research output: Contribution to journalReview article

Belli, Robert F. ; Bilgen, Ipek ; Al Baghal, Tarek. / Memory, communication, and data quality in calendar interviews. In: Public Opinion Quarterly. 2013 ; Vol. 77, No. S1. pp. 194-219.
@article{c99fede2ea43439cb6120d5994ec83e2,
title = "Memory, communication, and data quality in calendar interviews",
abstract = "Calendar instruments are hypothesized to promote data quality through the increased use of retrieval cues and conversational probes intended to clarify meanings. This research explores these hypotheses by examining the associations between retrieval and conversational verbal behaviors and data-quality measures. A verbal behavior coding scheme was applied to transcripts of 165 calendar interviews that collected life-course information on residence, marriage, employment, and unemployment from respondents in the Panel Study of Income Dynamics (PSID). Confirmatory factor analyses revealed three latent factors for interviewers (retrieval probes, rapport behaviors, and conversational behaviors intended to satisfy questionnaire objective) and three latent factors for respondents (retrieval strategies, rapport, and conversational behaviors indicative of difficulty being interviewed). Ratios of discrepancies in annual totals between retrospective calendar reports and reports collected for up to thirty years in the PSID over the total number of available years were used as measures of data quality. Regression analyses show that the level of behavior and the level of experiential complexity interact in their effect on data quality. Both interviewer and respondent retrieval behaviors are associated with better data quality when the retrieval task is more difficult but poorer accuracy when experiential complexity is low. Both interviewer and respondent rapport behaviors are associated with reduced error for complex employment histories but convey mixed results with marriage and unemployment histories. Patterns of results for interviewer conversational and respondent difficulty being interviewed behaviors are likewise inconsistent. Results do not completely confirm hypotheses but nevertheless have implications regarding interviewing practice and suggest directions for future research.",
author = "Belli, {Robert F.} and Ipek Bilgen and {Al Baghal}, Tarek",
year = "2013",
month = "4",
day = "4",
doi = "10.1093/poq/nfs099",
language = "English (US)",
volume = "77",
pages = "194--219",
journal = "Public Opinion Quarterly",
issn = "0033-362X",
publisher = "Oxford University Press",
number = "S1",

}

TY - JOUR

T1 - Memory, communication, and data quality in calendar interviews

AU - Belli, Robert F.

AU - Bilgen, Ipek

AU - Al Baghal, Tarek

PY - 2013/4/4

Y1 - 2013/4/4

N2 - Calendar instruments are hypothesized to promote data quality through the increased use of retrieval cues and conversational probes intended to clarify meanings. This research explores these hypotheses by examining the associations between retrieval and conversational verbal behaviors and data-quality measures. A verbal behavior coding scheme was applied to transcripts of 165 calendar interviews that collected life-course information on residence, marriage, employment, and unemployment from respondents in the Panel Study of Income Dynamics (PSID). Confirmatory factor analyses revealed three latent factors for interviewers (retrieval probes, rapport behaviors, and conversational behaviors intended to satisfy questionnaire objective) and three latent factors for respondents (retrieval strategies, rapport, and conversational behaviors indicative of difficulty being interviewed). Ratios of discrepancies in annual totals between retrospective calendar reports and reports collected for up to thirty years in the PSID over the total number of available years were used as measures of data quality. Regression analyses show that the level of behavior and the level of experiential complexity interact in their effect on data quality. Both interviewer and respondent retrieval behaviors are associated with better data quality when the retrieval task is more difficult but poorer accuracy when experiential complexity is low. Both interviewer and respondent rapport behaviors are associated with reduced error for complex employment histories but convey mixed results with marriage and unemployment histories. Patterns of results for interviewer conversational and respondent difficulty being interviewed behaviors are likewise inconsistent. Results do not completely confirm hypotheses but nevertheless have implications regarding interviewing practice and suggest directions for future research.

AB - Calendar instruments are hypothesized to promote data quality through the increased use of retrieval cues and conversational probes intended to clarify meanings. This research explores these hypotheses by examining the associations between retrieval and conversational verbal behaviors and data-quality measures. A verbal behavior coding scheme was applied to transcripts of 165 calendar interviews that collected life-course information on residence, marriage, employment, and unemployment from respondents in the Panel Study of Income Dynamics (PSID). Confirmatory factor analyses revealed three latent factors for interviewers (retrieval probes, rapport behaviors, and conversational behaviors intended to satisfy questionnaire objective) and three latent factors for respondents (retrieval strategies, rapport, and conversational behaviors indicative of difficulty being interviewed). Ratios of discrepancies in annual totals between retrospective calendar reports and reports collected for up to thirty years in the PSID over the total number of available years were used as measures of data quality. Regression analyses show that the level of behavior and the level of experiential complexity interact in their effect on data quality. Both interviewer and respondent retrieval behaviors are associated with better data quality when the retrieval task is more difficult but poorer accuracy when experiential complexity is low. Both interviewer and respondent rapport behaviors are associated with reduced error for complex employment histories but convey mixed results with marriage and unemployment histories. Patterns of results for interviewer conversational and respondent difficulty being interviewed behaviors are likewise inconsistent. Results do not completely confirm hypotheses but nevertheless have implications regarding interviewing practice and suggest directions for future research.

UR - http://www.scopus.com/inward/record.url?scp=84875590814&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84875590814&partnerID=8YFLogxK

U2 - 10.1093/poq/nfs099

DO - 10.1093/poq/nfs099

M3 - Review article

AN - SCOPUS:84875590814

VL - 77

SP - 194

EP - 219

JO - Public Opinion Quarterly

JF - Public Opinion Quarterly

SN - 0033-362X

IS - S1

ER -