Does "yes or no" on the telephone mean the same as "check-all-that-apply" on the web?

Jolene D Smyth, Leah Melani Christian, Don A. Dillman

Research output: Contribution to journalArticle

19 Citations (Scopus)

Abstract

Recent experimental research has shown that respondents to forced-choice questions endorse significantly more options than respondents to check-all questions. This research has challenged the common assumption that these two question formats can be used interchangeably but has been limited to comparisons within a single survey mode. In this paper we use data from a 2004 random sample survey of university students to compare the forced-choice and check-all question formats across web self-administered and telephone interviewer- administered surveys as they are commonly used in survey practice. We find that the within-mode question format effects revealed by previous research and reaffirmed in the current study appear to persist across modes as well; the telephone forced-choice format produces higher endorsement than the web check-all format. These results provide further support for the argument that the check-all and forced-choice question formats do not produce comparable results and are not interchangeable formats. Additional comparisons show that the forced-choice format performs similarly across telephone and web modes.

Original languageEnglish (US)
Pages (from-to)103-113
Number of pages11
JournalPublic Opinion Quarterly
Volume72
Issue number1
DOIs
StatePublished - Mar 1 2008

Fingerprint

Telephone
telephone
random sample
Students
World Wide Web
university
interview
student

ASJC Scopus subject areas

  • Communication
  • History
  • Sociology and Political Science
  • Social Sciences(all)
  • History and Philosophy of Science

Cite this

Does "yes or no" on the telephone mean the same as "check-all-that-apply" on the web? / Smyth, Jolene D; Christian, Leah Melani; Dillman, Don A.

In: Public Opinion Quarterly, Vol. 72, No. 1, 01.03.2008, p. 103-113.

Research output: Contribution to journalArticle

Smyth, Jolene D ; Christian, Leah Melani ; Dillman, Don A. / Does "yes or no" on the telephone mean the same as "check-all-that-apply" on the web?. In: Public Opinion Quarterly. 2008 ; Vol. 72, No. 1. pp. 103-113.
@article{01dff2b36b7d4672b94369c270b5c558,
title = "Does {"}yes or no{"} on the telephone mean the same as {"}check-all-that-apply{"} on the web?",
abstract = "Recent experimental research has shown that respondents to forced-choice questions endorse significantly more options than respondents to check-all questions. This research has challenged the common assumption that these two question formats can be used interchangeably but has been limited to comparisons within a single survey mode. In this paper we use data from a 2004 random sample survey of university students to compare the forced-choice and check-all question formats across web self-administered and telephone interviewer- administered surveys as they are commonly used in survey practice. We find that the within-mode question format effects revealed by previous research and reaffirmed in the current study appear to persist across modes as well; the telephone forced-choice format produces higher endorsement than the web check-all format. These results provide further support for the argument that the check-all and forced-choice question formats do not produce comparable results and are not interchangeable formats. Additional comparisons show that the forced-choice format performs similarly across telephone and web modes.",
author = "Smyth, {Jolene D} and Christian, {Leah Melani} and Dillman, {Don A.}",
year = "2008",
month = "3",
day = "1",
doi = "10.1093/poq/nfn005",
language = "English (US)",
volume = "72",
pages = "103--113",
journal = "Public Opinion Quarterly",
issn = "0033-362X",
publisher = "Oxford University Press",
number = "1",

}

TY - JOUR

T1 - Does "yes or no" on the telephone mean the same as "check-all-that-apply" on the web?

AU - Smyth, Jolene D

AU - Christian, Leah Melani

AU - Dillman, Don A.

PY - 2008/3/1

Y1 - 2008/3/1

N2 - Recent experimental research has shown that respondents to forced-choice questions endorse significantly more options than respondents to check-all questions. This research has challenged the common assumption that these two question formats can be used interchangeably but has been limited to comparisons within a single survey mode. In this paper we use data from a 2004 random sample survey of university students to compare the forced-choice and check-all question formats across web self-administered and telephone interviewer- administered surveys as they are commonly used in survey practice. We find that the within-mode question format effects revealed by previous research and reaffirmed in the current study appear to persist across modes as well; the telephone forced-choice format produces higher endorsement than the web check-all format. These results provide further support for the argument that the check-all and forced-choice question formats do not produce comparable results and are not interchangeable formats. Additional comparisons show that the forced-choice format performs similarly across telephone and web modes.

AB - Recent experimental research has shown that respondents to forced-choice questions endorse significantly more options than respondents to check-all questions. This research has challenged the common assumption that these two question formats can be used interchangeably but has been limited to comparisons within a single survey mode. In this paper we use data from a 2004 random sample survey of university students to compare the forced-choice and check-all question formats across web self-administered and telephone interviewer- administered surveys as they are commonly used in survey practice. We find that the within-mode question format effects revealed by previous research and reaffirmed in the current study appear to persist across modes as well; the telephone forced-choice format produces higher endorsement than the web check-all format. These results provide further support for the argument that the check-all and forced-choice question formats do not produce comparable results and are not interchangeable formats. Additional comparisons show that the forced-choice format performs similarly across telephone and web modes.

UR - http://www.scopus.com/inward/record.url?scp=41149091132&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=41149091132&partnerID=8YFLogxK

U2 - 10.1093/poq/nfn005

DO - 10.1093/poq/nfn005

M3 - Article

VL - 72

SP - 103

EP - 113

JO - Public Opinion Quarterly

JF - Public Opinion Quarterly

SN - 0033-362X

IS - 1

ER -