Helping respondents get it right the first time: The influence of words, symbols, and graphics in Web surveys

Leah Melani Christian, Don A. Dillman, Jolene D. Smyth

Research output: Contribution to journalArticle

62 Citations (Scopus)

Abstract

We utilize and apply visual design theory to experimentally test ways to improve the likelihood that web respondents report date answers in a particular format desired by the researcher, thus reducing possible deleterious effects of error messages or requests for corrections. These experiments were embedded in a series of web surveys of random samples of university students. We seek to examine the sequential and cumulative effects of visually manipulating the size and proximity of the answer spaces, the use of symbols instead of words, the verbal language of the question stem, and the graphical location of the symbolic instruction. Our results show that the successive series of visual language manipulations improve respondents' use of the desired format (two digits for the month and four digits for the year) from 45 percent to 96 percent. These results suggest that writing effective questions for web surveys may depend as much or more on the presentation of the answer categories/spaces as the question wording itself.

Original languageEnglish (US)
Pages (from-to)113-125
Number of pages13
JournalPublic Opinion Quarterly
Volume71
Issue number1
DOIs
StatePublished - Mar 1 2007

Fingerprint

symbol
Visual languages
language
random sample
manipulation
Students
instruction
university
experiment
student
Experiments
World Wide Web
Symbol
Experiment
Visual Languages
Language
Manipulation
Visual Design
Design Theory
Proximity

ASJC Scopus subject areas

  • Communication
  • History
  • Sociology and Political Science
  • Social Sciences(all)
  • History and Philosophy of Science

Cite this

Helping respondents get it right the first time : The influence of words, symbols, and graphics in Web surveys. / Christian, Leah Melani; Dillman, Don A.; Smyth, Jolene D.

In: Public Opinion Quarterly, Vol. 71, No. 1, 01.03.2007, p. 113-125.

Research output: Contribution to journalArticle

@article{d4925655139244e09521e41cdda99210,
title = "Helping respondents get it right the first time: The influence of words, symbols, and graphics in Web surveys",
abstract = "We utilize and apply visual design theory to experimentally test ways to improve the likelihood that web respondents report date answers in a particular format desired by the researcher, thus reducing possible deleterious effects of error messages or requests for corrections. These experiments were embedded in a series of web surveys of random samples of university students. We seek to examine the sequential and cumulative effects of visually manipulating the size and proximity of the answer spaces, the use of symbols instead of words, the verbal language of the question stem, and the graphical location of the symbolic instruction. Our results show that the successive series of visual language manipulations improve respondents' use of the desired format (two digits for the month and four digits for the year) from 45 percent to 96 percent. These results suggest that writing effective questions for web surveys may depend as much or more on the presentation of the answer categories/spaces as the question wording itself.",
author = "Christian, {Leah Melani} and Dillman, {Don A.} and Smyth, {Jolene D.}",
year = "2007",
month = "3",
day = "1",
doi = "10.1093/poq/nfl039",
language = "English (US)",
volume = "71",
pages = "113--125",
journal = "Public Opinion Quarterly",
issn = "0033-362X",
publisher = "Oxford University Press",
number = "1",

}

TY - JOUR

T1 - Helping respondents get it right the first time

T2 - The influence of words, symbols, and graphics in Web surveys

AU - Christian, Leah Melani

AU - Dillman, Don A.

AU - Smyth, Jolene D.

PY - 2007/3/1

Y1 - 2007/3/1

N2 - We utilize and apply visual design theory to experimentally test ways to improve the likelihood that web respondents report date answers in a particular format desired by the researcher, thus reducing possible deleterious effects of error messages or requests for corrections. These experiments were embedded in a series of web surveys of random samples of university students. We seek to examine the sequential and cumulative effects of visually manipulating the size and proximity of the answer spaces, the use of symbols instead of words, the verbal language of the question stem, and the graphical location of the symbolic instruction. Our results show that the successive series of visual language manipulations improve respondents' use of the desired format (two digits for the month and four digits for the year) from 45 percent to 96 percent. These results suggest that writing effective questions for web surveys may depend as much or more on the presentation of the answer categories/spaces as the question wording itself.

AB - We utilize and apply visual design theory to experimentally test ways to improve the likelihood that web respondents report date answers in a particular format desired by the researcher, thus reducing possible deleterious effects of error messages or requests for corrections. These experiments were embedded in a series of web surveys of random samples of university students. We seek to examine the sequential and cumulative effects of visually manipulating the size and proximity of the answer spaces, the use of symbols instead of words, the verbal language of the question stem, and the graphical location of the symbolic instruction. Our results show that the successive series of visual language manipulations improve respondents' use of the desired format (two digits for the month and four digits for the year) from 45 percent to 96 percent. These results suggest that writing effective questions for web surveys may depend as much or more on the presentation of the answer categories/spaces as the question wording itself.

UR - http://www.scopus.com/inward/record.url?scp=34047153215&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34047153215&partnerID=8YFLogxK

U2 - 10.1093/poq/nfl039

DO - 10.1093/poq/nfl039

M3 - Article

AN - SCOPUS:34047153215

VL - 71

SP - 113

EP - 125

JO - Public Opinion Quarterly

JF - Public Opinion Quarterly

SN - 0033-362X

IS - 1

ER -