Design Effects in the Transition to Web-Based Surveys

Don A. Dillman, Jolene D. Smyth

Research output: Contribution to journalArticle

75 Citations (Scopus)

Abstract

Abstract: Innovation within survey modes should always be mitigated by concerns about survey quality and in particular sampling, coverage, nonresponse, and measurement error. This is as true today with the development of web surveying as it was in the 1970s when telephone surveying was being developed. This paper focuses on measurement error in web surveys. Although Internet technology provides significant opportunities for innovation in survey design, systematic research has yet to be conducted on how most of the possible innovations might affect measurement error, leaving many survey designers "out in the cold." This paper summarizes recent research to provide an overview of how choosing the web mode affects the asking and answering of questions. It starts with examples of how question formats used in other survey modes perform differently in the web mode. It then provides examples of how the visual design of web surveys can influence answers in unexpected ways and how researchers can strategically use visual design to get respondents to provide their answers in a desired format. Finally, the paper concludes with suggested guidelines for web survey design.

Original languageEnglish (US)
Pages (from-to)S90-S96
JournalAmerican Journal of Preventive Medicine
Volume32
Issue number5 SUPPL.
DOIs
StatePublished - May 1 2007

Fingerprint

Surveys and Questionnaires
Telephone
Internet
Research Design
Research Personnel
Guidelines
Technology
Research

ASJC Scopus subject areas

  • Epidemiology
  • Public Health, Environmental and Occupational Health

Cite this

Design Effects in the Transition to Web-Based Surveys. / Dillman, Don A.; Smyth, Jolene D.

In: American Journal of Preventive Medicine, Vol. 32, No. 5 SUPPL., 01.05.2007, p. S90-S96.

Research output: Contribution to journalArticle

@article{80f80af5046943749d8ce8102c6584c8,
title = "Design Effects in the Transition to Web-Based Surveys",
abstract = "Abstract: Innovation within survey modes should always be mitigated by concerns about survey quality and in particular sampling, coverage, nonresponse, and measurement error. This is as true today with the development of web surveying as it was in the 1970s when telephone surveying was being developed. This paper focuses on measurement error in web surveys. Although Internet technology provides significant opportunities for innovation in survey design, systematic research has yet to be conducted on how most of the possible innovations might affect measurement error, leaving many survey designers {"}out in the cold.{"} This paper summarizes recent research to provide an overview of how choosing the web mode affects the asking and answering of questions. It starts with examples of how question formats used in other survey modes perform differently in the web mode. It then provides examples of how the visual design of web surveys can influence answers in unexpected ways and how researchers can strategically use visual design to get respondents to provide their answers in a desired format. Finally, the paper concludes with suggested guidelines for web survey design.",
author = "Dillman, {Don A.} and Smyth, {Jolene D.}",
year = "2007",
month = "5",
day = "1",
doi = "10.1016/j.amepre.2007.03.008",
language = "English (US)",
volume = "32",
pages = "S90--S96",
journal = "American Journal of Preventive Medicine",
issn = "0749-3797",
publisher = "Elsevier Inc.",
number = "5 SUPPL.",

}

TY - JOUR

T1 - Design Effects in the Transition to Web-Based Surveys

AU - Dillman, Don A.

AU - Smyth, Jolene D.

PY - 2007/5/1

Y1 - 2007/5/1

N2 - Abstract: Innovation within survey modes should always be mitigated by concerns about survey quality and in particular sampling, coverage, nonresponse, and measurement error. This is as true today with the development of web surveying as it was in the 1970s when telephone surveying was being developed. This paper focuses on measurement error in web surveys. Although Internet technology provides significant opportunities for innovation in survey design, systematic research has yet to be conducted on how most of the possible innovations might affect measurement error, leaving many survey designers "out in the cold." This paper summarizes recent research to provide an overview of how choosing the web mode affects the asking and answering of questions. It starts with examples of how question formats used in other survey modes perform differently in the web mode. It then provides examples of how the visual design of web surveys can influence answers in unexpected ways and how researchers can strategically use visual design to get respondents to provide their answers in a desired format. Finally, the paper concludes with suggested guidelines for web survey design.

AB - Abstract: Innovation within survey modes should always be mitigated by concerns about survey quality and in particular sampling, coverage, nonresponse, and measurement error. This is as true today with the development of web surveying as it was in the 1970s when telephone surveying was being developed. This paper focuses on measurement error in web surveys. Although Internet technology provides significant opportunities for innovation in survey design, systematic research has yet to be conducted on how most of the possible innovations might affect measurement error, leaving many survey designers "out in the cold." This paper summarizes recent research to provide an overview of how choosing the web mode affects the asking and answering of questions. It starts with examples of how question formats used in other survey modes perform differently in the web mode. It then provides examples of how the visual design of web surveys can influence answers in unexpected ways and how researchers can strategically use visual design to get respondents to provide their answers in a desired format. Finally, the paper concludes with suggested guidelines for web survey design.

UR - http://www.scopus.com/inward/record.url?scp=34247351661&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34247351661&partnerID=8YFLogxK

U2 - 10.1016/j.amepre.2007.03.008

DO - 10.1016/j.amepre.2007.03.008

M3 - Article

C2 - 17466824

AN - SCOPUS:34247351661

VL - 32

SP - S90-S96

JO - American Journal of Preventive Medicine

JF - American Journal of Preventive Medicine

SN - 0749-3797

IS - 5 SUPPL.

ER -