Behavior change intervention research in community settings

How generalizable are the results?

David A Dzewaltowski, Paul A Estabrooks, Lisa M. Klesges, Sheana Bull, Russell E. Glasgow

Research output: Contribution to journalReview article

135 Citations (Scopus)

Abstract

This review examines the extent to which recent behavioral intervention studies conducted in community settings reported on elements of internal and external validity, with an emphasis on whether research has been conducted in representative settings with representative populations. A targeted review was conducted on community-based intervention studies that promoted good nutrition, physical activity or smoking cessation/prevention, and were published in 11 leading health behavior journals between 1996 and 2000. The RE-AIM framework (reach, efficacy, adoption, implementation and maintenance) was used to evaluate the extent to which each paper reported on elements of reach, efficacy/effectiveness, adoption, implementation and maintenance. A total of 27 publications were reviewed. Although most studies (88%) reported participation rates among eligible members of the target audience ('reach'), only 11% of studies reported the participation rate ('adoption') among eligible community-based organizations or settings. Few studies reported if participating individuals or settings were representative of those found in the broader population. Although a majority of studies (59%) reported whether the intervention was delivered ('implementation'), few reported whether individuals maintained behavior change (30%) or whether organizations maintained or institutionalized interventions (0%). To increase the potential to translate community research findings to practice, studies should place a greater emphasis on obtaining and reporting external validity information, such as representativeness. The lack of external validity information limits researchers' and practitioners' ability to judge the generalizability of effects and the comparative utility of interventions. Improved reporting will facilitate implementation of proven and broadly applicable intervention strategies in communities. To make significant progress, all parties, including researchers, reviewers, editors and funders, need to take responsibility for increased emphasis on external validity information and ask what role they can best play to facilitate this process.

Original languageEnglish (US)
Pages (from-to)235-245
Number of pages11
JournalHealth Promotion International
Volume19
Issue number2
DOIs
StatePublished - Jun 1 2004

Fingerprint

Maintenance
Research Personnel
Aptitude
Health Behavior
Smoking Cessation
Research
Population
community
Publications
participation
community research
intervention strategy
health behavior
nutrition
smoking
editor
responsibility
lack
ability

Keywords

  • Behavioral interventions
  • External validity
  • RE-AIM

ASJC Scopus subject areas

  • Health(social science)
  • Public Health, Environmental and Occupational Health

Cite this

Behavior change intervention research in community settings : How generalizable are the results? / Dzewaltowski, David A; Estabrooks, Paul A; Klesges, Lisa M.; Bull, Sheana; Glasgow, Russell E.

In: Health Promotion International, Vol. 19, No. 2, 01.06.2004, p. 235-245.

Research output: Contribution to journalReview article

@article{85faf82485f34c97a709904a7afee090,
title = "Behavior change intervention research in community settings: How generalizable are the results?",
abstract = "This review examines the extent to which recent behavioral intervention studies conducted in community settings reported on elements of internal and external validity, with an emphasis on whether research has been conducted in representative settings with representative populations. A targeted review was conducted on community-based intervention studies that promoted good nutrition, physical activity or smoking cessation/prevention, and were published in 11 leading health behavior journals between 1996 and 2000. The RE-AIM framework (reach, efficacy, adoption, implementation and maintenance) was used to evaluate the extent to which each paper reported on elements of reach, efficacy/effectiveness, adoption, implementation and maintenance. A total of 27 publications were reviewed. Although most studies (88{\%}) reported participation rates among eligible members of the target audience ('reach'), only 11{\%} of studies reported the participation rate ('adoption') among eligible community-based organizations or settings. Few studies reported if participating individuals or settings were representative of those found in the broader population. Although a majority of studies (59{\%}) reported whether the intervention was delivered ('implementation'), few reported whether individuals maintained behavior change (30{\%}) or whether organizations maintained or institutionalized interventions (0{\%}). To increase the potential to translate community research findings to practice, studies should place a greater emphasis on obtaining and reporting external validity information, such as representativeness. The lack of external validity information limits researchers' and practitioners' ability to judge the generalizability of effects and the comparative utility of interventions. Improved reporting will facilitate implementation of proven and broadly applicable intervention strategies in communities. To make significant progress, all parties, including researchers, reviewers, editors and funders, need to take responsibility for increased emphasis on external validity information and ask what role they can best play to facilitate this process.",
keywords = "Behavioral interventions, External validity, RE-AIM",
author = "Dzewaltowski, {David A} and Estabrooks, {Paul A} and Klesges, {Lisa M.} and Sheana Bull and Glasgow, {Russell E.}",
year = "2004",
month = "6",
day = "1",
doi = "10.1093/heapro/dah211",
language = "English (US)",
volume = "19",
pages = "235--245",
journal = "Health Promotion International",
issn = "0957-4824",
publisher = "Oxford University Press",
number = "2",

}

TY - JOUR

T1 - Behavior change intervention research in community settings

T2 - How generalizable are the results?

AU - Dzewaltowski, David A

AU - Estabrooks, Paul A

AU - Klesges, Lisa M.

AU - Bull, Sheana

AU - Glasgow, Russell E.

PY - 2004/6/1

Y1 - 2004/6/1

N2 - This review examines the extent to which recent behavioral intervention studies conducted in community settings reported on elements of internal and external validity, with an emphasis on whether research has been conducted in representative settings with representative populations. A targeted review was conducted on community-based intervention studies that promoted good nutrition, physical activity or smoking cessation/prevention, and were published in 11 leading health behavior journals between 1996 and 2000. The RE-AIM framework (reach, efficacy, adoption, implementation and maintenance) was used to evaluate the extent to which each paper reported on elements of reach, efficacy/effectiveness, adoption, implementation and maintenance. A total of 27 publications were reviewed. Although most studies (88%) reported participation rates among eligible members of the target audience ('reach'), only 11% of studies reported the participation rate ('adoption') among eligible community-based organizations or settings. Few studies reported if participating individuals or settings were representative of those found in the broader population. Although a majority of studies (59%) reported whether the intervention was delivered ('implementation'), few reported whether individuals maintained behavior change (30%) or whether organizations maintained or institutionalized interventions (0%). To increase the potential to translate community research findings to practice, studies should place a greater emphasis on obtaining and reporting external validity information, such as representativeness. The lack of external validity information limits researchers' and practitioners' ability to judge the generalizability of effects and the comparative utility of interventions. Improved reporting will facilitate implementation of proven and broadly applicable intervention strategies in communities. To make significant progress, all parties, including researchers, reviewers, editors and funders, need to take responsibility for increased emphasis on external validity information and ask what role they can best play to facilitate this process.

AB - This review examines the extent to which recent behavioral intervention studies conducted in community settings reported on elements of internal and external validity, with an emphasis on whether research has been conducted in representative settings with representative populations. A targeted review was conducted on community-based intervention studies that promoted good nutrition, physical activity or smoking cessation/prevention, and were published in 11 leading health behavior journals between 1996 and 2000. The RE-AIM framework (reach, efficacy, adoption, implementation and maintenance) was used to evaluate the extent to which each paper reported on elements of reach, efficacy/effectiveness, adoption, implementation and maintenance. A total of 27 publications were reviewed. Although most studies (88%) reported participation rates among eligible members of the target audience ('reach'), only 11% of studies reported the participation rate ('adoption') among eligible community-based organizations or settings. Few studies reported if participating individuals or settings were representative of those found in the broader population. Although a majority of studies (59%) reported whether the intervention was delivered ('implementation'), few reported whether individuals maintained behavior change (30%) or whether organizations maintained or institutionalized interventions (0%). To increase the potential to translate community research findings to practice, studies should place a greater emphasis on obtaining and reporting external validity information, such as representativeness. The lack of external validity information limits researchers' and practitioners' ability to judge the generalizability of effects and the comparative utility of interventions. Improved reporting will facilitate implementation of proven and broadly applicable intervention strategies in communities. To make significant progress, all parties, including researchers, reviewers, editors and funders, need to take responsibility for increased emphasis on external validity information and ask what role they can best play to facilitate this process.

KW - Behavioral interventions

KW - External validity

KW - RE-AIM

UR - http://www.scopus.com/inward/record.url?scp=1842442685&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=1842442685&partnerID=8YFLogxK

U2 - 10.1093/heapro/dah211

DO - 10.1093/heapro/dah211

M3 - Review article

VL - 19

SP - 235

EP - 245

JO - Health Promotion International

JF - Health Promotion International

SN - 0957-4824

IS - 2

ER -