An Evaluation of the Observer Effect on Treatment Integrity in a Day Treatment Center for Children

Monica R. Howard, Raymond V. Burke, Keith D Allen

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Treatment integrity is an important concern in treatment centers but is often overlooked. Performance feedback is a well-established approach to improving treatment integrity, but is underused and undervalued. One way to increase its value to treatment centers may be to expose unrealized benefits on the observer who collects the performance feedback data. This "observer effect" could increase the value of performance feedback and promote more consistent evaluation of treatment integrity. The purpose of this investigation was to evaluate the observer effect on treatment integrity. Five supervisors who worked in a day treatment center were asked to collect performance feedback data on staff members' integrity in following a standard treatment protocol that supervisors were also expected to follow. Results showed an immediate and marked improvement in treatment integrity in three supervisors who collected but never received performance feedback. For two supervisors, this effect was reversed and replicated. Implications are discussed.

Original languageEnglish (US)
Pages (from-to)490-515
Number of pages26
JournalBehavior Modification
Volume37
Issue number4
DOIs
StatePublished - Jul 1 2013

Fingerprint

Therapeutics
Evaluation
Observer
Integrity
Clinical Protocols
Supervisors
Staff

Keywords

  • day treatment setting
  • observer effect
  • performance feedback
  • reactivity
  • treatment integrity

ASJC Scopus subject areas

  • Developmental and Educational Psychology
  • Clinical Psychology
  • Arts and Humanities (miscellaneous)

Cite this

An Evaluation of the Observer Effect on Treatment Integrity in a Day Treatment Center for Children. / Howard, Monica R.; Burke, Raymond V.; Allen, Keith D.

In: Behavior Modification, Vol. 37, No. 4, 01.07.2013, p. 490-515.

Research output: Contribution to journalArticle

@article{04b7e729a1ad41518b3a7110d624f214,
title = "An Evaluation of the Observer Effect on Treatment Integrity in a Day Treatment Center for Children",
abstract = "Treatment integrity is an important concern in treatment centers but is often overlooked. Performance feedback is a well-established approach to improving treatment integrity, but is underused and undervalued. One way to increase its value to treatment centers may be to expose unrealized benefits on the observer who collects the performance feedback data. This {"}observer effect{"} could increase the value of performance feedback and promote more consistent evaluation of treatment integrity. The purpose of this investigation was to evaluate the observer effect on treatment integrity. Five supervisors who worked in a day treatment center were asked to collect performance feedback data on staff members' integrity in following a standard treatment protocol that supervisors were also expected to follow. Results showed an immediate and marked improvement in treatment integrity in three supervisors who collected but never received performance feedback. For two supervisors, this effect was reversed and replicated. Implications are discussed.",
keywords = "day treatment setting, observer effect, performance feedback, reactivity, treatment integrity",
author = "Howard, {Monica R.} and Burke, {Raymond V.} and Allen, {Keith D}",
year = "2013",
month = "7",
day = "1",
doi = "10.1177/0145445513486801",
language = "English (US)",
volume = "37",
pages = "490--515",
journal = "Behavior Modification",
issn = "0145-4455",
publisher = "SAGE Publications Inc.",
number = "4",

}

TY - JOUR

T1 - An Evaluation of the Observer Effect on Treatment Integrity in a Day Treatment Center for Children

AU - Howard, Monica R.

AU - Burke, Raymond V.

AU - Allen, Keith D

PY - 2013/7/1

Y1 - 2013/7/1

N2 - Treatment integrity is an important concern in treatment centers but is often overlooked. Performance feedback is a well-established approach to improving treatment integrity, but is underused and undervalued. One way to increase its value to treatment centers may be to expose unrealized benefits on the observer who collects the performance feedback data. This "observer effect" could increase the value of performance feedback and promote more consistent evaluation of treatment integrity. The purpose of this investigation was to evaluate the observer effect on treatment integrity. Five supervisors who worked in a day treatment center were asked to collect performance feedback data on staff members' integrity in following a standard treatment protocol that supervisors were also expected to follow. Results showed an immediate and marked improvement in treatment integrity in three supervisors who collected but never received performance feedback. For two supervisors, this effect was reversed and replicated. Implications are discussed.

AB - Treatment integrity is an important concern in treatment centers but is often overlooked. Performance feedback is a well-established approach to improving treatment integrity, but is underused and undervalued. One way to increase its value to treatment centers may be to expose unrealized benefits on the observer who collects the performance feedback data. This "observer effect" could increase the value of performance feedback and promote more consistent evaluation of treatment integrity. The purpose of this investigation was to evaluate the observer effect on treatment integrity. Five supervisors who worked in a day treatment center were asked to collect performance feedback data on staff members' integrity in following a standard treatment protocol that supervisors were also expected to follow. Results showed an immediate and marked improvement in treatment integrity in three supervisors who collected but never received performance feedback. For two supervisors, this effect was reversed and replicated. Implications are discussed.

KW - day treatment setting

KW - observer effect

KW - performance feedback

KW - reactivity

KW - treatment integrity

UR - http://www.scopus.com/inward/record.url?scp=84878839875&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84878839875&partnerID=8YFLogxK

U2 - 10.1177/0145445513486801

DO - 10.1177/0145445513486801

M3 - Article

VL - 37

SP - 490

EP - 515

JO - Behavior Modification

JF - Behavior Modification

SN - 0145-4455

IS - 4

ER -