Program records as a source for program implementation assessment and youth outcomes predictors during residential care

Thomas J. Gross, Kristin Duppong Hurley, Justin J. Sullivan, Matthew C. Lambert, Mark J. Van Ryzin, Ronald W. Thompson

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

This study used point card information from a residential program to generate treatment fidelity metrics and determine if the metrics predicted youth outcomes after six months in care. Youth outcomes included staff (n= 52) and youth (n= 143) ratings, youth conduct records kept by the residential program's teaching-family homes and school records. Treatment fidelity metrics included the program components: (a) percentage of positive interactions, (b) number of privileges earned, and (c) a skills taught to interactions ratio. The percentage of positive interactions averaged 90% per youth; 76% of the point cards indicated that privileges were earned; and a variety of life skills were typically taught to the youth (skills ratio =61). The data from the treatment fidelity metrics supported that the program was implemented consistent with program expectations. The range of implementation quality for each measured component was then used to predict youth outcomes. Increased percent of positive interactions predicted significantly decreased externalizing behaviors as reported by staff (β= 0.31, p<001) and youth (β= 0.30, p<.001), and significantly fewer incidents of non-compliance (Exp(b) = 0.93, p< 001) and school problems (Exp(b) =0.91, p< 001) as indicated on the program records. The skills ratio indicated similar trends across outcomes, although non-significant at the p<.01 level. Permanent products may be helpful to develop program treatment fidelity metrics, which may be useful for monitoring implementation and may be associated with improved youth outcomes.

Original languageEnglish (US)
Pages (from-to)153-162
Number of pages10
JournalChildren and Youth Services Review
Volume58
DOIs
StatePublished - Nov 1 2015

Fingerprint

Outcome Assessment (Health Care)
interaction
privilege
staff
teaching program
Therapeutics
school
incident
Teaching
rating
monitoring
trend

Keywords

  • Residential care
  • Token economy
  • Treatment fidelity
  • Youth outcomes

ASJC Scopus subject areas

  • Education
  • Developmental and Educational Psychology
  • Sociology and Political Science

Cite this

Program records as a source for program implementation assessment and youth outcomes predictors during residential care. / Gross, Thomas J.; Hurley, Kristin Duppong; Sullivan, Justin J.; Lambert, Matthew C.; Van Ryzin, Mark J.; Thompson, Ronald W.

In: Children and Youth Services Review, Vol. 58, 01.11.2015, p. 153-162.

Research output: Contribution to journalArticle

@article{4a79f8519e1e4eeba4301bc186975cf5,
title = "Program records as a source for program implementation assessment and youth outcomes predictors during residential care",
abstract = "This study used point card information from a residential program to generate treatment fidelity metrics and determine if the metrics predicted youth outcomes after six months in care. Youth outcomes included staff (n= 52) and youth (n= 143) ratings, youth conduct records kept by the residential program's teaching-family homes and school records. Treatment fidelity metrics included the program components: (a) percentage of positive interactions, (b) number of privileges earned, and (c) a skills taught to interactions ratio. The percentage of positive interactions averaged 90{\%} per youth; 76{\%} of the point cards indicated that privileges were earned; and a variety of life skills were typically taught to the youth (skills ratio =61). The data from the treatment fidelity metrics supported that the program was implemented consistent with program expectations. The range of implementation quality for each measured component was then used to predict youth outcomes. Increased percent of positive interactions predicted significantly decreased externalizing behaviors as reported by staff (β= 0.31, p<001) and youth (β= 0.30, p<.001), and significantly fewer incidents of non-compliance (Exp(b) = 0.93, p< 001) and school problems (Exp(b) =0.91, p< 001) as indicated on the program records. The skills ratio indicated similar trends across outcomes, although non-significant at the p<.01 level. Permanent products may be helpful to develop program treatment fidelity metrics, which may be useful for monitoring implementation and may be associated with improved youth outcomes.",
keywords = "Residential care, Token economy, Treatment fidelity, Youth outcomes",
author = "Gross, {Thomas J.} and Hurley, {Kristin Duppong} and Sullivan, {Justin J.} and Lambert, {Matthew C.} and {Van Ryzin}, {Mark J.} and Thompson, {Ronald W.}",
year = "2015",
month = "11",
day = "1",
doi = "10.1016/j.childyouth.2015.09.016",
language = "English (US)",
volume = "58",
pages = "153--162",
journal = "Children and Youth Services Review",
issn = "0190-7409",
publisher = "Elsevier Limited",

}

TY - JOUR

T1 - Program records as a source for program implementation assessment and youth outcomes predictors during residential care

AU - Gross, Thomas J.

AU - Hurley, Kristin Duppong

AU - Sullivan, Justin J.

AU - Lambert, Matthew C.

AU - Van Ryzin, Mark J.

AU - Thompson, Ronald W.

PY - 2015/11/1

Y1 - 2015/11/1

N2 - This study used point card information from a residential program to generate treatment fidelity metrics and determine if the metrics predicted youth outcomes after six months in care. Youth outcomes included staff (n= 52) and youth (n= 143) ratings, youth conduct records kept by the residential program's teaching-family homes and school records. Treatment fidelity metrics included the program components: (a) percentage of positive interactions, (b) number of privileges earned, and (c) a skills taught to interactions ratio. The percentage of positive interactions averaged 90% per youth; 76% of the point cards indicated that privileges were earned; and a variety of life skills were typically taught to the youth (skills ratio =61). The data from the treatment fidelity metrics supported that the program was implemented consistent with program expectations. The range of implementation quality for each measured component was then used to predict youth outcomes. Increased percent of positive interactions predicted significantly decreased externalizing behaviors as reported by staff (β= 0.31, p<001) and youth (β= 0.30, p<.001), and significantly fewer incidents of non-compliance (Exp(b) = 0.93, p< 001) and school problems (Exp(b) =0.91, p< 001) as indicated on the program records. The skills ratio indicated similar trends across outcomes, although non-significant at the p<.01 level. Permanent products may be helpful to develop program treatment fidelity metrics, which may be useful for monitoring implementation and may be associated with improved youth outcomes.

AB - This study used point card information from a residential program to generate treatment fidelity metrics and determine if the metrics predicted youth outcomes after six months in care. Youth outcomes included staff (n= 52) and youth (n= 143) ratings, youth conduct records kept by the residential program's teaching-family homes and school records. Treatment fidelity metrics included the program components: (a) percentage of positive interactions, (b) number of privileges earned, and (c) a skills taught to interactions ratio. The percentage of positive interactions averaged 90% per youth; 76% of the point cards indicated that privileges were earned; and a variety of life skills were typically taught to the youth (skills ratio =61). The data from the treatment fidelity metrics supported that the program was implemented consistent with program expectations. The range of implementation quality for each measured component was then used to predict youth outcomes. Increased percent of positive interactions predicted significantly decreased externalizing behaviors as reported by staff (β= 0.31, p<001) and youth (β= 0.30, p<.001), and significantly fewer incidents of non-compliance (Exp(b) = 0.93, p< 001) and school problems (Exp(b) =0.91, p< 001) as indicated on the program records. The skills ratio indicated similar trends across outcomes, although non-significant at the p<.01 level. Permanent products may be helpful to develop program treatment fidelity metrics, which may be useful for monitoring implementation and may be associated with improved youth outcomes.

KW - Residential care

KW - Token economy

KW - Treatment fidelity

KW - Youth outcomes

UR - http://www.scopus.com/inward/record.url?scp=84942610501&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84942610501&partnerID=8YFLogxK

U2 - 10.1016/j.childyouth.2015.09.016

DO - 10.1016/j.childyouth.2015.09.016

M3 - Article

AN - SCOPUS:84942610501

VL - 58

SP - 153

EP - 162

JO - Children and Youth Services Review

JF - Children and Youth Services Review

SN - 0190-7409

ER -