Provider-Associated Measurement Error in Routine Outcome Monitoring in Community Mental Health

Emily B.H. Treichler, William D. Spaulding

Research output: Contribution to journalArticle

Abstract

Despite the strengths of routine outcome monitoring (ROM) in community mental health settings, there are a number of barriers to effective implementation of ROM, including measurement error due to provider factors (e.g., training level) and non-target client factors (i.e., client characteristics which have no meaningful relationship to the outcome of interest). In this study, ROM data from 80 client-provider dyads were examined for sources of variance due to provider factors and non-target client factors. Results indicated that provider factors and non-target client factors accounted for between 9.6 and 54% of the variance in the ROM measures. Our findings supported past research that provider characteristics impact ROM, and added the novel finding that client gender, age, diagnosis, and cognition also impact ROM. Methods to increase accuracy and utility of ROM in community mental health are discussed.

Original languageEnglish (US)
Pages (from-to)780-789
Number of pages10
JournalAdministration and Policy in Mental Health and Mental Health Services Research
Volume45
Issue number5
DOIs
StatePublished - Sep 1 2018

Fingerprint

Mental Health
Cognition
Outcome Assessment (Health Care)
Research

Keywords

  • Community mental health
  • Measurement
  • Routine outcome monitoring
  • Serious mental illness

ASJC Scopus subject areas

  • Phychiatric Mental Health
  • Health Policy
  • Public Health, Environmental and Occupational Health
  • Psychiatry and Mental health

Cite this

@article{b8c3b21f4ad84f0e84c93750cec09411,
title = "Provider-Associated Measurement Error in Routine Outcome Monitoring in Community Mental Health",
abstract = "Despite the strengths of routine outcome monitoring (ROM) in community mental health settings, there are a number of barriers to effective implementation of ROM, including measurement error due to provider factors (e.g., training level) and non-target client factors (i.e., client characteristics which have no meaningful relationship to the outcome of interest). In this study, ROM data from 80 client-provider dyads were examined for sources of variance due to provider factors and non-target client factors. Results indicated that provider factors and non-target client factors accounted for between 9.6 and 54{\%} of the variance in the ROM measures. Our findings supported past research that provider characteristics impact ROM, and added the novel finding that client gender, age, diagnosis, and cognition also impact ROM. Methods to increase accuracy and utility of ROM in community mental health are discussed.",
keywords = "Community mental health, Measurement, Routine outcome monitoring, Serious mental illness",
author = "Treichler, {Emily B.H.} and Spaulding, {William D.}",
year = "2018",
month = "9",
day = "1",
doi = "10.1007/s10488-018-0861-2",
language = "English (US)",
volume = "45",
pages = "780--789",
journal = "Administration and Policy in Mental Health and Mental Health Services Research",
issn = "0894-587X",
publisher = "Springer New York",
number = "5",

}

TY - JOUR

T1 - Provider-Associated Measurement Error in Routine Outcome Monitoring in Community Mental Health

AU - Treichler, Emily B.H.

AU - Spaulding, William D.

PY - 2018/9/1

Y1 - 2018/9/1

N2 - Despite the strengths of routine outcome monitoring (ROM) in community mental health settings, there are a number of barriers to effective implementation of ROM, including measurement error due to provider factors (e.g., training level) and non-target client factors (i.e., client characteristics which have no meaningful relationship to the outcome of interest). In this study, ROM data from 80 client-provider dyads were examined for sources of variance due to provider factors and non-target client factors. Results indicated that provider factors and non-target client factors accounted for between 9.6 and 54% of the variance in the ROM measures. Our findings supported past research that provider characteristics impact ROM, and added the novel finding that client gender, age, diagnosis, and cognition also impact ROM. Methods to increase accuracy and utility of ROM in community mental health are discussed.

AB - Despite the strengths of routine outcome monitoring (ROM) in community mental health settings, there are a number of barriers to effective implementation of ROM, including measurement error due to provider factors (e.g., training level) and non-target client factors (i.e., client characteristics which have no meaningful relationship to the outcome of interest). In this study, ROM data from 80 client-provider dyads were examined for sources of variance due to provider factors and non-target client factors. Results indicated that provider factors and non-target client factors accounted for between 9.6 and 54% of the variance in the ROM measures. Our findings supported past research that provider characteristics impact ROM, and added the novel finding that client gender, age, diagnosis, and cognition also impact ROM. Methods to increase accuracy and utility of ROM in community mental health are discussed.

KW - Community mental health

KW - Measurement

KW - Routine outcome monitoring

KW - Serious mental illness

UR - http://www.scopus.com/inward/record.url?scp=85044061257&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85044061257&partnerID=8YFLogxK

U2 - 10.1007/s10488-018-0861-2

DO - 10.1007/s10488-018-0861-2

M3 - Article

C2 - 29550889

AN - SCOPUS:85044061257

VL - 45

SP - 780

EP - 789

JO - Administration and Policy in Mental Health and Mental Health Services Research

JF - Administration and Policy in Mental Health and Mental Health Services Research

SN - 0894-587X

IS - 5

ER -