Abstract

The primary aim of this study was to decrease the subjectivity of the Team Performance Observation Tool (TPOT) and determine the psychometric properties of this tool when using scenario-specific targeted behavioral markers (TBMs). We used a convenience sample of 47 physical therapy and 25 nursing students at an academic medical center who were organized in interprofessional teams of three to care for a simulated patient. The TPOT demonstrated satisfactory validity and reliability with the use of TBMs. We demonstrated significant correlations between the TPOT overall rating and two scenario-specific outcomes: (1) a negative correlation between the TPOT overall rating and the number of medical errors committed by the 24 teams (r = -0.531, p = 0.008) and (2) a positive correlation between the TPOT overall rating and a time-based functional outcome (r = 0.803, p < 0.001). We demonstrated substantial test-retest reliability (kappa = 0.707, p < 0.001), inter-rater reliability (kappa = 0.730), and good internal consistency reliability (Cronbach's α = 0.921). The results of our study support the use of scenario-specific TBMs to enhance the reliability and validity of the TPOT for use in the evaluation of team-based simulation scenarios. Further evaluation of the TPOT with TBMs from other simulation and training contexts is warranted.

Original languageEnglish (US)
Pages (from-to)202-208
Number of pages7
JournalJournal of Interprofessional Care
Volume29
Issue number3
DOIs
StatePublished - May 1 2015

Fingerprint

Observation
Education
Reproducibility of Results
Medical Errors
Nursing Students
Psychometrics
Therapeutics

Keywords

  • Interprofessional education
  • Simulation
  • Targeted behavioral markers
  • Team Performance Observation Tool
  • Teamwork

ASJC Scopus subject areas

  • Medicine(all)

Cite this

@article{e18fbd8fe497490a95d3985f603557a5,
title = "Evaluation of the team performance observation tool with targeted behavioral markers in simulation-based interprofessional education",
abstract = "The primary aim of this study was to decrease the subjectivity of the Team Performance Observation Tool (TPOT) and determine the psychometric properties of this tool when using scenario-specific targeted behavioral markers (TBMs). We used a convenience sample of 47 physical therapy and 25 nursing students at an academic medical center who were organized in interprofessional teams of three to care for a simulated patient. The TPOT demonstrated satisfactory validity and reliability with the use of TBMs. We demonstrated significant correlations between the TPOT overall rating and two scenario-specific outcomes: (1) a negative correlation between the TPOT overall rating and the number of medical errors committed by the 24 teams (r = -0.531, p = 0.008) and (2) a positive correlation between the TPOT overall rating and a time-based functional outcome (r = 0.803, p < 0.001). We demonstrated substantial test-retest reliability (kappa = 0.707, p < 0.001), inter-rater reliability (kappa = 0.730), and good internal consistency reliability (Cronbach's α = 0.921). The results of our study support the use of scenario-specific TBMs to enhance the reliability and validity of the TPOT for use in the evaluation of team-based simulation scenarios. Further evaluation of the TPOT with TBMs from other simulation and training contexts is warranted.",
keywords = "Interprofessional education, Simulation, Targeted behavioral markers, Team Performance Observation Tool, Teamwork",
author = "Chao Zhang and Miller, {Connie L} and Volkman, {Kathleen Gerri} and Meza, {Jane L} and Katherine Jones",
year = "2015",
month = "5",
day = "1",
doi = "10.3109/13561820.2014.982789",
language = "English (US)",
volume = "29",
pages = "202--208",
journal = "Journal of Interprofessional Care",
issn = "1356-1820",
publisher = "Informa Healthcare",
number = "3",

}

TY - JOUR

T1 - Evaluation of the team performance observation tool with targeted behavioral markers in simulation-based interprofessional education

AU - Zhang, Chao

AU - Miller, Connie L

AU - Volkman, Kathleen Gerri

AU - Meza, Jane L

AU - Jones, Katherine

PY - 2015/5/1

Y1 - 2015/5/1

N2 - The primary aim of this study was to decrease the subjectivity of the Team Performance Observation Tool (TPOT) and determine the psychometric properties of this tool when using scenario-specific targeted behavioral markers (TBMs). We used a convenience sample of 47 physical therapy and 25 nursing students at an academic medical center who were organized in interprofessional teams of three to care for a simulated patient. The TPOT demonstrated satisfactory validity and reliability with the use of TBMs. We demonstrated significant correlations between the TPOT overall rating and two scenario-specific outcomes: (1) a negative correlation between the TPOT overall rating and the number of medical errors committed by the 24 teams (r = -0.531, p = 0.008) and (2) a positive correlation between the TPOT overall rating and a time-based functional outcome (r = 0.803, p < 0.001). We demonstrated substantial test-retest reliability (kappa = 0.707, p < 0.001), inter-rater reliability (kappa = 0.730), and good internal consistency reliability (Cronbach's α = 0.921). The results of our study support the use of scenario-specific TBMs to enhance the reliability and validity of the TPOT for use in the evaluation of team-based simulation scenarios. Further evaluation of the TPOT with TBMs from other simulation and training contexts is warranted.

AB - The primary aim of this study was to decrease the subjectivity of the Team Performance Observation Tool (TPOT) and determine the psychometric properties of this tool when using scenario-specific targeted behavioral markers (TBMs). We used a convenience sample of 47 physical therapy and 25 nursing students at an academic medical center who were organized in interprofessional teams of three to care for a simulated patient. The TPOT demonstrated satisfactory validity and reliability with the use of TBMs. We demonstrated significant correlations between the TPOT overall rating and two scenario-specific outcomes: (1) a negative correlation between the TPOT overall rating and the number of medical errors committed by the 24 teams (r = -0.531, p = 0.008) and (2) a positive correlation between the TPOT overall rating and a time-based functional outcome (r = 0.803, p < 0.001). We demonstrated substantial test-retest reliability (kappa = 0.707, p < 0.001), inter-rater reliability (kappa = 0.730), and good internal consistency reliability (Cronbach's α = 0.921). The results of our study support the use of scenario-specific TBMs to enhance the reliability and validity of the TPOT for use in the evaluation of team-based simulation scenarios. Further evaluation of the TPOT with TBMs from other simulation and training contexts is warranted.

KW - Interprofessional education

KW - Simulation

KW - Targeted behavioral markers

KW - Team Performance Observation Tool

KW - Teamwork

UR - http://www.scopus.com/inward/record.url?scp=84928603538&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84928603538&partnerID=8YFLogxK

U2 - 10.3109/13561820.2014.982789

DO - 10.3109/13561820.2014.982789

M3 - Article

VL - 29

SP - 202

EP - 208

JO - Journal of Interprofessional Care

JF - Journal of Interprofessional Care

SN - 1356-1820

IS - 3

ER -