Predictive validity and efficiency of ongoing visual-inspection criteria for interpreting functional analyses

Valdeep Saini, Wayne W Fisher, Billie J. Retzlaff

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Prior research has evaluated the reliability and validity of structured criteria for visually inspecting functional-analysis (FA) results on a post-hoc basis, after completion of the FA (i.e., post-hoc visual inspection [PHVI]; e.g., Hagopian et al., 1997). However, most behavior analysts inspect FAs using ongoing visual inspection (OVI) as the FA is implemented, and the validity of applying structured criteria during OVI remains unknown. In this investigation, we evaluated the predictive validity and efficiency of applying structured criteria on an ongoing basis by comparing the interim interpretations produced through OVI with (a) the final interpretations produced by PHVI, (b) the authors' post-hoc interpretations (PHAI) reported in the research studies, and (c) the consensus interpretations of these two post-hoc analyses. Ongoing visual inspection predicted the results of PHVI and the consensus interpretations with a very high degree of accuracy, and PHAI with a reasonably high degree of accuracy. Furthermore, the PHVI and PHAI results involved 32 FA sessions, on average, whereas the OVI required only 19 FA sessions to accurately identify the function(s) of destructive behavior (i.e., a 41% increase in efficiency). We discuss these findings relative to other methods designed to increase the accuracy and efficiency of FAs.

Original languageEnglish (US)
JournalJournal of Applied Behavior Analysis
DOIs
StateAccepted/In press - Jan 1 2018

Fingerprint

functional analysis
efficiency
interpretation
Research
Reproducibility of Results
Functional Analysis

Keywords

  • Data analysis
  • Functional analysis
  • Problem behavior
  • Structured visual inspection
  • Visual inspection

ASJC Scopus subject areas

  • Applied Psychology
  • Sociology and Political Science
  • Philosophy

Cite this

@article{63030432b0454f39964559dc9bc85571,
title = "Predictive validity and efficiency of ongoing visual-inspection criteria for interpreting functional analyses",
abstract = "Prior research has evaluated the reliability and validity of structured criteria for visually inspecting functional-analysis (FA) results on a post-hoc basis, after completion of the FA (i.e., post-hoc visual inspection [PHVI]; e.g., Hagopian et al., 1997). However, most behavior analysts inspect FAs using ongoing visual inspection (OVI) as the FA is implemented, and the validity of applying structured criteria during OVI remains unknown. In this investigation, we evaluated the predictive validity and efficiency of applying structured criteria on an ongoing basis by comparing the interim interpretations produced through OVI with (a) the final interpretations produced by PHVI, (b) the authors' post-hoc interpretations (PHAI) reported in the research studies, and (c) the consensus interpretations of these two post-hoc analyses. Ongoing visual inspection predicted the results of PHVI and the consensus interpretations with a very high degree of accuracy, and PHAI with a reasonably high degree of accuracy. Furthermore, the PHVI and PHAI results involved 32 FA sessions, on average, whereas the OVI required only 19 FA sessions to accurately identify the function(s) of destructive behavior (i.e., a 41{\%} increase in efficiency). We discuss these findings relative to other methods designed to increase the accuracy and efficiency of FAs.",
keywords = "Data analysis, Functional analysis, Problem behavior, Structured visual inspection, Visual inspection",
author = "Valdeep Saini and Fisher, {Wayne W} and Retzlaff, {Billie J.}",
year = "2018",
month = "1",
day = "1",
doi = "10.1002/jaba.450",
language = "English (US)",
journal = "Journal of Applied Behavior Analysis",
issn = "0021-8855",
publisher = "Society for the Experimental Analysis of Behavior Inc.",

}

TY - JOUR

T1 - Predictive validity and efficiency of ongoing visual-inspection criteria for interpreting functional analyses

AU - Saini, Valdeep

AU - Fisher, Wayne W

AU - Retzlaff, Billie J.

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Prior research has evaluated the reliability and validity of structured criteria for visually inspecting functional-analysis (FA) results on a post-hoc basis, after completion of the FA (i.e., post-hoc visual inspection [PHVI]; e.g., Hagopian et al., 1997). However, most behavior analysts inspect FAs using ongoing visual inspection (OVI) as the FA is implemented, and the validity of applying structured criteria during OVI remains unknown. In this investigation, we evaluated the predictive validity and efficiency of applying structured criteria on an ongoing basis by comparing the interim interpretations produced through OVI with (a) the final interpretations produced by PHVI, (b) the authors' post-hoc interpretations (PHAI) reported in the research studies, and (c) the consensus interpretations of these two post-hoc analyses. Ongoing visual inspection predicted the results of PHVI and the consensus interpretations with a very high degree of accuracy, and PHAI with a reasonably high degree of accuracy. Furthermore, the PHVI and PHAI results involved 32 FA sessions, on average, whereas the OVI required only 19 FA sessions to accurately identify the function(s) of destructive behavior (i.e., a 41% increase in efficiency). We discuss these findings relative to other methods designed to increase the accuracy and efficiency of FAs.

AB - Prior research has evaluated the reliability and validity of structured criteria for visually inspecting functional-analysis (FA) results on a post-hoc basis, after completion of the FA (i.e., post-hoc visual inspection [PHVI]; e.g., Hagopian et al., 1997). However, most behavior analysts inspect FAs using ongoing visual inspection (OVI) as the FA is implemented, and the validity of applying structured criteria during OVI remains unknown. In this investigation, we evaluated the predictive validity and efficiency of applying structured criteria on an ongoing basis by comparing the interim interpretations produced through OVI with (a) the final interpretations produced by PHVI, (b) the authors' post-hoc interpretations (PHAI) reported in the research studies, and (c) the consensus interpretations of these two post-hoc analyses. Ongoing visual inspection predicted the results of PHVI and the consensus interpretations with a very high degree of accuracy, and PHAI with a reasonably high degree of accuracy. Furthermore, the PHVI and PHAI results involved 32 FA sessions, on average, whereas the OVI required only 19 FA sessions to accurately identify the function(s) of destructive behavior (i.e., a 41% increase in efficiency). We discuss these findings relative to other methods designed to increase the accuracy and efficiency of FAs.

KW - Data analysis

KW - Functional analysis

KW - Problem behavior

KW - Structured visual inspection

KW - Visual inspection

UR - http://www.scopus.com/inward/record.url?scp=85043448825&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85043448825&partnerID=8YFLogxK

U2 - 10.1002/jaba.450

DO - 10.1002/jaba.450

M3 - Article

JO - Journal of Applied Behavior Analysis

JF - Journal of Applied Behavior Analysis

SN - 0021-8855

ER -