Randomization tests as alternative analysis methods for behavior-analytic data

Andrew R. Craig, Wayne W. Fisher

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Randomization statistics offer alternatives to many of the statistical methods commonly used in behavior analysis and the psychological sciences, more generally. These methods are more flexible than conventional parametric and nonparametric statistical techniques in that they make no assumptions about the underlying distribution of outcome variables, are relatively robust when applied to small-n data sets, and are generally applicable to between-groups, within-subjects, mixed, and single-case research designs. In the present article, we first will provide a historical overview of randomization methods. Next, we will discuss the properties of randomization statistics that may make them particularly well suited for analysis of behavior-analytic data. We will introduce readers to the major assumptions that undergird randomization methods, as well as some practical and computational considerations for their application. Finally, we will demonstrate how randomization statistics may be calculated for mixed and single-case research designs. Throughout, we will direct readers toward resources that they may find useful in developing randomization tests for their own data.

Original languageEnglish (US)
Pages (from-to)309-328
Number of pages20
JournalJournal of the experimental analysis of behavior
Volume111
Issue number2
DOIs
StatePublished - Mar 2019

Fingerprint

Random Allocation
Research Design
Psychology

Keywords

  • autocorrelation
  • between-groups research
  • data analysis
  • nonparametric statistics
  • randomization
  • single-case research
  • within-subjects research

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Behavioral Neuroscience

Cite this

Randomization tests as alternative analysis methods for behavior-analytic data. / Craig, Andrew R.; Fisher, Wayne W.

In: Journal of the experimental analysis of behavior, Vol. 111, No. 2, 03.2019, p. 309-328.

Research output: Contribution to journalArticle

@article{910d5539007046dea36777a6236a2b72,
title = "Randomization tests as alternative analysis methods for behavior-analytic data",
abstract = "Randomization statistics offer alternatives to many of the statistical methods commonly used in behavior analysis and the psychological sciences, more generally. These methods are more flexible than conventional parametric and nonparametric statistical techniques in that they make no assumptions about the underlying distribution of outcome variables, are relatively robust when applied to small-n data sets, and are generally applicable to between-groups, within-subjects, mixed, and single-case research designs. In the present article, we first will provide a historical overview of randomization methods. Next, we will discuss the properties of randomization statistics that may make them particularly well suited for analysis of behavior-analytic data. We will introduce readers to the major assumptions that undergird randomization methods, as well as some practical and computational considerations for their application. Finally, we will demonstrate how randomization statistics may be calculated for mixed and single-case research designs. Throughout, we will direct readers toward resources that they may find useful in developing randomization tests for their own data.",
keywords = "autocorrelation, between-groups research, data analysis, nonparametric statistics, randomization, single-case research, within-subjects research",
author = "Craig, {Andrew R.} and Fisher, {Wayne W.}",
year = "2019",
month = "3",
doi = "10.1002/jeab.500",
language = "English (US)",
volume = "111",
pages = "309--328",
journal = "Journal of the Experimental Analysis of Behavior",
issn = "0022-5002",
publisher = "Society for the Experimental Analysis of Behavior Inc.",
number = "2",

}

TY - JOUR

T1 - Randomization tests as alternative analysis methods for behavior-analytic data

AU - Craig, Andrew R.

AU - Fisher, Wayne W.

PY - 2019/3

Y1 - 2019/3

N2 - Randomization statistics offer alternatives to many of the statistical methods commonly used in behavior analysis and the psychological sciences, more generally. These methods are more flexible than conventional parametric and nonparametric statistical techniques in that they make no assumptions about the underlying distribution of outcome variables, are relatively robust when applied to small-n data sets, and are generally applicable to between-groups, within-subjects, mixed, and single-case research designs. In the present article, we first will provide a historical overview of randomization methods. Next, we will discuss the properties of randomization statistics that may make them particularly well suited for analysis of behavior-analytic data. We will introduce readers to the major assumptions that undergird randomization methods, as well as some practical and computational considerations for their application. Finally, we will demonstrate how randomization statistics may be calculated for mixed and single-case research designs. Throughout, we will direct readers toward resources that they may find useful in developing randomization tests for their own data.

AB - Randomization statistics offer alternatives to many of the statistical methods commonly used in behavior analysis and the psychological sciences, more generally. These methods are more flexible than conventional parametric and nonparametric statistical techniques in that they make no assumptions about the underlying distribution of outcome variables, are relatively robust when applied to small-n data sets, and are generally applicable to between-groups, within-subjects, mixed, and single-case research designs. In the present article, we first will provide a historical overview of randomization methods. Next, we will discuss the properties of randomization statistics that may make them particularly well suited for analysis of behavior-analytic data. We will introduce readers to the major assumptions that undergird randomization methods, as well as some practical and computational considerations for their application. Finally, we will demonstrate how randomization statistics may be calculated for mixed and single-case research designs. Throughout, we will direct readers toward resources that they may find useful in developing randomization tests for their own data.

KW - autocorrelation

KW - between-groups research

KW - data analysis

KW - nonparametric statistics

KW - randomization

KW - single-case research

KW - within-subjects research

UR - http://www.scopus.com/inward/record.url?scp=85060925488&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060925488&partnerID=8YFLogxK

U2 - 10.1002/jeab.500

DO - 10.1002/jeab.500

M3 - Article

C2 - 30706944

AN - SCOPUS:85060925488

VL - 111

SP - 309

EP - 328

JO - Journal of the Experimental Analysis of Behavior

JF - Journal of the Experimental Analysis of Behavior

SN - 0022-5002

IS - 2

ER -