Calibration of observational measurement of rate of responding

Oliver C. Mudford, Jason R. Zeleny, Wayne W Fisher, Molly E. Klum, Todd M. Owen

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

The quality of measurement systems used in almost all natural sciences other than behavior analysis is usually evaluated through calibration study rather than relying on interobserver agreement. We demonstrated some of the basic features of calibration using observer-measured rates of free-operant responding from 10 scripted 10-min calibration samples on video. Five novice and 5 experienced observers recorded (on laptop computers) response samples with a priori determined response rates ranging from 0 to 8 responses per minute. Observer records were then compared with these predetermined reference values using linear regression and related graphical depiction. Results indicated that all of the observers recorded rates that were accurate to within ±0.4 responses per minute and 5 were accurate to within ±0.1 responses per minute, indicating that continuous recording of responding on computers can be highly accurate and precise. Additional research is recommended to investigate conditions that affect the quality of direct observational measurement of behavior.

Original languageEnglish (US)
Pages (from-to)571-586
Number of pages16
JournalJournal of applied behavior analysis
Volume44
Issue number3
DOIs
StatePublished - Sep 1 2011

Fingerprint

Calibration
behavior analysis
natural sciences
Natural Science Disciplines
recording
video
regression
Linear Models
Reference Values
Research
Observer

Keywords

  • calibration
  • continuous recording
  • observer accuracy
  • observer precision
  • recording and measurement

ASJC Scopus subject areas

  • Applied Psychology
  • Philosophy
  • Sociology and Political Science

Cite this

Calibration of observational measurement of rate of responding. / Mudford, Oliver C.; Zeleny, Jason R.; Fisher, Wayne W; Klum, Molly E.; Owen, Todd M.

In: Journal of applied behavior analysis, Vol. 44, No. 3, 01.09.2011, p. 571-586.

Research output: Contribution to journalArticle

Mudford, Oliver C. ; Zeleny, Jason R. ; Fisher, Wayne W ; Klum, Molly E. ; Owen, Todd M. / Calibration of observational measurement of rate of responding. In: Journal of applied behavior analysis. 2011 ; Vol. 44, No. 3. pp. 571-586.
@article{5c96a01b82294e5ea56a9fb20f9012ab,
title = "Calibration of observational measurement of rate of responding",
abstract = "The quality of measurement systems used in almost all natural sciences other than behavior analysis is usually evaluated through calibration study rather than relying on interobserver agreement. We demonstrated some of the basic features of calibration using observer-measured rates of free-operant responding from 10 scripted 10-min calibration samples on video. Five novice and 5 experienced observers recorded (on laptop computers) response samples with a priori determined response rates ranging from 0 to 8 responses per minute. Observer records were then compared with these predetermined reference values using linear regression and related graphical depiction. Results indicated that all of the observers recorded rates that were accurate to within ±0.4 responses per minute and 5 were accurate to within ±0.1 responses per minute, indicating that continuous recording of responding on computers can be highly accurate and precise. Additional research is recommended to investigate conditions that affect the quality of direct observational measurement of behavior.",
keywords = "calibration, continuous recording, observer accuracy, observer precision, recording and measurement",
author = "Mudford, {Oliver C.} and Zeleny, {Jason R.} and Fisher, {Wayne W} and Klum, {Molly E.} and Owen, {Todd M.}",
year = "2011",
month = "9",
day = "1",
doi = "10.1901/jaba.2011.44-571",
language = "English (US)",
volume = "44",
pages = "571--586",
journal = "Journal of Applied Behavior Analysis",
issn = "0021-8855",
publisher = "Society for the Experimental Analysis of Behavior Inc.",
number = "3",

}

TY - JOUR

T1 - Calibration of observational measurement of rate of responding

AU - Mudford, Oliver C.

AU - Zeleny, Jason R.

AU - Fisher, Wayne W

AU - Klum, Molly E.

AU - Owen, Todd M.

PY - 2011/9/1

Y1 - 2011/9/1

N2 - The quality of measurement systems used in almost all natural sciences other than behavior analysis is usually evaluated through calibration study rather than relying on interobserver agreement. We demonstrated some of the basic features of calibration using observer-measured rates of free-operant responding from 10 scripted 10-min calibration samples on video. Five novice and 5 experienced observers recorded (on laptop computers) response samples with a priori determined response rates ranging from 0 to 8 responses per minute. Observer records were then compared with these predetermined reference values using linear regression and related graphical depiction. Results indicated that all of the observers recorded rates that were accurate to within ±0.4 responses per minute and 5 were accurate to within ±0.1 responses per minute, indicating that continuous recording of responding on computers can be highly accurate and precise. Additional research is recommended to investigate conditions that affect the quality of direct observational measurement of behavior.

AB - The quality of measurement systems used in almost all natural sciences other than behavior analysis is usually evaluated through calibration study rather than relying on interobserver agreement. We demonstrated some of the basic features of calibration using observer-measured rates of free-operant responding from 10 scripted 10-min calibration samples on video. Five novice and 5 experienced observers recorded (on laptop computers) response samples with a priori determined response rates ranging from 0 to 8 responses per minute. Observer records were then compared with these predetermined reference values using linear regression and related graphical depiction. Results indicated that all of the observers recorded rates that were accurate to within ±0.4 responses per minute and 5 were accurate to within ±0.1 responses per minute, indicating that continuous recording of responding on computers can be highly accurate and precise. Additional research is recommended to investigate conditions that affect the quality of direct observational measurement of behavior.

KW - calibration

KW - continuous recording

KW - observer accuracy

KW - observer precision

KW - recording and measurement

UR - http://www.scopus.com/inward/record.url?scp=84856136198&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84856136198&partnerID=8YFLogxK

U2 - 10.1901/jaba.2011.44-571

DO - 10.1901/jaba.2011.44-571

M3 - Article

C2 - 21941386

AN - SCOPUS:84856136198

VL - 44

SP - 571

EP - 586

JO - Journal of Applied Behavior Analysis

JF - Journal of Applied Behavior Analysis

SN - 0021-8855

IS - 3

ER -