A comparison of reliability measures for continuous and discontinuous recording methods: Inflated agreement scores with partial interval recording and momentary time sampling for duration events

John T. Rapp, Regina A. Carroll, Lindsay Stangeland, Greg Swanson, William J. Higgins

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

The authors evaluated the extent to which interobserver agreement (IOA) scores, using the block-by-block method for events scored with continuous duration recording (CDR), were higher when the data from the same sessions were converted to discontinuous methods. Sessions with IOA scores of 89% or less with CDR were rescored using 10-s partial interval recording (PIR) and 10-s momentary time sampling (MTS). Results indicated that IOA scores for 10-s PIR and 10-s MTS were consistently higher than IOA scores based on CDR for the same sessions. Specifically, 10-s MTS provided higher overestimations for low-duration events, whereas 10-s PIR produced higher overestimations for moderate- and high-duration events. Implications for researchers and clinicians are briefly discussed.

Original languageEnglish (US)
Pages (from-to)389-402
Number of pages14
JournalBehavior Modification
Volume35
Issue number4
DOIs
StatePublished - Jul 1 2011

Fingerprint

Research Personnel
Sampling
Clinicians

Keywords

  • continuous duration recording
  • interobserver agreement
  • momentary time sampling
  • partial interval recording

ASJC Scopus subject areas

  • Developmental and Educational Psychology
  • Clinical Psychology
  • Arts and Humanities (miscellaneous)

Cite this

A comparison of reliability measures for continuous and discontinuous recording methods : Inflated agreement scores with partial interval recording and momentary time sampling for duration events. / Rapp, John T.; Carroll, Regina A.; Stangeland, Lindsay; Swanson, Greg; Higgins, William J.

In: Behavior Modification, Vol. 35, No. 4, 01.07.2011, p. 389-402.

Research output: Contribution to journalArticle

@article{edf516baa0d9465f99d91f5c4e666a62,
title = "A comparison of reliability measures for continuous and discontinuous recording methods: Inflated agreement scores with partial interval recording and momentary time sampling for duration events",
abstract = "The authors evaluated the extent to which interobserver agreement (IOA) scores, using the block-by-block method for events scored with continuous duration recording (CDR), were higher when the data from the same sessions were converted to discontinuous methods. Sessions with IOA scores of 89{\%} or less with CDR were rescored using 10-s partial interval recording (PIR) and 10-s momentary time sampling (MTS). Results indicated that IOA scores for 10-s PIR and 10-s MTS were consistently higher than IOA scores based on CDR for the same sessions. Specifically, 10-s MTS provided higher overestimations for low-duration events, whereas 10-s PIR produced higher overestimations for moderate- and high-duration events. Implications for researchers and clinicians are briefly discussed.",
keywords = "continuous duration recording, interobserver agreement, momentary time sampling, partial interval recording",
author = "Rapp, {John T.} and Carroll, {Regina A.} and Lindsay Stangeland and Greg Swanson and Higgins, {William J.}",
year = "2011",
month = "7",
day = "1",
doi = "10.1177/0145445511405512",
language = "English (US)",
volume = "35",
pages = "389--402",
journal = "Behavior Modification",
issn = "0145-4455",
publisher = "SAGE Publications Inc.",
number = "4",

}

TY - JOUR

T1 - A comparison of reliability measures for continuous and discontinuous recording methods

T2 - Inflated agreement scores with partial interval recording and momentary time sampling for duration events

AU - Rapp, John T.

AU - Carroll, Regina A.

AU - Stangeland, Lindsay

AU - Swanson, Greg

AU - Higgins, William J.

PY - 2011/7/1

Y1 - 2011/7/1

N2 - The authors evaluated the extent to which interobserver agreement (IOA) scores, using the block-by-block method for events scored with continuous duration recording (CDR), were higher when the data from the same sessions were converted to discontinuous methods. Sessions with IOA scores of 89% or less with CDR were rescored using 10-s partial interval recording (PIR) and 10-s momentary time sampling (MTS). Results indicated that IOA scores for 10-s PIR and 10-s MTS were consistently higher than IOA scores based on CDR for the same sessions. Specifically, 10-s MTS provided higher overestimations for low-duration events, whereas 10-s PIR produced higher overestimations for moderate- and high-duration events. Implications for researchers and clinicians are briefly discussed.

AB - The authors evaluated the extent to which interobserver agreement (IOA) scores, using the block-by-block method for events scored with continuous duration recording (CDR), were higher when the data from the same sessions were converted to discontinuous methods. Sessions with IOA scores of 89% or less with CDR were rescored using 10-s partial interval recording (PIR) and 10-s momentary time sampling (MTS). Results indicated that IOA scores for 10-s PIR and 10-s MTS were consistently higher than IOA scores based on CDR for the same sessions. Specifically, 10-s MTS provided higher overestimations for low-duration events, whereas 10-s PIR produced higher overestimations for moderate- and high-duration events. Implications for researchers and clinicians are briefly discussed.

KW - continuous duration recording

KW - interobserver agreement

KW - momentary time sampling

KW - partial interval recording

UR - http://www.scopus.com/inward/record.url?scp=79957849083&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79957849083&partnerID=8YFLogxK

U2 - 10.1177/0145445511405512

DO - 10.1177/0145445511405512

M3 - Article

C2 - 21613241

AN - SCOPUS:79957849083

VL - 35

SP - 389

EP - 402

JO - Behavior Modification

JF - Behavior Modification

SN - 0145-4455

IS - 4

ER -