Interobserver and intraobserver reliability of two classification systems for intra-articular calcaneal fractures

Anthony J. Lauder, David J. Inda, Aaron M. Bott, Michael P. Clare, Timothy C. Fitzgibbons, Matthew A Mormino

Research output: Contribution to journalArticle

33 Citations (Scopus)

Abstract

Background: For a fracture classification to be useful it must provide prognostic significance, interobserver reliability, and intraobserver reproducibility. Most studies have found reliability and reproducibility to be poor for fracture classification schemes. The purpose of this study was to evaluate the interobserver and intraobserver reliability of the Sanders and Crosby-Fitzgibbons classification systems, two commonly used methods for classifying intra-articular calcaneal fractures. Methods: Twenty-five CT scans of intra-articular calcaneal fractures occurring at one trauma center were reviewed. The CT images were presented to eight observers (two orthopaedic surgery chief residents, two foot and ankle fellows, two fellowship-trained orthopaedic trauma surgeons, and two fellowship-trained foot and ankle surgeons) on two separate occasions 8 weeks apart. On each viewing, observers were asked to classify the fractures according to both the Sanders and Crosby-Fitzgibbons systems. Interobserver reliability and intraobserver reproducibility were assessed with computer-generated kappa statistics (SAS software; SAS Institute Inc., Cary, North Carolina). Results: Total unanimity (eight of eight observers assigned the same fracture classification) was achieved only 24% (six of 25) of the time with the Sanders system and 36% (nine of 25) of the time with the Crosby-Fitzgibbons scheme. Interobserver reliability for the Sanders classification method reached a moderate (kappa = 0.48, 0.50) level of agreement, when the subclasses were included. The agreement level increased but remained in the moderate (kappa = 0.55, 0.55) range when the subclasses were excluded. Interobserver agreement reached a substantial (kappa = 0.63, 0.63) level with the Crosby-Fitzgibbons system. Intraobserver reproducibility was better for both schemes. The Sanders system with subclasses included reached moderate (kappa = 0.57) agreement, while ignoring the subclasses brought agreement into the substantial (kappa = 0.77) range. The overall intraobserver agreement was substantial (kappa = 0.74) for the Crosby-Fitzgibbons system. Conclusions: Although intraobserver kappa values reached substantial levels and the Crosby-Fitzgibbons system generally showed greater agreement, we were unable to demonstrate excellent interobserver or intraobserver reliability with either classification scheme. While a system with perfect agreement would be impossible, our results indicate that these classifications lack the reproducibility to be considered ideal.

Original languageEnglish (US)
Pages (from-to)251-255
Number of pages5
JournalFoot and Ankle International
Volume27
Issue number4
DOIs
StatePublished - Jan 1 2006

Fingerprint

Intra-Articular Fractures
Ankle
Trauma Centers
Orthopedics
Foot
Software
Wounds and Injuries

Keywords

  • Calcaneus
  • Interobserver
  • Intraobserver
  • Kappa Values

ASJC Scopus subject areas

  • Surgery
  • Orthopedics and Sports Medicine

Cite this

Interobserver and intraobserver reliability of two classification systems for intra-articular calcaneal fractures. / Lauder, Anthony J.; Inda, David J.; Bott, Aaron M.; Clare, Michael P.; Fitzgibbons, Timothy C.; Mormino, Matthew A.

In: Foot and Ankle International, Vol. 27, No. 4, 01.01.2006, p. 251-255.

Research output: Contribution to journalArticle

Lauder, Anthony J. ; Inda, David J. ; Bott, Aaron M. ; Clare, Michael P. ; Fitzgibbons, Timothy C. ; Mormino, Matthew A. / Interobserver and intraobserver reliability of two classification systems for intra-articular calcaneal fractures. In: Foot and Ankle International. 2006 ; Vol. 27, No. 4. pp. 251-255.
@article{0136a3acc1d84ecca9782dc8aa2412ba,
title = "Interobserver and intraobserver reliability of two classification systems for intra-articular calcaneal fractures",
abstract = "Background: For a fracture classification to be useful it must provide prognostic significance, interobserver reliability, and intraobserver reproducibility. Most studies have found reliability and reproducibility to be poor for fracture classification schemes. The purpose of this study was to evaluate the interobserver and intraobserver reliability of the Sanders and Crosby-Fitzgibbons classification systems, two commonly used methods for classifying intra-articular calcaneal fractures. Methods: Twenty-five CT scans of intra-articular calcaneal fractures occurring at one trauma center were reviewed. The CT images were presented to eight observers (two orthopaedic surgery chief residents, two foot and ankle fellows, two fellowship-trained orthopaedic trauma surgeons, and two fellowship-trained foot and ankle surgeons) on two separate occasions 8 weeks apart. On each viewing, observers were asked to classify the fractures according to both the Sanders and Crosby-Fitzgibbons systems. Interobserver reliability and intraobserver reproducibility were assessed with computer-generated kappa statistics (SAS software; SAS Institute Inc., Cary, North Carolina). Results: Total unanimity (eight of eight observers assigned the same fracture classification) was achieved only 24{\%} (six of 25) of the time with the Sanders system and 36{\%} (nine of 25) of the time with the Crosby-Fitzgibbons scheme. Interobserver reliability for the Sanders classification method reached a moderate (kappa = 0.48, 0.50) level of agreement, when the subclasses were included. The agreement level increased but remained in the moderate (kappa = 0.55, 0.55) range when the subclasses were excluded. Interobserver agreement reached a substantial (kappa = 0.63, 0.63) level with the Crosby-Fitzgibbons system. Intraobserver reproducibility was better for both schemes. The Sanders system with subclasses included reached moderate (kappa = 0.57) agreement, while ignoring the subclasses brought agreement into the substantial (kappa = 0.77) range. The overall intraobserver agreement was substantial (kappa = 0.74) for the Crosby-Fitzgibbons system. Conclusions: Although intraobserver kappa values reached substantial levels and the Crosby-Fitzgibbons system generally showed greater agreement, we were unable to demonstrate excellent interobserver or intraobserver reliability with either classification scheme. While a system with perfect agreement would be impossible, our results indicate that these classifications lack the reproducibility to be considered ideal.",
keywords = "Calcaneus, Interobserver, Intraobserver, Kappa Values",
author = "Lauder, {Anthony J.} and Inda, {David J.} and Bott, {Aaron M.} and Clare, {Michael P.} and Fitzgibbons, {Timothy C.} and Mormino, {Matthew A}",
year = "2006",
month = "1",
day = "1",
doi = "10.1177/107110070602700405",
language = "English (US)",
volume = "27",
pages = "251--255",
journal = "Foot and Ankle International",
issn = "1071-1007",
publisher = "AOFAS - American Orthopaedic Foot and Ankle Society",
number = "4",

}

TY - JOUR

T1 - Interobserver and intraobserver reliability of two classification systems for intra-articular calcaneal fractures

AU - Lauder, Anthony J.

AU - Inda, David J.

AU - Bott, Aaron M.

AU - Clare, Michael P.

AU - Fitzgibbons, Timothy C.

AU - Mormino, Matthew A

PY - 2006/1/1

Y1 - 2006/1/1

N2 - Background: For a fracture classification to be useful it must provide prognostic significance, interobserver reliability, and intraobserver reproducibility. Most studies have found reliability and reproducibility to be poor for fracture classification schemes. The purpose of this study was to evaluate the interobserver and intraobserver reliability of the Sanders and Crosby-Fitzgibbons classification systems, two commonly used methods for classifying intra-articular calcaneal fractures. Methods: Twenty-five CT scans of intra-articular calcaneal fractures occurring at one trauma center were reviewed. The CT images were presented to eight observers (two orthopaedic surgery chief residents, two foot and ankle fellows, two fellowship-trained orthopaedic trauma surgeons, and two fellowship-trained foot and ankle surgeons) on two separate occasions 8 weeks apart. On each viewing, observers were asked to classify the fractures according to both the Sanders and Crosby-Fitzgibbons systems. Interobserver reliability and intraobserver reproducibility were assessed with computer-generated kappa statistics (SAS software; SAS Institute Inc., Cary, North Carolina). Results: Total unanimity (eight of eight observers assigned the same fracture classification) was achieved only 24% (six of 25) of the time with the Sanders system and 36% (nine of 25) of the time with the Crosby-Fitzgibbons scheme. Interobserver reliability for the Sanders classification method reached a moderate (kappa = 0.48, 0.50) level of agreement, when the subclasses were included. The agreement level increased but remained in the moderate (kappa = 0.55, 0.55) range when the subclasses were excluded. Interobserver agreement reached a substantial (kappa = 0.63, 0.63) level with the Crosby-Fitzgibbons system. Intraobserver reproducibility was better for both schemes. The Sanders system with subclasses included reached moderate (kappa = 0.57) agreement, while ignoring the subclasses brought agreement into the substantial (kappa = 0.77) range. The overall intraobserver agreement was substantial (kappa = 0.74) for the Crosby-Fitzgibbons system. Conclusions: Although intraobserver kappa values reached substantial levels and the Crosby-Fitzgibbons system generally showed greater agreement, we were unable to demonstrate excellent interobserver or intraobserver reliability with either classification scheme. While a system with perfect agreement would be impossible, our results indicate that these classifications lack the reproducibility to be considered ideal.

AB - Background: For a fracture classification to be useful it must provide prognostic significance, interobserver reliability, and intraobserver reproducibility. Most studies have found reliability and reproducibility to be poor for fracture classification schemes. The purpose of this study was to evaluate the interobserver and intraobserver reliability of the Sanders and Crosby-Fitzgibbons classification systems, two commonly used methods for classifying intra-articular calcaneal fractures. Methods: Twenty-five CT scans of intra-articular calcaneal fractures occurring at one trauma center were reviewed. The CT images were presented to eight observers (two orthopaedic surgery chief residents, two foot and ankle fellows, two fellowship-trained orthopaedic trauma surgeons, and two fellowship-trained foot and ankle surgeons) on two separate occasions 8 weeks apart. On each viewing, observers were asked to classify the fractures according to both the Sanders and Crosby-Fitzgibbons systems. Interobserver reliability and intraobserver reproducibility were assessed with computer-generated kappa statistics (SAS software; SAS Institute Inc., Cary, North Carolina). Results: Total unanimity (eight of eight observers assigned the same fracture classification) was achieved only 24% (six of 25) of the time with the Sanders system and 36% (nine of 25) of the time with the Crosby-Fitzgibbons scheme. Interobserver reliability for the Sanders classification method reached a moderate (kappa = 0.48, 0.50) level of agreement, when the subclasses were included. The agreement level increased but remained in the moderate (kappa = 0.55, 0.55) range when the subclasses were excluded. Interobserver agreement reached a substantial (kappa = 0.63, 0.63) level with the Crosby-Fitzgibbons system. Intraobserver reproducibility was better for both schemes. The Sanders system with subclasses included reached moderate (kappa = 0.57) agreement, while ignoring the subclasses brought agreement into the substantial (kappa = 0.77) range. The overall intraobserver agreement was substantial (kappa = 0.74) for the Crosby-Fitzgibbons system. Conclusions: Although intraobserver kappa values reached substantial levels and the Crosby-Fitzgibbons system generally showed greater agreement, we were unable to demonstrate excellent interobserver or intraobserver reliability with either classification scheme. While a system with perfect agreement would be impossible, our results indicate that these classifications lack the reproducibility to be considered ideal.

KW - Calcaneus

KW - Interobserver

KW - Intraobserver

KW - Kappa Values

UR - http://www.scopus.com/inward/record.url?scp=33645684887&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33645684887&partnerID=8YFLogxK

U2 - 10.1177/107110070602700405

DO - 10.1177/107110070602700405

M3 - Article

VL - 27

SP - 251

EP - 255

JO - Foot and Ankle International

JF - Foot and Ankle International

SN - 1071-1007

IS - 4

ER -