A pilot study of the relationship between experts’ ratings and scores generated by the NBME’s computer-based examination system

David J. Solomon, Janet R. Osuch, Kimberly Anderson, James Babel, James Gruenberg, John Kisala, Mary Milroy, Willard Stawski

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

This pilot study evaluates the consistency of experts’ ratings of students’ performances on the National Board of Medical Examiners’ Computer Based Examination (CBX) cases and the relationship of those ratings to the CBX’s scoring algorithm. The authors were investigating whether an automated scoring algorithm can adequately assess an examinee’s management of a computer-simulated patient. In 1989-90, at the Michigan State University College of Human Medicine, eight students, completing a surgery clerkship, each managed eight CBX cases and took a computer-administered, multiple-choice examination. Six clerkship coordinators rated the students’ performances in terms of overall management, efficiency, and dangerous actions. The ratings correlated highly with scores produced by the CBX’s scoring system.

Original languageEnglish (US)
Pages (from-to)130-132
Number of pages3
JournalAcademic Medicine
Volume67
Issue number2
StatePublished - Feb 1992

Fingerprint

examination system
rating
expert
examination
medical examiner
student
management
surgery
performance
medicine
efficiency

ASJC Scopus subject areas

  • Education

Cite this

Solomon, D. J., Osuch, J. R., Anderson, K., Babel, J., Gruenberg, J., Kisala, J., ... Stawski, W. (1992). A pilot study of the relationship between experts’ ratings and scores generated by the NBME’s computer-based examination system. Academic Medicine, 67(2), 130-132.

A pilot study of the relationship between experts’ ratings and scores generated by the NBME’s computer-based examination system. / Solomon, David J.; Osuch, Janet R.; Anderson, Kimberly; Babel, James; Gruenberg, James; Kisala, John; Milroy, Mary; Stawski, Willard.

In: Academic Medicine, Vol. 67, No. 2, 02.1992, p. 130-132.

Research output: Contribution to journalArticle

Solomon, DJ, Osuch, JR, Anderson, K, Babel, J, Gruenberg, J, Kisala, J, Milroy, M & Stawski, W 1992, 'A pilot study of the relationship between experts’ ratings and scores generated by the NBME’s computer-based examination system', Academic Medicine, vol. 67, no. 2, pp. 130-132.
Solomon, David J. ; Osuch, Janet R. ; Anderson, Kimberly ; Babel, James ; Gruenberg, James ; Kisala, John ; Milroy, Mary ; Stawski, Willard. / A pilot study of the relationship between experts’ ratings and scores generated by the NBME’s computer-based examination system. In: Academic Medicine. 1992 ; Vol. 67, No. 2. pp. 130-132.
@article{e621789099ba45719f55096dfed39d0e,
title = "A pilot study of the relationship between experts’ ratings and scores generated by the NBME’s computer-based examination system",
abstract = "This pilot study evaluates the consistency of experts’ ratings of students’ performances on the National Board of Medical Examiners’ Computer Based Examination (CBX) cases and the relationship of those ratings to the CBX’s scoring algorithm. The authors were investigating whether an automated scoring algorithm can adequately assess an examinee’s management of a computer-simulated patient. In 1989-90, at the Michigan State University College of Human Medicine, eight students, completing a surgery clerkship, each managed eight CBX cases and took a computer-administered, multiple-choice examination. Six clerkship coordinators rated the students’ performances in terms of overall management, efficiency, and dangerous actions. The ratings correlated highly with scores produced by the CBX’s scoring system.",
author = "Solomon, {David J.} and Osuch, {Janet R.} and Kimberly Anderson and James Babel and James Gruenberg and John Kisala and Mary Milroy and Willard Stawski",
year = "1992",
month = "2",
language = "English (US)",
volume = "67",
pages = "130--132",
journal = "Academic Medicine",
issn = "1040-2446",
publisher = "Lippincott Williams and Wilkins",
number = "2",

}

TY - JOUR

T1 - A pilot study of the relationship between experts’ ratings and scores generated by the NBME’s computer-based examination system

AU - Solomon, David J.

AU - Osuch, Janet R.

AU - Anderson, Kimberly

AU - Babel, James

AU - Gruenberg, James

AU - Kisala, John

AU - Milroy, Mary

AU - Stawski, Willard

PY - 1992/2

Y1 - 1992/2

N2 - This pilot study evaluates the consistency of experts’ ratings of students’ performances on the National Board of Medical Examiners’ Computer Based Examination (CBX) cases and the relationship of those ratings to the CBX’s scoring algorithm. The authors were investigating whether an automated scoring algorithm can adequately assess an examinee’s management of a computer-simulated patient. In 1989-90, at the Michigan State University College of Human Medicine, eight students, completing a surgery clerkship, each managed eight CBX cases and took a computer-administered, multiple-choice examination. Six clerkship coordinators rated the students’ performances in terms of overall management, efficiency, and dangerous actions. The ratings correlated highly with scores produced by the CBX’s scoring system.

AB - This pilot study evaluates the consistency of experts’ ratings of students’ performances on the National Board of Medical Examiners’ Computer Based Examination (CBX) cases and the relationship of those ratings to the CBX’s scoring algorithm. The authors were investigating whether an automated scoring algorithm can adequately assess an examinee’s management of a computer-simulated patient. In 1989-90, at the Michigan State University College of Human Medicine, eight students, completing a surgery clerkship, each managed eight CBX cases and took a computer-administered, multiple-choice examination. Six clerkship coordinators rated the students’ performances in terms of overall management, efficiency, and dangerous actions. The ratings correlated highly with scores produced by the CBX’s scoring system.

UR - http://www.scopus.com/inward/record.url?scp=0026590199&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0026590199&partnerID=8YFLogxK

M3 - Article

C2 - 1546992

AN - SCOPUS:0026590199

VL - 67

SP - 130

EP - 132

JO - Academic Medicine

JF - Academic Medicine

SN - 1040-2446

IS - 2

ER -