Validity and reliability of a novel written examination to assess knowledge and clinical decision making skills of medical students on the surgery clerkship

Anna Reinert, Ana Berlin, Aubrie Swan-Sein, Roman Nowygrod, Abbey L Fingeret

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Background The Surgery Clerkship Clinical Skills Examination (CSE) is a novel written examination developed to assess the surgical knowledge, clinical decision making, communication skills, and professionalism of medical students on the surgery clerkship. This study was undertaken to determine its validity. Methods Data were prospectively collected from July 2011 through February 2013. Multivariate linear and logistic regression analyses were used to assess score trend; convergent validity with National Board of Medical Examiners surgery and medicine subject scores, United States Medical Licensing Examination Step 1 and Step 2 Clinical Knowledge scores, and evaluation of clinical reasoning and fund of knowledge; and the effect of clerkship order. Exam reliability was assessed using a modified Cronbach's α statistic. Results During the study period, 262 students completed the CSE, with a normal distribution of performance. United States Medical Licensing Examination Step 2 Clinical Knowledge score and end-of-clerkship evaluations of fund of knowledge and clinical reasoning predicted CSE score. Performance on the CSE was independent of clerkship order or prior clerkships. The modified Cronbach's α value for the exam was.67. Conclusions The CSE is an objective, valid, reliable instrument for assessing students on the surgery clerkship, independent of clerkship order.

Original languageEnglish (US)
Pages (from-to)236-242
Number of pages7
JournalAmerican journal of surgery
Volume207
Issue number2
DOIs
StatePublished - Feb 1 2014

Fingerprint

Clinical Competence
Medical Students
Reproducibility of Results
Financial Management
Licensure
Students
Coroners and Medical Examiners
Normal Distribution
Linear Models
Logistic Models
Communication
Regression Analysis
Medicine
Clinical Decision-Making

Keywords

  • Assessment
  • Clinical reasoning
  • Clinical skills
  • Medical student
  • Objective examination
  • Surgical education

ASJC Scopus subject areas

  • Surgery

Cite this

Validity and reliability of a novel written examination to assess knowledge and clinical decision making skills of medical students on the surgery clerkship. / Reinert, Anna; Berlin, Ana; Swan-Sein, Aubrie; Nowygrod, Roman; Fingeret, Abbey L.

In: American journal of surgery, Vol. 207, No. 2, 01.02.2014, p. 236-242.

Research output: Contribution to journalArticle

@article{1d021f964e1045a7b49f8b12c95e8953,
title = "Validity and reliability of a novel written examination to assess knowledge and clinical decision making skills of medical students on the surgery clerkship",
abstract = "Background The Surgery Clerkship Clinical Skills Examination (CSE) is a novel written examination developed to assess the surgical knowledge, clinical decision making, communication skills, and professionalism of medical students on the surgery clerkship. This study was undertaken to determine its validity. Methods Data were prospectively collected from July 2011 through February 2013. Multivariate linear and logistic regression analyses were used to assess score trend; convergent validity with National Board of Medical Examiners surgery and medicine subject scores, United States Medical Licensing Examination Step 1 and Step 2 Clinical Knowledge scores, and evaluation of clinical reasoning and fund of knowledge; and the effect of clerkship order. Exam reliability was assessed using a modified Cronbach's α statistic. Results During the study period, 262 students completed the CSE, with a normal distribution of performance. United States Medical Licensing Examination Step 2 Clinical Knowledge score and end-of-clerkship evaluations of fund of knowledge and clinical reasoning predicted CSE score. Performance on the CSE was independent of clerkship order or prior clerkships. The modified Cronbach's α value for the exam was.67. Conclusions The CSE is an objective, valid, reliable instrument for assessing students on the surgery clerkship, independent of clerkship order.",
keywords = "Assessment, Clinical reasoning, Clinical skills, Medical student, Objective examination, Surgical education",
author = "Anna Reinert and Ana Berlin and Aubrie Swan-Sein and Roman Nowygrod and Fingeret, {Abbey L}",
year = "2014",
month = "2",
day = "1",
doi = "10.1016/j.amjsurg.2013.08.024",
language = "English (US)",
volume = "207",
pages = "236--242",
journal = "American Journal of Surgery",
issn = "0002-9610",
publisher = "Elsevier Inc.",
number = "2",

}

TY - JOUR

T1 - Validity and reliability of a novel written examination to assess knowledge and clinical decision making skills of medical students on the surgery clerkship

AU - Reinert, Anna

AU - Berlin, Ana

AU - Swan-Sein, Aubrie

AU - Nowygrod, Roman

AU - Fingeret, Abbey L

PY - 2014/2/1

Y1 - 2014/2/1

N2 - Background The Surgery Clerkship Clinical Skills Examination (CSE) is a novel written examination developed to assess the surgical knowledge, clinical decision making, communication skills, and professionalism of medical students on the surgery clerkship. This study was undertaken to determine its validity. Methods Data were prospectively collected from July 2011 through February 2013. Multivariate linear and logistic regression analyses were used to assess score trend; convergent validity with National Board of Medical Examiners surgery and medicine subject scores, United States Medical Licensing Examination Step 1 and Step 2 Clinical Knowledge scores, and evaluation of clinical reasoning and fund of knowledge; and the effect of clerkship order. Exam reliability was assessed using a modified Cronbach's α statistic. Results During the study period, 262 students completed the CSE, with a normal distribution of performance. United States Medical Licensing Examination Step 2 Clinical Knowledge score and end-of-clerkship evaluations of fund of knowledge and clinical reasoning predicted CSE score. Performance on the CSE was independent of clerkship order or prior clerkships. The modified Cronbach's α value for the exam was.67. Conclusions The CSE is an objective, valid, reliable instrument for assessing students on the surgery clerkship, independent of clerkship order.

AB - Background The Surgery Clerkship Clinical Skills Examination (CSE) is a novel written examination developed to assess the surgical knowledge, clinical decision making, communication skills, and professionalism of medical students on the surgery clerkship. This study was undertaken to determine its validity. Methods Data were prospectively collected from July 2011 through February 2013. Multivariate linear and logistic regression analyses were used to assess score trend; convergent validity with National Board of Medical Examiners surgery and medicine subject scores, United States Medical Licensing Examination Step 1 and Step 2 Clinical Knowledge scores, and evaluation of clinical reasoning and fund of knowledge; and the effect of clerkship order. Exam reliability was assessed using a modified Cronbach's α statistic. Results During the study period, 262 students completed the CSE, with a normal distribution of performance. United States Medical Licensing Examination Step 2 Clinical Knowledge score and end-of-clerkship evaluations of fund of knowledge and clinical reasoning predicted CSE score. Performance on the CSE was independent of clerkship order or prior clerkships. The modified Cronbach's α value for the exam was.67. Conclusions The CSE is an objective, valid, reliable instrument for assessing students on the surgery clerkship, independent of clerkship order.

KW - Assessment

KW - Clinical reasoning

KW - Clinical skills

KW - Medical student

KW - Objective examination

KW - Surgical education

UR - http://www.scopus.com/inward/record.url?scp=84893636437&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84893636437&partnerID=8YFLogxK

U2 - 10.1016/j.amjsurg.2013.08.024

DO - 10.1016/j.amjsurg.2013.08.024

M3 - Article

VL - 207

SP - 236

EP - 242

JO - American Journal of Surgery

JF - American Journal of Surgery

SN - 0002-9610

IS - 2

ER -