Program Factors That Influence American Board of Surgery In-Training Examination Performance: A Multi-Institutional Study

Jerry J. Kim, Edward D. Gifford, Ashkan Moazzez, Richard A. Sidwell, Mark E. Reeves, Thomas H. Hartranft, Kenji Inaba, Benjamin T. Jarman, Chandrakanth Are, Joseph M. Galante, Farin Amersi, Brian R. Smith, Marc L. Melcher, M. Timothy Nelson, Timothy Donahue, Garth Jacobsen, Tracey D. Arnell, Steven Lee, Angela Neville, Christian de Virgilio

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

Objective To determine the influence of program strategies, such as program directors' (PD) attitudes about the American Board of Surgery In-Training Examination (ABSITE) and approach to ABSITE preparation, on residents' ABSITE performance. Design A 17-item questionnaire was sent to PDs at surgical residency programs. The questions were designed to elicit information regarding the educational curriculum, remediation protocols, and opinions relating to the ABSITE. Main outcome measure was categorical resident ABSITE percentile scores from the January 2014 examination. Statistical analysis was performed using the Student t-test, analysis of variance, and linear regression as appropriate. Setting The study was carried out at general surgery residency programs across the country. Participants In total, 15 general surgery residency PDs participated in the study. Results The PD response rate was 100%. All 460 resident ABSITE scores from the 15 programs were obtained. In total, 10 programs (67%) identified as university affiliated, 4 programs (27%) as independent academic, and 1 program (7%) as hybrid. The mean number of residents per program was 30.7 (range: 15-57). In total, 14 PDs (93%) indicated that an ABSITE review curriculum was in place and 13 PDs (87%) indicated they had a remediation protocol for residents with low ABSITE scores (with differing thresholds of <30th, <35th, and <40th percentile). The median overall ABSITE score for all residents was 61st percentile (interquartile range = 39.5). The mean ABSITE score for each program ranged from 39th to 75th percentile. Program factors associated with higher ABSITE scores included tracking resident reading throughout the year (median 63rd percentile with tracking vs 59th percentile without, p = 0.040) and the type of remediation (by PD: 77th percentile, by PD and faculty: 57th percentile, faculty only: 64th percentile, with Surgical Education and Self-Assessment Program (SESAP): 63rd percentile, outside review course: 43rd percentile; p < 0.001). Programs with a remediation protocol trended toward higher ABSITE scores compared with programs without remediation protocols (median 61st percentile vs 53rd percentile, p = 0.098). Factors not significantly associated with ABSITE performance included number of structured educational hours per week and frequency of ABSITE review sessions. Conclusions Program factors appear to significantly influence ABSITE performance. Programs where the PD was actively involved in remediation mentorship and the tracking of resident reading achieved higher ABSITE percentile scores on the January 2014 examination. Counterintuitively, residents from programs with a lower ABSITE threshold for remediation performed better on the examination.

Original languageEnglish (US)
Pages (from-to)e236-e242
JournalJournal of Surgical Education
Volume72
Issue number6
DOIs
StatePublished - Jan 1 2015

Fingerprint

surgery
examination
performance
resident
director
Internship and Residency
Curriculum
Reading
A 17
Mentors
curriculum
self-assessment
analysis of variance

Keywords

  • Key Words ABSITE
  • program director
  • surgery residency
  • surgical education

ASJC Scopus subject areas

  • Surgery
  • Education

Cite this

Kim, J. J., Gifford, E. D., Moazzez, A., Sidwell, R. A., Reeves, M. E., Hartranft, T. H., ... Virgilio, C. D. (2015). Program Factors That Influence American Board of Surgery In-Training Examination Performance: A Multi-Institutional Study. Journal of Surgical Education, 72(6), e236-e242. https://doi.org/10.1016/j.jsurg.2015.06.014

Program Factors That Influence American Board of Surgery In-Training Examination Performance : A Multi-Institutional Study. / Kim, Jerry J.; Gifford, Edward D.; Moazzez, Ashkan; Sidwell, Richard A.; Reeves, Mark E.; Hartranft, Thomas H.; Inaba, Kenji; Jarman, Benjamin T.; Are, Chandrakanth; Galante, Joseph M.; Amersi, Farin; Smith, Brian R.; Melcher, Marc L.; Nelson, M. Timothy; Donahue, Timothy; Jacobsen, Garth; Arnell, Tracey D.; Lee, Steven; Neville, Angela; Virgilio, Christian de.

In: Journal of Surgical Education, Vol. 72, No. 6, 01.01.2015, p. e236-e242.

Research output: Contribution to journalArticle

Kim, JJ, Gifford, ED, Moazzez, A, Sidwell, RA, Reeves, ME, Hartranft, TH, Inaba, K, Jarman, BT, Are, C, Galante, JM, Amersi, F, Smith, BR, Melcher, ML, Nelson, MT, Donahue, T, Jacobsen, G, Arnell, TD, Lee, S, Neville, A & Virgilio, CD 2015, 'Program Factors That Influence American Board of Surgery In-Training Examination Performance: A Multi-Institutional Study', Journal of Surgical Education, vol. 72, no. 6, pp. e236-e242. https://doi.org/10.1016/j.jsurg.2015.06.014
Kim, Jerry J. ; Gifford, Edward D. ; Moazzez, Ashkan ; Sidwell, Richard A. ; Reeves, Mark E. ; Hartranft, Thomas H. ; Inaba, Kenji ; Jarman, Benjamin T. ; Are, Chandrakanth ; Galante, Joseph M. ; Amersi, Farin ; Smith, Brian R. ; Melcher, Marc L. ; Nelson, M. Timothy ; Donahue, Timothy ; Jacobsen, Garth ; Arnell, Tracey D. ; Lee, Steven ; Neville, Angela ; Virgilio, Christian de. / Program Factors That Influence American Board of Surgery In-Training Examination Performance : A Multi-Institutional Study. In: Journal of Surgical Education. 2015 ; Vol. 72, No. 6. pp. e236-e242.
@article{64a9aac4f5c049d0b788f11948b2efe2,
title = "Program Factors That Influence American Board of Surgery In-Training Examination Performance: A Multi-Institutional Study",
abstract = "Objective To determine the influence of program strategies, such as program directors' (PD) attitudes about the American Board of Surgery In-Training Examination (ABSITE) and approach to ABSITE preparation, on residents' ABSITE performance. Design A 17-item questionnaire was sent to PDs at surgical residency programs. The questions were designed to elicit information regarding the educational curriculum, remediation protocols, and opinions relating to the ABSITE. Main outcome measure was categorical resident ABSITE percentile scores from the January 2014 examination. Statistical analysis was performed using the Student t-test, analysis of variance, and linear regression as appropriate. Setting The study was carried out at general surgery residency programs across the country. Participants In total, 15 general surgery residency PDs participated in the study. Results The PD response rate was 100{\%}. All 460 resident ABSITE scores from the 15 programs were obtained. In total, 10 programs (67{\%}) identified as university affiliated, 4 programs (27{\%}) as independent academic, and 1 program (7{\%}) as hybrid. The mean number of residents per program was 30.7 (range: 15-57). In total, 14 PDs (93{\%}) indicated that an ABSITE review curriculum was in place and 13 PDs (87{\%}) indicated they had a remediation protocol for residents with low ABSITE scores (with differing thresholds of <30th, <35th, and <40th percentile). The median overall ABSITE score for all residents was 61st percentile (interquartile range = 39.5). The mean ABSITE score for each program ranged from 39th to 75th percentile. Program factors associated with higher ABSITE scores included tracking resident reading throughout the year (median 63rd percentile with tracking vs 59th percentile without, p = 0.040) and the type of remediation (by PD: 77th percentile, by PD and faculty: 57th percentile, faculty only: 64th percentile, with Surgical Education and Self-Assessment Program (SESAP): 63rd percentile, outside review course: 43rd percentile; p < 0.001). Programs with a remediation protocol trended toward higher ABSITE scores compared with programs without remediation protocols (median 61st percentile vs 53rd percentile, p = 0.098). Factors not significantly associated with ABSITE performance included number of structured educational hours per week and frequency of ABSITE review sessions. Conclusions Program factors appear to significantly influence ABSITE performance. Programs where the PD was actively involved in remediation mentorship and the tracking of resident reading achieved higher ABSITE percentile scores on the January 2014 examination. Counterintuitively, residents from programs with a lower ABSITE threshold for remediation performed better on the examination.",
keywords = "Key Words ABSITE, program director, surgery residency, surgical education",
author = "Kim, {Jerry J.} and Gifford, {Edward D.} and Ashkan Moazzez and Sidwell, {Richard A.} and Reeves, {Mark E.} and Hartranft, {Thomas H.} and Kenji Inaba and Jarman, {Benjamin T.} and Chandrakanth Are and Galante, {Joseph M.} and Farin Amersi and Smith, {Brian R.} and Melcher, {Marc L.} and Nelson, {M. Timothy} and Timothy Donahue and Garth Jacobsen and Arnell, {Tracey D.} and Steven Lee and Angela Neville and Virgilio, {Christian de}",
year = "2015",
month = "1",
day = "1",
doi = "10.1016/j.jsurg.2015.06.014",
language = "English (US)",
volume = "72",
pages = "e236--e242",
journal = "Journal of Surgical Education",
issn = "1931-7204",
publisher = "Elsevier Inc.",
number = "6",

}

TY - JOUR

T1 - Program Factors That Influence American Board of Surgery In-Training Examination Performance

T2 - A Multi-Institutional Study

AU - Kim, Jerry J.

AU - Gifford, Edward D.

AU - Moazzez, Ashkan

AU - Sidwell, Richard A.

AU - Reeves, Mark E.

AU - Hartranft, Thomas H.

AU - Inaba, Kenji

AU - Jarman, Benjamin T.

AU - Are, Chandrakanth

AU - Galante, Joseph M.

AU - Amersi, Farin

AU - Smith, Brian R.

AU - Melcher, Marc L.

AU - Nelson, M. Timothy

AU - Donahue, Timothy

AU - Jacobsen, Garth

AU - Arnell, Tracey D.

AU - Lee, Steven

AU - Neville, Angela

AU - Virgilio, Christian de

PY - 2015/1/1

Y1 - 2015/1/1

N2 - Objective To determine the influence of program strategies, such as program directors' (PD) attitudes about the American Board of Surgery In-Training Examination (ABSITE) and approach to ABSITE preparation, on residents' ABSITE performance. Design A 17-item questionnaire was sent to PDs at surgical residency programs. The questions were designed to elicit information regarding the educational curriculum, remediation protocols, and opinions relating to the ABSITE. Main outcome measure was categorical resident ABSITE percentile scores from the January 2014 examination. Statistical analysis was performed using the Student t-test, analysis of variance, and linear regression as appropriate. Setting The study was carried out at general surgery residency programs across the country. Participants In total, 15 general surgery residency PDs participated in the study. Results The PD response rate was 100%. All 460 resident ABSITE scores from the 15 programs were obtained. In total, 10 programs (67%) identified as university affiliated, 4 programs (27%) as independent academic, and 1 program (7%) as hybrid. The mean number of residents per program was 30.7 (range: 15-57). In total, 14 PDs (93%) indicated that an ABSITE review curriculum was in place and 13 PDs (87%) indicated they had a remediation protocol for residents with low ABSITE scores (with differing thresholds of <30th, <35th, and <40th percentile). The median overall ABSITE score for all residents was 61st percentile (interquartile range = 39.5). The mean ABSITE score for each program ranged from 39th to 75th percentile. Program factors associated with higher ABSITE scores included tracking resident reading throughout the year (median 63rd percentile with tracking vs 59th percentile without, p = 0.040) and the type of remediation (by PD: 77th percentile, by PD and faculty: 57th percentile, faculty only: 64th percentile, with Surgical Education and Self-Assessment Program (SESAP): 63rd percentile, outside review course: 43rd percentile; p < 0.001). Programs with a remediation protocol trended toward higher ABSITE scores compared with programs without remediation protocols (median 61st percentile vs 53rd percentile, p = 0.098). Factors not significantly associated with ABSITE performance included number of structured educational hours per week and frequency of ABSITE review sessions. Conclusions Program factors appear to significantly influence ABSITE performance. Programs where the PD was actively involved in remediation mentorship and the tracking of resident reading achieved higher ABSITE percentile scores on the January 2014 examination. Counterintuitively, residents from programs with a lower ABSITE threshold for remediation performed better on the examination.

AB - Objective To determine the influence of program strategies, such as program directors' (PD) attitudes about the American Board of Surgery In-Training Examination (ABSITE) and approach to ABSITE preparation, on residents' ABSITE performance. Design A 17-item questionnaire was sent to PDs at surgical residency programs. The questions were designed to elicit information regarding the educational curriculum, remediation protocols, and opinions relating to the ABSITE. Main outcome measure was categorical resident ABSITE percentile scores from the January 2014 examination. Statistical analysis was performed using the Student t-test, analysis of variance, and linear regression as appropriate. Setting The study was carried out at general surgery residency programs across the country. Participants In total, 15 general surgery residency PDs participated in the study. Results The PD response rate was 100%. All 460 resident ABSITE scores from the 15 programs were obtained. In total, 10 programs (67%) identified as university affiliated, 4 programs (27%) as independent academic, and 1 program (7%) as hybrid. The mean number of residents per program was 30.7 (range: 15-57). In total, 14 PDs (93%) indicated that an ABSITE review curriculum was in place and 13 PDs (87%) indicated they had a remediation protocol for residents with low ABSITE scores (with differing thresholds of <30th, <35th, and <40th percentile). The median overall ABSITE score for all residents was 61st percentile (interquartile range = 39.5). The mean ABSITE score for each program ranged from 39th to 75th percentile. Program factors associated with higher ABSITE scores included tracking resident reading throughout the year (median 63rd percentile with tracking vs 59th percentile without, p = 0.040) and the type of remediation (by PD: 77th percentile, by PD and faculty: 57th percentile, faculty only: 64th percentile, with Surgical Education and Self-Assessment Program (SESAP): 63rd percentile, outside review course: 43rd percentile; p < 0.001). Programs with a remediation protocol trended toward higher ABSITE scores compared with programs without remediation protocols (median 61st percentile vs 53rd percentile, p = 0.098). Factors not significantly associated with ABSITE performance included number of structured educational hours per week and frequency of ABSITE review sessions. Conclusions Program factors appear to significantly influence ABSITE performance. Programs where the PD was actively involved in remediation mentorship and the tracking of resident reading achieved higher ABSITE percentile scores on the January 2014 examination. Counterintuitively, residents from programs with a lower ABSITE threshold for remediation performed better on the examination.

KW - Key Words ABSITE

KW - program director

KW - surgery residency

KW - surgical education

UR - http://www.scopus.com/inward/record.url?scp=84940062209&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84940062209&partnerID=8YFLogxK

U2 - 10.1016/j.jsurg.2015.06.014

DO - 10.1016/j.jsurg.2015.06.014

M3 - Article

C2 - 26319103

AN - SCOPUS:84940062209

VL - 72

SP - e236-e242

JO - Journal of Surgical Education

JF - Journal of Surgical Education

SN - 1931-7204

IS - 6

ER -