Evaluation of web-based learning tools: Lessons learned from the thoracic surgery directors association curriculum project three-year experience

Jeffrey P. Gold, William B. Begg, David A. Fullerton, Douglas J. Mathisen, Mark B. Orringer, Edward D. Verrier

Research output: Contribution to journalArticle

14 Citations (Scopus)

Abstract

Background. In 2001 the Thoracic Surgery Directors Association implemented a web-based curriculum for prematriculated TS residents containing 75 learning modules organized into 13 sections Each module contains an audio/video presentation, a summary, frequently asked questions, references, a self-assessment, and a critique. Curriculum content was provided as a randomized prospective trial one year prior to matriculation to residents matching into a TS program from 2001 to 2004. Methods. Over 3 years the utilization and impact of this curriculum was evaluated by 8 different methods including resident surveys, faculty surveys, web tracking, examination scores, and individual online learning module critiques. Each completed critique evaluated the resident's perception of the relevance, content quality and presentation quality of the module on a scale corresponding to low, average and high. Results. A total of 11,117 learning modules were used through the end of 2004 with complete critiques available on 1458 (13%). Utilization and measured quality continue to increase over the 3-year interval. The average rating scores for relevance, content and presentation tracked together and were overall rated as good or excellent (92%). There were large variations in utilization and perceived quality by section subject. As the average module rating score improved, the utilization increased and the variability of the rating decreased substantially. Conclusions. Module specific learner evaluation of educational content is one of several important feedback tools for monitoring ongoing curricular development and refinement. These studies, based upon web tracking, demonstrate increasing resident use and strong resident satisfaction. This educational format will hopefully lend itself to many important improvements in web-based Thoracic Surgery education.

Original languageEnglish (US)
Pages (from-to)802-810
Number of pages9
JournalAnnals of Thoracic Surgery
Volume80
Issue number3
DOIs
StatePublished - Sep 1 2005

Fingerprint

Curriculum
Thoracic Surgery
Learning
Education
Surveys and Questionnaires

ASJC Scopus subject areas

  • Surgery
  • Pulmonary and Respiratory Medicine
  • Cardiology and Cardiovascular Medicine

Cite this

Evaluation of web-based learning tools : Lessons learned from the thoracic surgery directors association curriculum project three-year experience. / Gold, Jeffrey P.; Begg, William B.; Fullerton, David A.; Mathisen, Douglas J.; Orringer, Mark B.; Verrier, Edward D.

In: Annals of Thoracic Surgery, Vol. 80, No. 3, 01.09.2005, p. 802-810.

Research output: Contribution to journalArticle

Gold, Jeffrey P. ; Begg, William B. ; Fullerton, David A. ; Mathisen, Douglas J. ; Orringer, Mark B. ; Verrier, Edward D. / Evaluation of web-based learning tools : Lessons learned from the thoracic surgery directors association curriculum project three-year experience. In: Annals of Thoracic Surgery. 2005 ; Vol. 80, No. 3. pp. 802-810.
@article{fed26f2317554aa7a92cecec1d196865,
title = "Evaluation of web-based learning tools: Lessons learned from the thoracic surgery directors association curriculum project three-year experience",
abstract = "Background. In 2001 the Thoracic Surgery Directors Association implemented a web-based curriculum for prematriculated TS residents containing 75 learning modules organized into 13 sections Each module contains an audio/video presentation, a summary, frequently asked questions, references, a self-assessment, and a critique. Curriculum content was provided as a randomized prospective trial one year prior to matriculation to residents matching into a TS program from 2001 to 2004. Methods. Over 3 years the utilization and impact of this curriculum was evaluated by 8 different methods including resident surveys, faculty surveys, web tracking, examination scores, and individual online learning module critiques. Each completed critique evaluated the resident's perception of the relevance, content quality and presentation quality of the module on a scale corresponding to low, average and high. Results. A total of 11,117 learning modules were used through the end of 2004 with complete critiques available on 1458 (13{\%}). Utilization and measured quality continue to increase over the 3-year interval. The average rating scores for relevance, content and presentation tracked together and were overall rated as good or excellent (92{\%}). There were large variations in utilization and perceived quality by section subject. As the average module rating score improved, the utilization increased and the variability of the rating decreased substantially. Conclusions. Module specific learner evaluation of educational content is one of several important feedback tools for monitoring ongoing curricular development and refinement. These studies, based upon web tracking, demonstrate increasing resident use and strong resident satisfaction. This educational format will hopefully lend itself to many important improvements in web-based Thoracic Surgery education.",
author = "Gold, {Jeffrey P.} and Begg, {William B.} and Fullerton, {David A.} and Mathisen, {Douglas J.} and Orringer, {Mark B.} and Verrier, {Edward D.}",
year = "2005",
month = "9",
day = "1",
doi = "10.1016/j.athoracsur.2005.03.052",
language = "English (US)",
volume = "80",
pages = "802--810",
journal = "Annals of Thoracic Surgery",
issn = "0003-4975",
publisher = "Elsevier USA",
number = "3",

}

TY - JOUR

T1 - Evaluation of web-based learning tools

T2 - Lessons learned from the thoracic surgery directors association curriculum project three-year experience

AU - Gold, Jeffrey P.

AU - Begg, William B.

AU - Fullerton, David A.

AU - Mathisen, Douglas J.

AU - Orringer, Mark B.

AU - Verrier, Edward D.

PY - 2005/9/1

Y1 - 2005/9/1

N2 - Background. In 2001 the Thoracic Surgery Directors Association implemented a web-based curriculum for prematriculated TS residents containing 75 learning modules organized into 13 sections Each module contains an audio/video presentation, a summary, frequently asked questions, references, a self-assessment, and a critique. Curriculum content was provided as a randomized prospective trial one year prior to matriculation to residents matching into a TS program from 2001 to 2004. Methods. Over 3 years the utilization and impact of this curriculum was evaluated by 8 different methods including resident surveys, faculty surveys, web tracking, examination scores, and individual online learning module critiques. Each completed critique evaluated the resident's perception of the relevance, content quality and presentation quality of the module on a scale corresponding to low, average and high. Results. A total of 11,117 learning modules were used through the end of 2004 with complete critiques available on 1458 (13%). Utilization and measured quality continue to increase over the 3-year interval. The average rating scores for relevance, content and presentation tracked together and were overall rated as good or excellent (92%). There were large variations in utilization and perceived quality by section subject. As the average module rating score improved, the utilization increased and the variability of the rating decreased substantially. Conclusions. Module specific learner evaluation of educational content is one of several important feedback tools for monitoring ongoing curricular development and refinement. These studies, based upon web tracking, demonstrate increasing resident use and strong resident satisfaction. This educational format will hopefully lend itself to many important improvements in web-based Thoracic Surgery education.

AB - Background. In 2001 the Thoracic Surgery Directors Association implemented a web-based curriculum for prematriculated TS residents containing 75 learning modules organized into 13 sections Each module contains an audio/video presentation, a summary, frequently asked questions, references, a self-assessment, and a critique. Curriculum content was provided as a randomized prospective trial one year prior to matriculation to residents matching into a TS program from 2001 to 2004. Methods. Over 3 years the utilization and impact of this curriculum was evaluated by 8 different methods including resident surveys, faculty surveys, web tracking, examination scores, and individual online learning module critiques. Each completed critique evaluated the resident's perception of the relevance, content quality and presentation quality of the module on a scale corresponding to low, average and high. Results. A total of 11,117 learning modules were used through the end of 2004 with complete critiques available on 1458 (13%). Utilization and measured quality continue to increase over the 3-year interval. The average rating scores for relevance, content and presentation tracked together and were overall rated as good or excellent (92%). There were large variations in utilization and perceived quality by section subject. As the average module rating score improved, the utilization increased and the variability of the rating decreased substantially. Conclusions. Module specific learner evaluation of educational content is one of several important feedback tools for monitoring ongoing curricular development and refinement. These studies, based upon web tracking, demonstrate increasing resident use and strong resident satisfaction. This educational format will hopefully lend itself to many important improvements in web-based Thoracic Surgery education.

UR - http://www.scopus.com/inward/record.url?scp=23944433948&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=23944433948&partnerID=8YFLogxK

U2 - 10.1016/j.athoracsur.2005.03.052

DO - 10.1016/j.athoracsur.2005.03.052

M3 - Article

C2 - 16122433

AN - SCOPUS:23944433948

VL - 80

SP - 802

EP - 810

JO - Annals of Thoracic Surgery

JF - Annals of Thoracic Surgery

SN - 0003-4975

IS - 3

ER -