A controlled study of improvements in student exam performance with the use of an audience response system during medical school lectures

Hugh A. Stoddard, Craig A. Piquette

Research output: Contribution to journalArticle

18 Citations (Scopus)

Abstract

BACKGROUND: An audience response system (ARS) is an electronic classroom communication device. There are several educational justifications for using ARS. Our controlled study investigated whether ARS use was associated with improved performance on a course exam. METHOD: This study used exam scores as the outcome and employed a switching replication design with a paired-samples t test analysis. The control and experimental groups differed only on whether students were expected to use ARS to enter data during lectures. RESULTS: The average scores on questions when ARS was used were statistically similar to scores when ARS was not used. A sign test on difference scores confirmed the result. Statistical power was adequate to detect at least a small effect size. CONCLUSIONS: Improvements in test scores found in previous studies may have been due to the inclusion of questions in the lecture rather than the use of ARS. Embedding questions into lectures is beneficial, either with or without ARS technology.

Original languageEnglish (US)
Pages (from-to)S37-S40
JournalAcademic Medicine
Volume85
Issue number10 SUPPL.
DOIs
StatePublished - Oct 2010

Fingerprint

Medical Schools
Communication
Students
Technology
Equipment and Supplies
Control Groups
school
performance
student
inclusion
electronics
classroom
communication

ASJC Scopus subject areas

  • Education

Cite this

A controlled study of improvements in student exam performance with the use of an audience response system during medical school lectures. / Stoddard, Hugh A.; Piquette, Craig A.

In: Academic Medicine, Vol. 85, No. 10 SUPPL., 10.2010, p. S37-S40.

Research output: Contribution to journalArticle

@article{6d14812b00834d74839258428640d631,
title = "A controlled study of improvements in student exam performance with the use of an audience response system during medical school lectures",
abstract = "BACKGROUND: An audience response system (ARS) is an electronic classroom communication device. There are several educational justifications for using ARS. Our controlled study investigated whether ARS use was associated with improved performance on a course exam. METHOD: This study used exam scores as the outcome and employed a switching replication design with a paired-samples t test analysis. The control and experimental groups differed only on whether students were expected to use ARS to enter data during lectures. RESULTS: The average scores on questions when ARS was used were statistically similar to scores when ARS was not used. A sign test on difference scores confirmed the result. Statistical power was adequate to detect at least a small effect size. CONCLUSIONS: Improvements in test scores found in previous studies may have been due to the inclusion of questions in the lecture rather than the use of ARS. Embedding questions into lectures is beneficial, either with or without ARS technology.",
author = "Stoddard, {Hugh A.} and Piquette, {Craig A.}",
year = "2010",
month = "10",
doi = "10.1097/ACM.0b013e3181ed3b40",
language = "English (US)",
volume = "85",
pages = "S37--S40",
journal = "Academic Medicine",
issn = "1040-2446",
publisher = "Lippincott Williams and Wilkins",
number = "10 SUPPL.",

}

TY - JOUR

T1 - A controlled study of improvements in student exam performance with the use of an audience response system during medical school lectures

AU - Stoddard, Hugh A.

AU - Piquette, Craig A.

PY - 2010/10

Y1 - 2010/10

N2 - BACKGROUND: An audience response system (ARS) is an electronic classroom communication device. There are several educational justifications for using ARS. Our controlled study investigated whether ARS use was associated with improved performance on a course exam. METHOD: This study used exam scores as the outcome and employed a switching replication design with a paired-samples t test analysis. The control and experimental groups differed only on whether students were expected to use ARS to enter data during lectures. RESULTS: The average scores on questions when ARS was used were statistically similar to scores when ARS was not used. A sign test on difference scores confirmed the result. Statistical power was adequate to detect at least a small effect size. CONCLUSIONS: Improvements in test scores found in previous studies may have been due to the inclusion of questions in the lecture rather than the use of ARS. Embedding questions into lectures is beneficial, either with or without ARS technology.

AB - BACKGROUND: An audience response system (ARS) is an electronic classroom communication device. There are several educational justifications for using ARS. Our controlled study investigated whether ARS use was associated with improved performance on a course exam. METHOD: This study used exam scores as the outcome and employed a switching replication design with a paired-samples t test analysis. The control and experimental groups differed only on whether students were expected to use ARS to enter data during lectures. RESULTS: The average scores on questions when ARS was used were statistically similar to scores when ARS was not used. A sign test on difference scores confirmed the result. Statistical power was adequate to detect at least a small effect size. CONCLUSIONS: Improvements in test scores found in previous studies may have been due to the inclusion of questions in the lecture rather than the use of ARS. Embedding questions into lectures is beneficial, either with or without ARS technology.

UR - http://www.scopus.com/inward/record.url?scp=77958450889&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77958450889&partnerID=8YFLogxK

U2 - 10.1097/ACM.0b013e3181ed3b40

DO - 10.1097/ACM.0b013e3181ed3b40

M3 - Article

C2 - 20881700

AN - SCOPUS:77958450889

VL - 85

SP - S37-S40

JO - Academic Medicine

JF - Academic Medicine

SN - 1040-2446

IS - 10 SUPPL.

ER -