Differential item functioning across race and ethnicity for the emotional and behavioral screener

Matthew C. Lambert, Stacy Ann A. January, Cynthia J. Cress, Michael H. Epstein, Douglas Cullinan

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% female) who were diverse with regard to race and ethnicity (45% African American, 41% Hispanic/Latino, and 14% Caucasian). Classroom teachers rated each student on the EBS during the fall semester screening window. Item response theory modeling was combined with ordinal regression to investigate the presence and impact of differential item functioning across 3 race and ethnicity groups. The findings suggest that items from the EBS exhibit small to negligible levels of DIF, and the limited DIF that was present does not significantly impact overall scores. Researchers and practitioners can have confidence that scores from the EBS are relatively unaffected by test bias when measuring the emotional and behavioral risk of young students from African American, Hispanic/Latino, or Caucasian backgrounds.

Original languageEnglish (US)
Pages (from-to)399-407
Number of pages9
JournalSchool Psychology Quarterly
Volume33
Issue number3
DOIs
StatePublished - Sep 2018

Fingerprint

Hispanic Americans
ethnicity
Caucasian
Students
African Americans
female student
semester
ethnic group
student
confidence
Ethnic Groups
regression
classroom
Research Personnel
trend
teacher
Group
American

Keywords

  • Behavior assessment
  • Differential item functioning
  • Emotional and Behavioral Screener (EBS)
  • Measurement invariance
  • Universal screening

ASJC Scopus subject areas

  • Education
  • Developmental and Educational Psychology

Cite this

Differential item functioning across race and ethnicity for the emotional and behavioral screener. / Lambert, Matthew C.; January, Stacy Ann A.; Cress, Cynthia J.; Epstein, Michael H.; Cullinan, Douglas.

In: School Psychology Quarterly, Vol. 33, No. 3, 09.2018, p. 399-407.

Research output: Contribution to journalArticle

Lambert, Matthew C. ; January, Stacy Ann A. ; Cress, Cynthia J. ; Epstein, Michael H. ; Cullinan, Douglas. / Differential item functioning across race and ethnicity for the emotional and behavioral screener. In: School Psychology Quarterly. 2018 ; Vol. 33, No. 3. pp. 399-407.
@article{9665ba566ce0402b81d0b7839d64088e,
title = "Differential item functioning across race and ethnicity for the emotional and behavioral screener",
abstract = "The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49{\%} female) who were diverse with regard to race and ethnicity (45{\%} African American, 41{\%} Hispanic/Latino, and 14{\%} Caucasian). Classroom teachers rated each student on the EBS during the fall semester screening window. Item response theory modeling was combined with ordinal regression to investigate the presence and impact of differential item functioning across 3 race and ethnicity groups. The findings suggest that items from the EBS exhibit small to negligible levels of DIF, and the limited DIF that was present does not significantly impact overall scores. Researchers and practitioners can have confidence that scores from the EBS are relatively unaffected by test bias when measuring the emotional and behavioral risk of young students from African American, Hispanic/Latino, or Caucasian backgrounds.",
keywords = "Behavior assessment, Differential item functioning, Emotional and Behavioral Screener (EBS), Measurement invariance, Universal screening",
author = "Lambert, {Matthew C.} and January, {Stacy Ann A.} and Cress, {Cynthia J.} and Epstein, {Michael H.} and Douglas Cullinan",
year = "2018",
month = "9",
doi = "10.1037/spq0000224",
language = "English (US)",
volume = "33",
pages = "399--407",
journal = "School Psychology",
issn = "2578-4218",
publisher = "American Psychological Association Inc.",
number = "3",

}

TY - JOUR

T1 - Differential item functioning across race and ethnicity for the emotional and behavioral screener

AU - Lambert, Matthew C.

AU - January, Stacy Ann A.

AU - Cress, Cynthia J.

AU - Epstein, Michael H.

AU - Cullinan, Douglas

PY - 2018/9

Y1 - 2018/9

N2 - The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% female) who were diverse with regard to race and ethnicity (45% African American, 41% Hispanic/Latino, and 14% Caucasian). Classroom teachers rated each student on the EBS during the fall semester screening window. Item response theory modeling was combined with ordinal regression to investigate the presence and impact of differential item functioning across 3 race and ethnicity groups. The findings suggest that items from the EBS exhibit small to negligible levels of DIF, and the limited DIF that was present does not significantly impact overall scores. Researchers and practitioners can have confidence that scores from the EBS are relatively unaffected by test bias when measuring the emotional and behavioral risk of young students from African American, Hispanic/Latino, or Caucasian backgrounds.

AB - The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% female) who were diverse with regard to race and ethnicity (45% African American, 41% Hispanic/Latino, and 14% Caucasian). Classroom teachers rated each student on the EBS during the fall semester screening window. Item response theory modeling was combined with ordinal regression to investigate the presence and impact of differential item functioning across 3 race and ethnicity groups. The findings suggest that items from the EBS exhibit small to negligible levels of DIF, and the limited DIF that was present does not significantly impact overall scores. Researchers and practitioners can have confidence that scores from the EBS are relatively unaffected by test bias when measuring the emotional and behavioral risk of young students from African American, Hispanic/Latino, or Caucasian backgrounds.

KW - Behavior assessment

KW - Differential item functioning

KW - Emotional and Behavioral Screener (EBS)

KW - Measurement invariance

KW - Universal screening

UR - http://www.scopus.com/inward/record.url?scp=85028448874&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85028448874&partnerID=8YFLogxK

U2 - 10.1037/spq0000224

DO - 10.1037/spq0000224

M3 - Article

C2 - 28857588

AN - SCOPUS:85028448874

VL - 33

SP - 399

EP - 407

JO - School Psychology

JF - School Psychology

SN - 2578-4218

IS - 3

ER -