Convergent, Criterion and Social Validity of the Emotional and Behavioral Screener

Corey D. Pierce, Matthew Lambert, Hussain Alamer

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Recent reports suggest that up to 20 % of all school-aged students demonstrate characteristics related to emotional disturbance. However, <1 % of these students actually receive special education services for ED, a percentage that has remained unchanged for nearly 30 years. Screening procedures have been developed to identify the behavioral needs of students within school-wide systems such as Multitiered System of Support, Positive Behavior Support, and Response to Intervention. While several screening tools are available at this time, many require significant time, training, and/or effort, factors which limit their practical use in schools. A new efficient assessment tool Emotional and Behavioral Screener (EBS) has recently been developed as a universal screening instrument. The purpose of this study was to examine the validity of the EBS scores, with a sample of over 600 elementary students, in comparison to scores from the Social Skills Improvement System assessment tool. Results indicated high levels of convergent validity between the scores (social skills; ρ = −0.70; and problem behavior; ρ = 0.79); strong criterion validity as assessed by differences in EBS scores between individuals with normal versus problematic scores (based on established cut-off scores) on the SSIS (social skills; d = 2.23; and problem behavior; d = 3.58) and assessed by binary classification between cut-off scores of the EBS and SSIS (AUROC range.86–.88); and adequate social validity. Implications and limitations of these results are discussed.

Original languageEnglish (US)
Pages (from-to)77-85
Number of pages9
JournalJournal of Child and Family Studies
Volume25
Issue number1
DOIs
StatePublished - Jan 1 2016

Fingerprint

Students
Special Education
Affective Symptoms
student
school
special education
Social Skills
Problem Behavior
time

Keywords

  • Assessment
  • Behavior
  • MTSS
  • PBIS
  • RtI
  • Screen

ASJC Scopus subject areas

  • Developmental and Educational Psychology
  • Life-span and Life-course Studies

Cite this

Convergent, Criterion and Social Validity of the Emotional and Behavioral Screener. / Pierce, Corey D.; Lambert, Matthew; Alamer, Hussain.

In: Journal of Child and Family Studies, Vol. 25, No. 1, 01.01.2016, p. 77-85.

Research output: Contribution to journalArticle

@article{07a169a105ca4a69a44bf257d24a3877,
title = "Convergent, Criterion and Social Validity of the Emotional and Behavioral Screener",
abstract = "Recent reports suggest that up to 20 {\%} of all school-aged students demonstrate characteristics related to emotional disturbance. However, <1 {\%} of these students actually receive special education services for ED, a percentage that has remained unchanged for nearly 30 years. Screening procedures have been developed to identify the behavioral needs of students within school-wide systems such as Multitiered System of Support, Positive Behavior Support, and Response to Intervention. While several screening tools are available at this time, many require significant time, training, and/or effort, factors which limit their practical use in schools. A new efficient assessment tool Emotional and Behavioral Screener (EBS) has recently been developed as a universal screening instrument. The purpose of this study was to examine the validity of the EBS scores, with a sample of over 600 elementary students, in comparison to scores from the Social Skills Improvement System assessment tool. Results indicated high levels of convergent validity between the scores (social skills; ρ = −0.70; and problem behavior; ρ = 0.79); strong criterion validity as assessed by differences in EBS scores between individuals with normal versus problematic scores (based on established cut-off scores) on the SSIS (social skills; d = 2.23; and problem behavior; d = 3.58) and assessed by binary classification between cut-off scores of the EBS and SSIS (AUROC range.86–.88); and adequate social validity. Implications and limitations of these results are discussed.",
keywords = "Assessment, Behavior, MTSS, PBIS, RtI, Screen",
author = "Pierce, {Corey D.} and Matthew Lambert and Hussain Alamer",
year = "2016",
month = "1",
day = "1",
doi = "10.1007/s10826-015-0206-7",
language = "English (US)",
volume = "25",
pages = "77--85",
journal = "Journal of Child and Family Studies",
issn = "1062-1024",
publisher = "Springer New York",
number = "1",

}

TY - JOUR

T1 - Convergent, Criterion and Social Validity of the Emotional and Behavioral Screener

AU - Pierce, Corey D.

AU - Lambert, Matthew

AU - Alamer, Hussain

PY - 2016/1/1

Y1 - 2016/1/1

N2 - Recent reports suggest that up to 20 % of all school-aged students demonstrate characteristics related to emotional disturbance. However, <1 % of these students actually receive special education services for ED, a percentage that has remained unchanged for nearly 30 years. Screening procedures have been developed to identify the behavioral needs of students within school-wide systems such as Multitiered System of Support, Positive Behavior Support, and Response to Intervention. While several screening tools are available at this time, many require significant time, training, and/or effort, factors which limit their practical use in schools. A new efficient assessment tool Emotional and Behavioral Screener (EBS) has recently been developed as a universal screening instrument. The purpose of this study was to examine the validity of the EBS scores, with a sample of over 600 elementary students, in comparison to scores from the Social Skills Improvement System assessment tool. Results indicated high levels of convergent validity between the scores (social skills; ρ = −0.70; and problem behavior; ρ = 0.79); strong criterion validity as assessed by differences in EBS scores between individuals with normal versus problematic scores (based on established cut-off scores) on the SSIS (social skills; d = 2.23; and problem behavior; d = 3.58) and assessed by binary classification between cut-off scores of the EBS and SSIS (AUROC range.86–.88); and adequate social validity. Implications and limitations of these results are discussed.

AB - Recent reports suggest that up to 20 % of all school-aged students demonstrate characteristics related to emotional disturbance. However, <1 % of these students actually receive special education services for ED, a percentage that has remained unchanged for nearly 30 years. Screening procedures have been developed to identify the behavioral needs of students within school-wide systems such as Multitiered System of Support, Positive Behavior Support, and Response to Intervention. While several screening tools are available at this time, many require significant time, training, and/or effort, factors which limit their practical use in schools. A new efficient assessment tool Emotional and Behavioral Screener (EBS) has recently been developed as a universal screening instrument. The purpose of this study was to examine the validity of the EBS scores, with a sample of over 600 elementary students, in comparison to scores from the Social Skills Improvement System assessment tool. Results indicated high levels of convergent validity between the scores (social skills; ρ = −0.70; and problem behavior; ρ = 0.79); strong criterion validity as assessed by differences in EBS scores between individuals with normal versus problematic scores (based on established cut-off scores) on the SSIS (social skills; d = 2.23; and problem behavior; d = 3.58) and assessed by binary classification between cut-off scores of the EBS and SSIS (AUROC range.86–.88); and adequate social validity. Implications and limitations of these results are discussed.

KW - Assessment

KW - Behavior

KW - MTSS

KW - PBIS

KW - RtI

KW - Screen

UR - http://www.scopus.com/inward/record.url?scp=84953354217&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84953354217&partnerID=8YFLogxK

U2 - 10.1007/s10826-015-0206-7

DO - 10.1007/s10826-015-0206-7

M3 - Article

AN - SCOPUS:84953354217

VL - 25

SP - 77

EP - 85

JO - Journal of Child and Family Studies

JF - Journal of Child and Family Studies

SN - 1062-1024

IS - 1

ER -