Discriminant construct validity of ImPACT™: A companion study

A. Maerlender, L. Flashman, A. Kessler, S. Kumbhani, R. Greenwald, T. Tosteson, T. McAllister

Research output: Contribution to journalArticle

24 Citations (Scopus)

Abstract

In a previous analysis of ImPACT scores relative to traditional neuropsychological tests (NP) and experimental tasks (Maerlender et al., 2010) we demonstrated convergent construct validity for the primary ImPACT test-score composites. A complete analysis of discriminant validity was not undertaken at that time. Here, test scores from the 54 collegiate football and hockey players were re-analyzed to specifically address the discriminant validity of the ImPACT™ composite scores using a multiply operationalized correlation matrix of multi-trait multi-method data. In the method used here, discriminant validity is determined by obtaining non-significant correlations between a target score when correlated with the average of the other trait measurements (multiply-operationalized multi-trait-mono-method analysis). Results showed that the ImPACT™ Verbal Memory (p =.044), Visual Memory (p =.006), and Visual Motor Speed (p =.000) scores were highly correlated with composites of the other scores, while the Reaction Time composite demonstrated adequate discriminant validity (p =.145). In comparison all of the NP composites showed good discrimination (all p-values >.05, except for Reaction Time p =.05). Thus the apparent lack of discriminability between three of four composite scores in this sample raises questions about using ImPACT™ composite scores to support specific construct-oriented interpretations. Taken together, the discriminant and convergent construct validity properties of ImPACT™ indicate construct sensitivity, but limited construct specificity.

Original languageEnglish (US)
Pages (from-to)290-299
Number of pages10
JournalClinical Neuropsychologist
Volume27
Issue number2
DOIs
StatePublished - Feb 1 2013

Fingerprint

Neuropsychological Tests
Reaction Time
Hockey
Football
Discriminant Analysis
Construct Validity
Companionship
Discrimination (Psychology)
Test Scores

Keywords

  • Contruct validity
  • Discriminant validity
  • ImPACT™
  • Neuropsychological testing
  • Sports concussion

ASJC Scopus subject areas

  • Neuropsychology and Physiological Psychology
  • Developmental and Educational Psychology
  • Clinical Psychology
  • Arts and Humanities (miscellaneous)
  • Psychiatry and Mental health

Cite this

Maerlender, A., Flashman, L., Kessler, A., Kumbhani, S., Greenwald, R., Tosteson, T., & McAllister, T. (2013). Discriminant construct validity of ImPACT™: A companion study. Clinical Neuropsychologist, 27(2), 290-299. https://doi.org/10.1080/13854046.2012.744098

Discriminant construct validity of ImPACT™ : A companion study. / Maerlender, A.; Flashman, L.; Kessler, A.; Kumbhani, S.; Greenwald, R.; Tosteson, T.; McAllister, T.

In: Clinical Neuropsychologist, Vol. 27, No. 2, 01.02.2013, p. 290-299.

Research output: Contribution to journalArticle

Maerlender, A, Flashman, L, Kessler, A, Kumbhani, S, Greenwald, R, Tosteson, T & McAllister, T 2013, 'Discriminant construct validity of ImPACT™: A companion study', Clinical Neuropsychologist, vol. 27, no. 2, pp. 290-299. https://doi.org/10.1080/13854046.2012.744098
Maerlender A, Flashman L, Kessler A, Kumbhani S, Greenwald R, Tosteson T et al. Discriminant construct validity of ImPACT™: A companion study. Clinical Neuropsychologist. 2013 Feb 1;27(2):290-299. https://doi.org/10.1080/13854046.2012.744098
Maerlender, A. ; Flashman, L. ; Kessler, A. ; Kumbhani, S. ; Greenwald, R. ; Tosteson, T. ; McAllister, T. / Discriminant construct validity of ImPACT™ : A companion study. In: Clinical Neuropsychologist. 2013 ; Vol. 27, No. 2. pp. 290-299.
@article{c43d8990dcd34c5fb014a895e5267bca,
title = "Discriminant construct validity of ImPACT™: A companion study",
abstract = "In a previous analysis of ImPACT scores relative to traditional neuropsychological tests (NP) and experimental tasks (Maerlender et al., 2010) we demonstrated convergent construct validity for the primary ImPACT test-score composites. A complete analysis of discriminant validity was not undertaken at that time. Here, test scores from the 54 collegiate football and hockey players were re-analyzed to specifically address the discriminant validity of the ImPACT™ composite scores using a multiply operationalized correlation matrix of multi-trait multi-method data. In the method used here, discriminant validity is determined by obtaining non-significant correlations between a target score when correlated with the average of the other trait measurements (multiply-operationalized multi-trait-mono-method analysis). Results showed that the ImPACT™ Verbal Memory (p =.044), Visual Memory (p =.006), and Visual Motor Speed (p =.000) scores were highly correlated with composites of the other scores, while the Reaction Time composite demonstrated adequate discriminant validity (p =.145). In comparison all of the NP composites showed good discrimination (all p-values >.05, except for Reaction Time p =.05). Thus the apparent lack of discriminability between three of four composite scores in this sample raises questions about using ImPACT™ composite scores to support specific construct-oriented interpretations. Taken together, the discriminant and convergent construct validity properties of ImPACT™ indicate construct sensitivity, but limited construct specificity.",
keywords = "Contruct validity, Discriminant validity, ImPACT™, Neuropsychological testing, Sports concussion",
author = "A. Maerlender and L. Flashman and A. Kessler and S. Kumbhani and R. Greenwald and T. Tosteson and T. McAllister",
year = "2013",
month = "2",
day = "1",
doi = "10.1080/13854046.2012.744098",
language = "English (US)",
volume = "27",
pages = "290--299",
journal = "Clinical Neuropsychologist",
issn = "0920-1637",
publisher = "Swets & Zeitlinger",
number = "2",

}

TY - JOUR

T1 - Discriminant construct validity of ImPACT™

T2 - A companion study

AU - Maerlender, A.

AU - Flashman, L.

AU - Kessler, A.

AU - Kumbhani, S.

AU - Greenwald, R.

AU - Tosteson, T.

AU - McAllister, T.

PY - 2013/2/1

Y1 - 2013/2/1

N2 - In a previous analysis of ImPACT scores relative to traditional neuropsychological tests (NP) and experimental tasks (Maerlender et al., 2010) we demonstrated convergent construct validity for the primary ImPACT test-score composites. A complete analysis of discriminant validity was not undertaken at that time. Here, test scores from the 54 collegiate football and hockey players were re-analyzed to specifically address the discriminant validity of the ImPACT™ composite scores using a multiply operationalized correlation matrix of multi-trait multi-method data. In the method used here, discriminant validity is determined by obtaining non-significant correlations between a target score when correlated with the average of the other trait measurements (multiply-operationalized multi-trait-mono-method analysis). Results showed that the ImPACT™ Verbal Memory (p =.044), Visual Memory (p =.006), and Visual Motor Speed (p =.000) scores were highly correlated with composites of the other scores, while the Reaction Time composite demonstrated adequate discriminant validity (p =.145). In comparison all of the NP composites showed good discrimination (all p-values >.05, except for Reaction Time p =.05). Thus the apparent lack of discriminability between three of four composite scores in this sample raises questions about using ImPACT™ composite scores to support specific construct-oriented interpretations. Taken together, the discriminant and convergent construct validity properties of ImPACT™ indicate construct sensitivity, but limited construct specificity.

AB - In a previous analysis of ImPACT scores relative to traditional neuropsychological tests (NP) and experimental tasks (Maerlender et al., 2010) we demonstrated convergent construct validity for the primary ImPACT test-score composites. A complete analysis of discriminant validity was not undertaken at that time. Here, test scores from the 54 collegiate football and hockey players were re-analyzed to specifically address the discriminant validity of the ImPACT™ composite scores using a multiply operationalized correlation matrix of multi-trait multi-method data. In the method used here, discriminant validity is determined by obtaining non-significant correlations between a target score when correlated with the average of the other trait measurements (multiply-operationalized multi-trait-mono-method analysis). Results showed that the ImPACT™ Verbal Memory (p =.044), Visual Memory (p =.006), and Visual Motor Speed (p =.000) scores were highly correlated with composites of the other scores, while the Reaction Time composite demonstrated adequate discriminant validity (p =.145). In comparison all of the NP composites showed good discrimination (all p-values >.05, except for Reaction Time p =.05). Thus the apparent lack of discriminability between three of four composite scores in this sample raises questions about using ImPACT™ composite scores to support specific construct-oriented interpretations. Taken together, the discriminant and convergent construct validity properties of ImPACT™ indicate construct sensitivity, but limited construct specificity.

KW - Contruct validity

KW - Discriminant validity

KW - ImPACT™

KW - Neuropsychological testing

KW - Sports concussion

UR - http://www.scopus.com/inward/record.url?scp=84876131085&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84876131085&partnerID=8YFLogxK

U2 - 10.1080/13854046.2012.744098

DO - 10.1080/13854046.2012.744098

M3 - Article

C2 - 23317033

AN - SCOPUS:84876131085

VL - 27

SP - 290

EP - 299

JO - Clinical Neuropsychologist

JF - Clinical Neuropsychologist

SN - 0920-1637

IS - 2

ER -