Testing Practices and Attitudes Toward Tests and Testing: An International Survey

Arne Evers, Carina M. McCormick, Leslie R. Hawley, José Muñiz, Giulia Balboni, Dave Bartram, Dusica Boben, Jens Egeland, Karma El-Hassan, José R. Fernández-Hermida, Saul Fine, Örjan Frans, Grazina Gintiliené, Carmen Hagemeister, Peter Halama, Dragos Iliescu, Aleksandra Jaworowska, Paul Jiménez, Marina Manthouli, Krunoslav MatesicLars Michaelsen, Andrew Mogaji, James Morley-Kirk, Sándor Rózsa, Lorraine Rowlands, Mark Schittekatte, H. Canan Sümer, Tono Suwartono, Tomáš Urbánek, Solange Wechsler, Tamara Zelenevska, Svetoslav Zanev, Jianxin Zhang

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

On behalf of the International Test Commission and the European Federation of Psychologists' Associations a world-wide survey on the opinions of professional psychologists on testing practices was carried out. The main objective of this study was to collect data for a better understanding of the state of psychological testing worldwide. These data could guide the actions and measures taken by ITC, EFPA, and other stakeholders. A questionnaire was administered to 20,467 professional psychologists from 29 countries. Five scales were constructed relating to: concern over incorrect test use, regulations on tests and testing, internet and computerized testing, appreciation of tests, and knowledge and training relating to test use. Equivalence across countries was evaluated using the alignment method, four scales demonstrated acceptable levels of invariance. Multilevel analysis was used to determine how scores were related to age, gender, and specialization, as well as how scores varied between countries. Although the results show a high appreciation of tests in general, the appreciation of internet and computerized testing is much lower. These scales show low variability over countries, whereas differences between countries on the other reported scales are much greater. This implies the need for some overarching improvements as well as country-specific actions.

Original languageEnglish (US)
Pages (from-to)158-190
Number of pages33
JournalInternational Journal of Testing
Volume17
Issue number2
DOIs
StatePublished - Apr 3 2017

Fingerprint

Psychology
Testing
psychologist
Internet
Multilevel Analysis
Invariance
multi-level analysis
Federation
Specialization
federation
equivalence
Questionnaire
specialization
Surveys and Questionnaires
Alignment
stakeholder
Equivalence
Imply
regulation
questionnaire

Keywords

  • European Federation of Psychologists' Associations
  • International Test Commission
  • psychological testing
  • test use
  • testing practices

ASJC Scopus subject areas

  • Social Psychology
  • Education
  • Modeling and Simulation

Cite this

Testing Practices and Attitudes Toward Tests and Testing : An International Survey. / Evers, Arne; McCormick, Carina M.; Hawley, Leslie R.; Muñiz, José; Balboni, Giulia; Bartram, Dave; Boben, Dusica; Egeland, Jens; El-Hassan, Karma; Fernández-Hermida, José R.; Fine, Saul; Frans, Örjan; Gintiliené, Grazina; Hagemeister, Carmen; Halama, Peter; Iliescu, Dragos; Jaworowska, Aleksandra; Jiménez, Paul; Manthouli, Marina; Matesic, Krunoslav; Michaelsen, Lars; Mogaji, Andrew; Morley-Kirk, James; Rózsa, Sándor; Rowlands, Lorraine; Schittekatte, Mark; Sümer, H. Canan; Suwartono, Tono; Urbánek, Tomáš; Wechsler, Solange; Zelenevska, Tamara; Zanev, Svetoslav; Zhang, Jianxin.

In: International Journal of Testing, Vol. 17, No. 2, 03.04.2017, p. 158-190.

Research output: Contribution to journalArticle

Evers, A, McCormick, CM, Hawley, LR, Muñiz, J, Balboni, G, Bartram, D, Boben, D, Egeland, J, El-Hassan, K, Fernández-Hermida, JR, Fine, S, Frans, Ö, Gintiliené, G, Hagemeister, C, Halama, P, Iliescu, D, Jaworowska, A, Jiménez, P, Manthouli, M, Matesic, K, Michaelsen, L, Mogaji, A, Morley-Kirk, J, Rózsa, S, Rowlands, L, Schittekatte, M, Sümer, HC, Suwartono, T, Urbánek, T, Wechsler, S, Zelenevska, T, Zanev, S & Zhang, J 2017, 'Testing Practices and Attitudes Toward Tests and Testing: An International Survey', International Journal of Testing, vol. 17, no. 2, pp. 158-190. https://doi.org/10.1080/15305058.2016.1216434
Evers, Arne ; McCormick, Carina M. ; Hawley, Leslie R. ; Muñiz, José ; Balboni, Giulia ; Bartram, Dave ; Boben, Dusica ; Egeland, Jens ; El-Hassan, Karma ; Fernández-Hermida, José R. ; Fine, Saul ; Frans, Örjan ; Gintiliené, Grazina ; Hagemeister, Carmen ; Halama, Peter ; Iliescu, Dragos ; Jaworowska, Aleksandra ; Jiménez, Paul ; Manthouli, Marina ; Matesic, Krunoslav ; Michaelsen, Lars ; Mogaji, Andrew ; Morley-Kirk, James ; Rózsa, Sándor ; Rowlands, Lorraine ; Schittekatte, Mark ; Sümer, H. Canan ; Suwartono, Tono ; Urbánek, Tomáš ; Wechsler, Solange ; Zelenevska, Tamara ; Zanev, Svetoslav ; Zhang, Jianxin. / Testing Practices and Attitudes Toward Tests and Testing : An International Survey. In: International Journal of Testing. 2017 ; Vol. 17, No. 2. pp. 158-190.
@article{63914623d1e14dadb641f5f560963c64,
title = "Testing Practices and Attitudes Toward Tests and Testing: An International Survey",
abstract = "On behalf of the International Test Commission and the European Federation of Psychologists' Associations a world-wide survey on the opinions of professional psychologists on testing practices was carried out. The main objective of this study was to collect data for a better understanding of the state of psychological testing worldwide. These data could guide the actions and measures taken by ITC, EFPA, and other stakeholders. A questionnaire was administered to 20,467 professional psychologists from 29 countries. Five scales were constructed relating to: concern over incorrect test use, regulations on tests and testing, internet and computerized testing, appreciation of tests, and knowledge and training relating to test use. Equivalence across countries was evaluated using the alignment method, four scales demonstrated acceptable levels of invariance. Multilevel analysis was used to determine how scores were related to age, gender, and specialization, as well as how scores varied between countries. Although the results show a high appreciation of tests in general, the appreciation of internet and computerized testing is much lower. These scales show low variability over countries, whereas differences between countries on the other reported scales are much greater. This implies the need for some overarching improvements as well as country-specific actions.",
keywords = "European Federation of Psychologists' Associations, International Test Commission, psychological testing, test use, testing practices",
author = "Arne Evers and McCormick, {Carina M.} and Hawley, {Leslie R.} and Jos{\'e} Mu{\~n}iz and Giulia Balboni and Dave Bartram and Dusica Boben and Jens Egeland and Karma El-Hassan and Fern{\'a}ndez-Hermida, {Jos{\'e} R.} and Saul Fine and {\"O}rjan Frans and Grazina Gintilien{\'e} and Carmen Hagemeister and Peter Halama and Dragos Iliescu and Aleksandra Jaworowska and Paul Jim{\'e}nez and Marina Manthouli and Krunoslav Matesic and Lars Michaelsen and Andrew Mogaji and James Morley-Kirk and S{\'a}ndor R{\'o}zsa and Lorraine Rowlands and Mark Schittekatte and S{\"u}mer, {H. Canan} and Tono Suwartono and Tom{\'a}š Urb{\'a}nek and Solange Wechsler and Tamara Zelenevska and Svetoslav Zanev and Jianxin Zhang",
year = "2017",
month = "4",
day = "3",
doi = "10.1080/15305058.2016.1216434",
language = "English (US)",
volume = "17",
pages = "158--190",
journal = "International Journal of Testing",
issn = "1530-5058",
publisher = "Routledge",
number = "2",

}

TY - JOUR

T1 - Testing Practices and Attitudes Toward Tests and Testing

T2 - An International Survey

AU - Evers, Arne

AU - McCormick, Carina M.

AU - Hawley, Leslie R.

AU - Muñiz, José

AU - Balboni, Giulia

AU - Bartram, Dave

AU - Boben, Dusica

AU - Egeland, Jens

AU - El-Hassan, Karma

AU - Fernández-Hermida, José R.

AU - Fine, Saul

AU - Frans, Örjan

AU - Gintiliené, Grazina

AU - Hagemeister, Carmen

AU - Halama, Peter

AU - Iliescu, Dragos

AU - Jaworowska, Aleksandra

AU - Jiménez, Paul

AU - Manthouli, Marina

AU - Matesic, Krunoslav

AU - Michaelsen, Lars

AU - Mogaji, Andrew

AU - Morley-Kirk, James

AU - Rózsa, Sándor

AU - Rowlands, Lorraine

AU - Schittekatte, Mark

AU - Sümer, H. Canan

AU - Suwartono, Tono

AU - Urbánek, Tomáš

AU - Wechsler, Solange

AU - Zelenevska, Tamara

AU - Zanev, Svetoslav

AU - Zhang, Jianxin

PY - 2017/4/3

Y1 - 2017/4/3

N2 - On behalf of the International Test Commission and the European Federation of Psychologists' Associations a world-wide survey on the opinions of professional psychologists on testing practices was carried out. The main objective of this study was to collect data for a better understanding of the state of psychological testing worldwide. These data could guide the actions and measures taken by ITC, EFPA, and other stakeholders. A questionnaire was administered to 20,467 professional psychologists from 29 countries. Five scales were constructed relating to: concern over incorrect test use, regulations on tests and testing, internet and computerized testing, appreciation of tests, and knowledge and training relating to test use. Equivalence across countries was evaluated using the alignment method, four scales demonstrated acceptable levels of invariance. Multilevel analysis was used to determine how scores were related to age, gender, and specialization, as well as how scores varied between countries. Although the results show a high appreciation of tests in general, the appreciation of internet and computerized testing is much lower. These scales show low variability over countries, whereas differences between countries on the other reported scales are much greater. This implies the need for some overarching improvements as well as country-specific actions.

AB - On behalf of the International Test Commission and the European Federation of Psychologists' Associations a world-wide survey on the opinions of professional psychologists on testing practices was carried out. The main objective of this study was to collect data for a better understanding of the state of psychological testing worldwide. These data could guide the actions and measures taken by ITC, EFPA, and other stakeholders. A questionnaire was administered to 20,467 professional psychologists from 29 countries. Five scales were constructed relating to: concern over incorrect test use, regulations on tests and testing, internet and computerized testing, appreciation of tests, and knowledge and training relating to test use. Equivalence across countries was evaluated using the alignment method, four scales demonstrated acceptable levels of invariance. Multilevel analysis was used to determine how scores were related to age, gender, and specialization, as well as how scores varied between countries. Although the results show a high appreciation of tests in general, the appreciation of internet and computerized testing is much lower. These scales show low variability over countries, whereas differences between countries on the other reported scales are much greater. This implies the need for some overarching improvements as well as country-specific actions.

KW - European Federation of Psychologists' Associations

KW - International Test Commission

KW - psychological testing

KW - test use

KW - testing practices

UR - http://www.scopus.com/inward/record.url?scp=84984922289&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84984922289&partnerID=8YFLogxK

U2 - 10.1080/15305058.2016.1216434

DO - 10.1080/15305058.2016.1216434

M3 - Article

AN - SCOPUS:84984922289

VL - 17

SP - 158

EP - 190

JO - International Journal of Testing

JF - International Journal of Testing

SN - 1530-5058

IS - 2

ER -