Is test takers' video game usage a game changer? Criterion‐related validity and potential bias of a cognitive game‐based assessment
Bibliographic Data
| ID | 6415435 |
|---|---|
| Authors | Marie L Ohlms (0000-0003-4022-6904, Institute of Psychology and Education Universität Ulm Ulm Germany), Annika Hohner (Institute of Psychology and Education Universität Ulm Ulm Germany), Klaus G Melchers (0000-0003-4211-6450, Institute of Psychology and Education Universität Ulm Ulm Germany) |
| Year | 2025 |
| Volume | 74 |
| Issue | 5 |
| Publication date | 2025-10-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Applied Psychology (JOURNAL) |
| Journal identifiers | ISSN: 0269-994X • E-ISSN: 1464-0597 |
| Publisher | Wiley (PUBLISHER • GB) |
| DOI | 10.1111/apps.70038 |
| OpenAlex | W4415057419 |
| Language | EN |
| References cited | 62 |
Game‐based assessments (GBAs) have become increasingly popular among researchers and practitioners. However, research on their criterion‐related validity is scarce, and despite the proposed benefits of GBAs, concerns remain about their fairness. Thus, this study examines the criterion‐related validity of a GBA measuring cognitive abilities, and whether there is differential validity and test bias based on test takers' video game usage. For this purpose, data were collected from two samples: a working sample ( N = 156) and a potential applicant sample ( N = 92). In both samples, participants completed a cognitive GBA and answered questions assessing their academic performance, video game usage, and demographics. For the working sample, we also collected supervisor‐rated job performance. Results showed that GBA performance was positively correlated with academic performance in both samples, suggesting criterion‐related validity. Video game usage was positively associated with GBA performance and negatively with academic performance, indicating test bias. These findings suggest that video game usage enhances skills relevant to success in cognitive GBAs but not necessarily to academic performance, raising fairness concerns. This study advances research on cognitive GBAs by providing evidence for their criterion‐related validity, by addressing concerns about fairness, and by providing insights for their use in personnel selection
Education, Achievement, and Giftedness · Personality Traits and Psychology · Psychological and Educational Research Studies
The Validity of Self-Reported Grade Point Averages, Class Ranks, and Test Scores
Intelligence and school grades
Do Angry Birds Make for Angry Children? A Meta-Analysis of Video Game Influences on Children’s and Adolescents’ Aggression, Mental Health, Prosocial Behavior, and Academic Performance
Job Satisfaction and Organizational Commitment as Predictors of Organizational Citizenship and In-Role Behaviors
It's just a game! Effects of fantasy in a storified test on applicant reactions
| Citation velocity | historical |
|---|---|
| Highly cited | No |