Effects of Response Format on Psychometric Properties and Fairness of a Matrices Test
Multiple Choice vs. Free Response
Bibliographic Data
| ID | 22164563 |
|---|---|
| Authors | Sonja Breuer (0000-0001-6214-5262, University of Salzburg, corresponding author), Thomas Scherndl (0000-0001-5755-9073, University of Salzburg), Tuulia M Ortner (0000-0002-5703-6915, University of Salzburg) |
| Year | 2020 |
| Volume | 5 |
| Publication date | 2020-02-20 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Frontiers in Education (JOURNAL) |
| Journal identifiers | ISSN: 2504-284X • E-ISSN: 2504-284X |
| Publisher | Frontiers Media SA (PUBLISHER • CH) |
| DOI | 10.3389/feduc.2020.00015 |
| OpenAlex | W3006879939 |
| Language | EN |
| Citations received | 1 |
| References cited | 86 |
Reasoning is regarded to be an essential facet of fundamental cognitive abilities. As examinee characteristics may affect performance in Reasoning tests, concern about maintaining fairness is expressed. The purpose of the current study was to examine effects of response format on psychometric properties and fairness of a matrices test according to examinee ́s sex, risk propensity, and test anxiety. A total of 433 German-speaking pupils (aged 14 to 20) were randomly assigned to either a multiple choice or a free response version of the same 25-item test. Data analysis yielded Rasch-homogeneous 23-item versions, with higher reliability, but lower criterion validity for the free response test. No interactions between response format and sex, test anxiety, or risk propensity were revealed, but a significant main effect of sex: men out-performed women in reasoning irrespective of response format. Results are discussed with reference to attributes of the test situation and sample characteristics
Anxiety · Cognition · Developmental psychology · Differential item functioning · Item response theory · Multiple choice · Psychometrics · Rasch model · Response bias · Statistics · Test anxiety · Communication · Education, Achievement, and Giftedness · Mathematics · Psychology · Psychometric Methodologies and Testing · Social and Intergroup Psychology · Social Psychology
Sex Differences on the Progressive Matrices
Human Cognitive Abilities
Test anxiety prevalence and gender differences in a sample of English secondary school students
Bayesian inference for psychology. Part I
The new science of cognitive sex differences
Correlates, Causes, Effects, and Treatment of Test Anxiety
The Prevalence and Effects of Test Anxiety in School Children
Towards an Integrated Analysis of Bias in Cross-Cultural Assessment
Evaluation of a behavioral measure of risk taking
Influence of Context on Item Parameters in Forced-Choice Personality Assessments
An Empirical Investigation of the Effects of Three Methods of Handling Guessing and Risk Taking on the Psychometric Indices of a Test
A domain‐specific risk‐attitude scale
The Relationship Between Test Item Format and Gender Achievement Gaps on Math and ELA Tests in Fourth and Eighth Grades
Fairness is not validity or cultural bias in racial-group assessment
Sex differences in means and variability on the progressive matrices in university students
Why is psychometric research on bias in mental testing so often ignored
The validity and utility of selection methods in personnel psychology
Gender differences in risk taking
| Citations per year | 1 |
|---|---|
| Citation span | 2026 - 2026 (1) |
| Highly cited | No |