Construct validity and fairness of an operational listening test with World Englishes
Datos Bibliográficos
| ID | 19381003 |
|---|---|
| Autores | Hitoshi Nishizawa (0000-0002-8335-006X, University of Hawaiʻi at Mānoa, autor de correspondencia) |
| Año | 2023 |
| Volumen | 40 |
| Número | 3 |
| Páginas | 493-520 |
| Fecha de publicación | 2023-07-01 |
| Peer Reviewed | Sí |
| Open Access | Sí |
| Tipo | ARTICLE |
| Revista | Language Testing (JOURNAL) |
| Identificadores de la revista | ISSN: 0265-5322 • E-ISSN: 1477-0946 |
| Editorial | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/02655322221137869 |
| OpenAlex | W4313590897 |
| Idioma | EN |
| Citas recibidas | 9 |
| Referencias citadas | 31 |
In this study, I investigate the construct validity and fairness pertaining to the use of a variety of Englishes in listening test input. I obtained data from a post-entry English language placement test administered at a public university in the United States. In addition to expectedly familiar American English, the test features Hawai’i, Filipino, and Indian English, which are expectedly less familiar to our test takers, but justified by the context. I used confirmatory factor analysis to test whether the category of unfamiliar English items formed a latent factor distinct from the other category of more familiar American English items. I used Rasch-based differential item functioning analysis to examine item biases as a function of examinees’ place of origin. The results from the confirmatory factor analysis suggested that the unfamiliar English items tapped into the same underlying construct as the familiar English items. The Rasch-based differential item functioning analysis revealed many instances of item bias among unfamiliar English items with higher proportions of item biases for items targeting narrow comprehension than broad comprehension. However, at the test level, the unfamiliar English items did not substantially influence raw total scores. These findings offer support for using a variety of Englishes in listening tests
Active listening · Confirmatory factor analysis · Construct validity · Developmental psychology · Differential item functioning · Item analysis · Item response theory · Language assessment · Linguistics · Mathematics education · Polytomous Rasch model · Psychometrics · Rasch model · Statistics · Structural equation modeling · Communication · Computer Science · Educational and Psychological Assessments · EFL/ESL Teaching and Learning · Multilingual Education and Policy · Psychology · Social Psychology · Artificial Intelligence
A Scoping Review of Global Englishes Language Teaching Research from 2020 to 2025
Japanese EFL Learners’ Perspectives on the Inclusion of Diverse English Accents in Audio Recordings for Textbooks and Listening Tests
Japanese EFL learners’ comprehension and perceptions of three different accents in listening assessment
Academic writing assessment in the Iranian expanding circle context
Exploring GenAI-Powered Listening Test Development
Authenticity of academic lecture passages in high-stakes tests
Fairness of using different English accents
Intelligibility and input variability influence adaptation to unfamiliar L2 pronunciation in L2
Transdisciplinary Intersections in Second Language Pronunciation Learning and Teaching
Introducing Global Englishes
Pronunciation Fundamentals
Changing Communicative Needs, Revised Assessment Objectives
Modeling Perceptions of the Accentedness and Comprehensibility of L2 Speech the Role of Speaking Rate
The interlanguage speech intelligibility benefit
The Problematic Concept of Native Speaker in Psycholinguistics
Unifactor Latent Trait Models Applied to Multifactor Tests
From One to Multiple Accents on a Test of L2 Listening Comprehension
A ‘new’ hierarchy of English teachers
The Reviewer’s Guide to Quantitative Methods in the Social Sciences
A meta-analysis of test format effects on reading and listening test performance
A comprehensive review of Rasch measurement in language assessment
Factor structure of the revised Toeic ® test
Validity and washback in language testing
Examining the effects of different English speech varieties on an L2 academic listening comprehension test at the item level
Accent, listening assessment and the potential for a shared-L1 advantage
From mythical ‘standard’ to standard reality
The Routledge handbook of English as a lingua franca
The Effects of Nonnative Accents on Listening Comprehension
The Effects of International Accents and Shared First Language on Listening Comprehension Tests
Speech Rate and Listening Comprehension
| Obras citantes distintas | 9 |
|---|---|
| Citas por año | 4,5 |
| Intervalo de citas | 2024 - 2026 (3) |
| Velocidad de citación | current |
| Altamente citado | No |
| Tipos de cita | Neutras: 9 |