Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Did they take the same test? Examinee language proficiency and the structure of language tests

Bibliographic Data

ID19380970
AuthorsSang-Keun Shin (Ewha Womans University, Seoul,, corresponding author)
Year2005
Volume22
Issue1
Pages31-57
Publication date2005-01-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueLanguage Testing (JOURNAL)
Journal identifiersISSN: 0265-5322 • E-ISSN: 1477-0946
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1191/0265532205lt296oa
OpenAlexW2143158998
LanguageEN
Citations received13
References cited26

This study investigated the relationship between examinee proficiency and the structure of the Test of English as a Foreign Language (TOEFL) and the Speaking proficiency in English Assessment Kit (SPEAK). Specifically, using multi-group structural equation modeling, this study tested two competing hypotheses about the relationship: whether or not the dimensions of language ability become more or less differentiated as a function of increasing examinee proficiency. Among four alternative models (a second-order model, a correlated specific factor model, a single general factor model, and a totally divisible model), a second-order factor model was established as a baseline model for three ability groups and then estimated simultaneously with cross-group equality imposed. The results showed that the tests were partially equivalent, thereby supporting neither of the hypotheses. Finally, the multiple indicators and multiple causes modeling analysis suggested that the language backgrounds of test-takers were related to measurement non-invariance

Foreign language · Language assessment · Language proficiency · Linguistics · Mathematics education · Statistics · Structural equation modeling · Test of English as a Foreign Language · Computer Science · Educational Technology and Assessment · Mathematics · Psychology · Psychometric Methodologies and Testing · Student Assessment and Feedback

  • Structural Equation Modeling in Language Assessment

    Open Access•Yasuyo Sawaki•Encyclopedia of Applied Linguistics•2026

  • Factor structure of the Toefl Internet-based test

    Open Access•Yasuyo Sawaki, Lawrence J Stricker et al.•Language Testing•2009

  • Do the Toefl iBT ® section scores provide value-added information to stakeholders

    Open Access•Yasuyo Sawaki, Sandip Sinharay•Language Testing•2018

  • Measuring English language proficiency across subgroups

    Open Access•Hanwook Yoo, Venessa F Manna et al.•Language Testing•2019

  • Investigating and optimizing score dependability of a local ITA speaking test across language groups

    Open Access•Ji-young Shin•Language Testing•2022

  • Language ability of young English language learners

    Open Access•Lin Gu•Language Testing•2015

  • Examining the factor structure and its replicability across multiple listening test forms

    Open Access•Tingting Liu, Vahid Aryadoust et al.•Language Testing•2022

  • Do divisible subskills exist in second language (L2) comprehension? A structural equation modeling approach

    Open Access•Min-Young Song, Min‐Young Song•Language Testing•2008

  • Measuring English language workplace proficiency across subgroups

    Open Access•Hanwook Yoo, Venessa F Manna•Language Testing•2017

  • Validating a standards-based classroom assessment of English proficiency

    Open Access•Lorena Llosa•Language Testing•2007

  • Factor structure of the revised Toeic ® test

    Open Access•Yo In''Nami, Yo In’nami et al.•Language Testing•2012

  • Construct validation of analytic rating scales in a speaking assessment

    Open Access•Yasuyo Sawaki•Language Testing•2007

  • At the interface between language testing and second language acquisition

    Open Access•Lin Gu•Language Testing•2014

  • Second Language Acquisition

    Susan M Ga, Susan M Gass et al.•Second Language Acquisition•2001

  • Testing Factorial Invariance across Groups

    Open Access•Gordon W Cheung, Roger B Rensvold•Journal of Management•1999

  • Structural Equations with Latent Variables

    Open Access•K A Bollen•Structural Equations with Latent…•1989

  • Investigating the effects of strategy use and second language test performance with high- and low-ability test takers

    Open Access•James E Purpura•Language Testing•1998

  • Differential item functioning on two tests of EFL proficiency

    Open Access•Katherine E Ryan, Lyle F Bachman•Language Testing•1992

  • Using G-theory and Many-facet Rasch measurement in the development of performance assessments of the ESL speaking skills of immigrants

    Open Access•Brian K Lynch, T F Mcnamara et al.•Language Testing•1998

  • Detecting DIF across the different language groups in a speaking test

    Open Access•Mi-Kyung Kim, Mikyung Kim•Language Testing•2001

  • An investigation of a criterion- referenced test using G-theory, and factor and cluster analyses

    Open Access•Antony John Kunnan•Language Testing•1992

  • Some Theory and Applications of Confirmatory Second-Order Factor Analysis

    David Rindskopf, Tedd Rose•Multivariate Behavioral Research•1988

  • Cross-Validation Of Covariance Structures

    Robert Cudeck, Michael W Browne•Multivariate Behavioral Research•1983

  • Some Cautions Concerning The Application Of Causal Modeling Methods

    Norman Cliff•Multivariate Behavioral Research•1983

  • Assessment of Fit in Overidentified Models with Latent Variables

    Open Access•Blair Wheaton•Sociological Methods & Research•1987

  • The Construct Validation of Some Components of Communicative Proficiency

    Lyle F Bachman, Adrian S Palmer•TESOL Quarterly•1982

  • Current developments in language testing

    Open Access•William Grabe•Lingua•1986

  • Testing for the equivalence of factor covariance and mean structures

    Barbara M Byrne, Richard J Shavelson et al.•Psychological Bulletin•1989

  • Assessing Measurement Invariance in Cross‐National Consumer Research

    Jan-Benedict E M Steenkamp, Jan‐Benedict E M Steenkamp et al.•Journal of Consumer Research•1998

  • Comparative fit indexes in structural models

    Peter M Bentler•Psychological Bulletin•1990

  • The Construct Validation of the Fsi Oral Interview1

    Open Access•Lyle F Bachman, Adrian S Palmer•Language Learning•1981

  • Assessment of L2 Proficiency in Second Language Acquisition Research

    Open Access•Margaret Thomas•Language Learning•1994

  • The Divisibility of Language Competence

    Open Access•Kamal A Fouly, Kamal Abdel-Alim Fouly et al.•Language Learning•1990

  • The Effect of Language Background on "Foreign" Language Test Performance

    Open Access•Catherine Elder•Language Learning•1996

  • Alternative Ways of Assessing Model Fit

    Open Access•Michael W Browne, Robert Cudeck•Sociological Methods & Research•1992

Unique citing works13
Citations per year0,68
Citation span2007 - 2026 (20)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 13

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae