Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

A Multidimensional Analysis of a High-Stakes English Listening Test

A Corpus-Based Approach

Bibliographic Data

ID22048314
AuthorsXuelian Tao (0009-0006-6245-6152, Nanyang Technological University), Vahid Aryadoust (0000-0001-6960-2489, Nanyang Technological University, corresponding author)
Year2024
Volume14
Issue2
Pages137
Publication date2024-01-29
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueEducation Sciences (JOURNAL)
Journal identifiersISSN: 2227-7102 • E-ISSN: 2227-7102
PublisherMDPI AG (PUBLISHER • IT)
DOI10.3390/educsci14020137
OpenAlexW4391322506
LanguageEN
Citations received4
References cited52

The Gaokao, also known as China’s national college entrance exam, is a high-stakes exam for nearly all Chinese students. English has been one of the three most important subjects for a long time, and listening plays an important role in the Gaokao English test. However, relatively little research has been conducted on local versions of Gaokao’s English listening tests. This study analyzed the linguistic features and corresponding functional dimensions of the three different text types in the Gaokao’s listening test, investigating whether the papers used in three major regions of China were differentiated in terms of the co-occurrence patterns of lexicogrammatical features and dimensions of the transcripts. A corpus consisting of 170 sets of test papers (134,913 words) covering 31 provinces and cities from 2000 to 2022 was analyzed using a multidimensional analysis wherein six exclusive dimensions were extracted. The results showed that there were meaningful differences across short conversations, long conversations, and monologues with regard to the six dimensions’ scores, and regions further had significant differences in three dimensions: Syntactic and Clausal Complexity, Oral versus Literate Discourse, and Procedural Discourse, while Time Period was not associated with any differences. Implications for language teaching and assessment are discussed

Active listening · Linguistics · Mathematics education · Natural language processing · Communication · Computer Science · Discourse Analysis in Language Studies · Natural Language Processing Techniques · Psychology · Second Language Acquisition and Learning

  • Automated analysis of common errors in L2 learner production

    Open Access•Atsushi Mizumoto•Studies in Second Language…•2025

  • Exploring GenAI-Powered Listening Test Development

    Open Access•Junyan Guo•Languages•2026

  • An automatized semantic analysis of two large-scale listening tests

    Open Access•Yufan Zhao, Vahid Aryadoust•Language Testing•2025

  • Justifying the Score or Informing the Stakeholder? Transparency Challenges in Large-Scale Language Testing

    Open Access•Vahid Aryadoust•Language Testing•2026

  • University Language

    Douglas Biber•University Language•2006

  • Dimensions of Register Variation

    Open Access•Douglas Biber•Dimensions of Register Variation•1995

  • Register, Genre, and Style

    Open Access•Douglas Biber, Susan Conrad•Register, Genre, and Style•2019

  • Variation across Speech and Writing

    Open Access•Douglas Biber•Variation Across Speech and Writing•1988

  • Representativeness in Corpus Design

    Douglas Biber•Literary and Linguistic Computing•1993

  • Measuring Syntactic Complexity in L2 Writing Using Fine‐Grained Clausal and Phrasal Indices

    Open Access•Kristopher Kyle, Scott A Crossley•Modern Language Journal•2018

  • Register as a predictor of linguistic variation

    Douglas Biber, Douglas Biber Douglas Biber•Corpus Linguistics and Linguistic…•2012

  • An Index of Factorial Simplicity

    Open Access•Henry F Kaiser•Psychometrika•1974

  • Evaluating the use of exploratory factor analysis in psychological research.

    Leandre R Fabrigar, Duane T Wegener et al.•Psychological Methods•1999

  • Task complexity, task difficulty, and task production

    Peter Robinson•Applied Linguistics•2001

  • Topic and Accent Coverage in a Commercialized L2 Listening Test

    Open Access•Vahid Aryadoust•Applied Linguistics•2024

  • The typology of second language listening constructs

    Open Access•Vahid Aryadoust, Lan Luo•Language Testing•2023

  • Register variation in spoken and written language use across technology-mediated and non-technology-mediated learning environments

    Open Access•Kristopher Kyle, Masaki Eguchi et al.•Language Testing•2022

  • Construct validity in Toefl iBT speaking tasks

    Open Access•Kristopher Kyle, Scott A Crossley et al.•Language Testing•2016

  • What can gaze behaviors, neuroimaging data, and test scores tell us about test method effects and cognitive load in listening assessments

    Open Access•Vahid Aryadoust, Stacy Foo et al.•Language Testing•2022

  • Recent developments in second and foreign language listening comprehension research

    Open Access•Larry Vandergrift•Language Teaching•2007

  • Listening in on monologues and dialogues

    Jean E Fox Tree•Discourse Processes•1999

  • Should We Use Characteristics of Conversation to Measure Grammatical Complexity in L2 Writing Development

    Open Access•Douglas Biber, BETHANY GRAY et al.•TESOL Quarterly•2011

  • The Role of Task and Listener Characteristics in Second Language Listening

    Open Access•Tineke Brunfaut, Andrea Révész•TESOL Quarterly•2015

  • Simplification of Input

    Craig Chaudron•TESOL Quarterly•1983

  • A Corpus‐Based Evaluation of Syntactic Complexity Measures as Indices of College‐Level ESL Writers' Language Development

    Open Access•Xiaofei Lu•TESOL Quarterly•2011

  • An analysis of relative clauses in the Lancaster/IBM spoken English corpus

    Junko Yamashita•English Studies•1994

  • Speaking and Writing in the University

    Douglas Biber, Susan Conrad et al.•TESOL Quarterly•2002

  • A multidimensional study of interactive registers in Pakistani and US English

    Open Access•M Shakir, Dagmar Deuber•World Englishes•2018

Unique citing works4
Citations per year4
Citation span2025 - 2026 (2)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 4

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae