Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Use of Dependency‐Annotated Learner Corpora in Measuring Syntactic Complexity for Granularity, Accuracy, Consistency, and Transparency

Implications for Research and Teaching

Bibliographic Data

ID7169348
AuthorsYujie Zhang (0000-0001-6480-4268, Faculty of Education and Social Work The University of Auckland Auckland New Zealand), Long Jiang Zhang (0000-0003-1025-1746, Faculty of Education and Social Work The University of Auckland Auckland New Zealand, corresponding author)
Year2025
Volume59
Issue2
Pages1050-1063
Publication date2025-06-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueTESOL Quarterly (JOURNAL)
Journal identifiersISSN: 0039-8322 • E-ISSN: 1545-7249
PublisherWiley (PUBLISHER • GB)
DOI10.1002/tesq.3370
OpenAlexW4404487634
LanguageEN
Citations received2
References cited32

Syntactic complexity has long been used to gauge language learners' performance, proficiency, and development, offering language teachers valid recommendations for syllabus design and materials development. Progress in syntactic complexity research foreshadows the imperative of measuring syntactic features at a high level of granularity, which remains, however, inadequately represented in the current operationalization of syntactic complexity. Beyond this misalignment, researchers also caution against the issues of consistency and accuracy in its measurement. We thus advocate for a methodological synergy by combining automatized dependency annotation and self‐built learner corpora, arguing that this can effectively address the aforementioned concerns and promote the initiative for transparency and openness in applied linguistics. Next, we concisely showcase how to manage this method step by step, which can be done easily with tools, and some practical considerations, so researchers and teachers can compile their do‐it‐yourself corpora. We conclude by discussing the implications of adopting this method for research and teaching. How this method can figure into potential areas of inquiry is identified with examples, including task‐based language teaching, writing assessment, and additional language syntactic acquisition. Pedagogically, we illustrate how this method can help language teachers identify gaps in learners' language production, raise their language awareness, and inform learner‐centered instruction

Consistency (knowledge bases · Dependency (UML · Dependency grammar · Granularity · Linguistics · Natural language processing · Programming language · Transparency (behavior · Artificial Intelligence · Computer Science · Natural Language Processing Techniques · Psychology · Text Readability and Simplification · Topic Modeling

  • Longitudinal development of L2 speaking accuracy in AI-enhanced smart class

    Open Access•Mengjia Liu, Harwati Hashim et al.•System•2026

  • Learner Corpus Research in Applied Linguistics

    Open Access•Ute Römer•TESOL Quarterly•2026

  • Corpus Linguistics, Learner Corpora, and SLA

    Open Access•Tony Mcenery, Vaclav Brezina et al.•Annual Review of Applied…•2019

  • Task-Based Learner Production

    Open Access•Luke Plonsky, Youjin Kim•Annual Review of Applied…•2016

  • Automated Evaluation of Text and Discourse with Coh-Metrix

    Open Access•D S Mcnamara, Arthur C Graesser et al.•Automated Evaluation of Text and…•2014

  • Dependency Distance as a Metric of Language Comprehension Difficulty

    Open Access•Haitao Liu, Haitao Liu Haitao Liu•Journal of Cognitive Science•2008

  • Does writing development equal writing quality? A computational investigation of syntactic complexity in L2 learners

    Open Access•Scott A Crossley, D S Mcnamara•Journal of Second Language Writing•2014

  • Measuring Syntactic Complexity in L2 Writing Using Fine‐Grained Clausal and Phrasal Indices

    Open Access•Kristopher Kyle, Scott A Crossley•Modern Language Journal•2018

  • Caf

    Gabriele Pallotti•Applied Linguistics•2009

  • Calling for More Consistency, Refinement, and Critical Consideration in the Use of Syntactic Complexity Measures for Writing

    Open Access•Yaochen Deng, Lei Lei et al.•Applied Linguistics•2021

  • Towards an Organic Approach to Investigating CAF in Instructed SLA

    John M Norris, Lourdes Ortega•Applied Linguistics•2009

  • Automated measurement of syntactic complexity in corpus-based L2 writing research and implications for writing assessment

    Open Access•Xiaofei Lu•Language Testing•2017

  • Dependency Grammar

    Marie-Catherine De Marneffe, Joakim Nivre•Annual Review of Linguistics•2019

  • Dependency parsing of learner English

    Yan Huang, Akira Murakami et al.•International Journal of Corpus…•2018

  • Syntactic complexity in assessing young adolescent EFL learners’ writings

    Open Access•Peng Bi, Jingyang Jiang•System•2020

  • Should We Use Characteristics of Conversation to Measure Grammatical Complexity in L2 Writing Development

    Open Access•Douglas Biber, BETHANY GRAY et al.•TESOL Quarterly•2011

  • The Linguistic Development of Students of English as a Second Language in Two Written Genres

    Open Access•Hyung-Jo Yoon, Hyung‐Jo Yoon et al.•TESOL Quarterly•2017

  • Open science

    Open Access•Ali H Al‐hoorie, Carlo Cinaglia et al.•TESOL Quarterly•2024

  • Learner Corpora in Corpus‐Informed Instruction

    Open Access•Shelley Staple, Shelley Staples et al.•TESOL Quarterly•2024

  • A Corpus‐Based Evaluation of Syntactic Complexity Measures as Indices of College‐Level ESL Writers' Language Development

    Open Access•Xiaofei Lu•TESOL Quarterly•2011

  • Distance-invoked difficulty as a trigger for errors in Chinese and Japanese EFL learners’ English writings

    Qianqian Jiang, Jingyang Jiang et al.•IRAL - International Review of…•2025

  • Introducing Registered Reports at Language Learning

    Open Access•Emma Marsden, Kara Morgan‐short et al.•Language Learning•2018

Unique citing works2
Citations per year2
Citation span2026 - 2026 (1)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 2

Tools

Open DOI
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae