Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Korean Syntactic Complexity Analyzer (Kosca)

An NLP application for the analysis of syntactic complexity in second language production

Bibliographic Data

ID19380331
AuthorsHaerim Hwang (0000-0003-0888-590X, The Chinese University of Hong Kong, Hong Kong), Hyunwoo Kim (0000-0003-4810-6333, Yonsei University, Republic of Korea, corresponding author)
Year2024
Volume41
Issue3
Pages506-529
Publication date2024-07-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueLanguage Testing (JOURNAL)
Journal identifiersISSN: 0265-5322 • E-ISSN: 1477-0946
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1177/02655322231222596
OpenAlexW4391568498
LanguageEN
Citations received2
References cited42

Given the lack of computational tools available for assessing second language (L2) production in Korean, this study introduces a novel automated tool called the Korean Syntactic Complexity Analyzer (KOSCA) for measuring syntactic complexity in L2 Korean production. As an open-source graphic user interface (GUI) developed in Python, KOSCA provides seven indices of syntactic complexity, including traditional and Korean-specific ones. Its validity was tested by investigating whether the syntactic complexity indices measured by it in L2 written and spoken production could explain the variability of L2 Korean learners’ proficiency. The results of mixed-effects regression analyses showed that all seven indices significantly accounted for learner proficiency in Korean. Subsequent stepwise multiple regression analyses revealed that the syntactic complexity indices explained 56.0% of the total variance in proficiency for the written data and 54.4% for the spoken data. These findings underscore the validity of the syntactic complexity indices measured by KOSCA as reliable indicators of L2 Korean proficiency, which can serve as a valuable resource for researchers and educators in the field of L2 Korean learning and assessment

Linguistics · Natural language processing · Second language · Syntax · Computer Science · Natural Language Processing Techniques · Philosophy · Psychology · Text Readability and Simplification · Topic Modeling · Artificial Intelligence

  • Development of morphological diversity in second language Korean

    Open Access•Haerim Hwang•System•2024

  • Korean Syntactic Complexity Analyzer (Kosca)

    Open Access•Haerim Hwang, Hyunwoo Kim•Language Testing•2024

  • Regression Diagnostics

    John Fox, John P Fox•Regression Diagnostics•1991

  • A First Language

    Roger Brown•First Language•1973

  • Speaking

    Willem J M Levelt•Speaking•1989

  • Syntactic complexity in L2 writing

    Open Access•Lourdes Ortega•Journal of Second Language Writing•2015

  • The tool for the automatic analysis of lexical sophistication (Taales)

    Open Access•Kristopher Kyle, Scott A Crossley et al.•Behavior Research Methods•2018

  • Linguistic features in writing quality and development

    Open Access•Scott A Crossley, Scott Crossley•Journal of Writing Research•2020

  • A new look at the statistical model identification

    Open Access•Hirotugu Akaike•IEEE Transactions on Automatic…•1974

  • Random effects structure for confirmatory hypothesis testing

    Open Access•Dale J Barr, Roger Levy et al.•Journal of Memory and Language•2013

  • Fitting Linear Mixed-Effects Models Using lme4

    Open Access•David M Bates, Douglas Bates et al.•Journal of Statistical Software•2015

  • Complexity, Accuracy, and Fluency in Second Language Acquisition

    Alex Housen, Folkert Kuiken•Applied Linguistics•2009

  • Syntactic Complexity Measures and their Relationship to L2 Proficiency

    Lourdes Ortega•Applied Linguistics•2003

  • Assessed Levels of Second Language Speaking Proficiency

    Noriko Iwashita, Annie Brown et al.•Applied Linguistics•2007

  • Towards an Organic Approach to Investigating CAF in Instructed SLA

    John M Norris, Lourdes Ortega•Applied Linguistics•2009

  • Why Ordinal Variables Can (Almost) Always Be Treated as Continuous Variables

    Open Access•Alexander Robitzsch•Frontiers in Education•2020

  • Investigating grammatical complexity in L2 English writing research

    Open Access•Douglas Biber, BETHANY GRAY et al.•Journal of English for Academic…•2020

  • Effects of Written Versus Spoken Production Modalities on Syntactic Complexity Measures in Beginning‐Level Child EFL Learners

    Open Access•Haerim Hwang, Hye-Young Jung et al.•Modern Language Journal•2020

  • Measuring Writing Development and Proficiency Gains Using Indices of Lexical and Syntactic Complexity

    Open Access•Olesya Kisselev, Rossina Soyan et al.•Modern Language Journal•2022

  • Assessing syntactic sophistication in L2 writing

    Open Access•Kristopher Kyle, Scott A Crossley et al.•Language Testing•2017

  • Korean Syntactic Complexity Analyzer (Kosca)

    Open Access•Haerim Hwang, Hyunwoo Kim•Language Testing•2024

  • Syllable-Pattern-Based Unknown-Morpheme Segmentation and Estimation for Hybrid Part-of-Speech Tagging of Korean

    Open Access•Gary geunbae Lee, Jeong-Won Cha et al.•Computational Linguistics•2002

  • Proficiency‐related variation in syntactic complexity

    Open Access•Craig Lambert, Sachiko Nakamura•International Journal of Applied…•2018

  • Coh-Metrix

    D S Mcnamara, Max M Louwerse et al.•Discourse Processes•2010

  • Should We Use Characteristics of Conversation to Measure Grammatical Complexity in L2 Writing Development

    Open Access•Douglas Biber, BETHANY GRAY et al.•TESOL Quarterly•2011

  • A Second Look at T-Unit Analysis

    Kathleen Bardovi-Harlig•TESOL Quarterly•1992

  • A Corpus‐Based Evaluation of Syntactic Complexity Measures as Indices of College‐Level ESL Writers' Language Development

    Open Access•Xiaofei Lu•TESOL Quarterly•2011

  • (Generalized Linear) Mixed-Effects Modeling

    Open Access•Stefan Th Grie•Language Learning•2021

  • Assessing Verb-Construction Integration in Young Learners of English as a Foreign Language

    Open Access•Hyunwoo Kim, Haerim Hwang•Language Learning•2022

  • Task Effects on Linguistic Complexity and Accuracy

    Open Access•Theodora Alexopoulou, Marije Michel et al.•Language Learning•2017

Unique citing works2
Citations per year1
Citation span2024 - 2024 (1)
Citation velocityrecent
Highly citedNo
Citation typesNeutral: 2
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae