Korean Syntactic Complexity Analyzer (Kosca)

Given the lack of computational tools available for assessing second language (L2) production in Korean, this study introduces a novel automated tool called the Korean Syntactic Complexity Analyzer (KOSCA) for measuring syntactic complexity in L2 Korean production. As an open-source graphic user interface (GUI) developed in Python, KOSCA provides seven indices of syntactic complexity, including traditional and Korean-specific ones. Its validity was tested by investigating whether the syntactic complexity indices measured by it in L2 written and spoken production could explain the variability of L2 Korean learners’ proficiency. The results of mixed-effects regression analyses showed that all seven indices significantly accounted for learner proficiency in Korean. Subsequent stepwise multiple regression analyses revealed that the syntactic complexity indices explained 56.0% of the total variance in proficiency for the written data and 54.4% for the spoken data. These findings underscore the validity of the syntactic complexity indices measured by KOSCA as reliable indicators of L2 Korean proficiency, which can serve as a valuable resource for researchers and educators in the field of L2 Korean learning and assessment

Linguistics · Natural language processing · Second language · Syntax · Computer Science · Natural Language Processing Techniques · Philosophy · Psychology · Text Readability and Simplification · Topic Modeling · Artificial Intelligence

• Development of morphological diversity in second language Korean

  Open Access•Haerim Hwang•System•2024

  Incluir item

• Korean Syntactic Complexity Analyzer (Kosca)

  Open Access•Haerim Hwang, Hyunwoo Kim•Language Testing•2024

  Incluir item

• Regression Diagnostics

  John Fox, John P Fox•Regression Diagnostics•1991

  Incluir item

• A First Language

  Roger Brown•First Language•1973

  Incluir item

• Speaking

  Willem J M Levelt•Speaking•1989

  Incluir item

• Syntactic complexity in L2 writing

  Open Access•Lourdes Ortega•Journal of Second Language Writing•2015

  Incluir item

• The tool for the automatic analysis of lexical sophistication (Taales)

  Open Access•Kristopher Kyle, Scott A Crossley et al.•Behavior Research Methods•2018

  Incluir item

• Linguistic features in writing quality and development

  Open Access•Scott A Crossley, Scott Crossley•Journal of Writing Research•2020

  Incluir item

• A new look at the statistical model identification

  Open Access•Hirotugu Akaike•IEEE Transactions on Automatic…•1974

  Incluir item

• Random effects structure for confirmatory hypothesis testing

  Open Access•Dale J Barr, Roger Levy et al.•Journal of Memory and Language•2013

  Incluir item

• Fitting Linear Mixed-Effects Models Using lme4

  Open Access•David M Bates, Douglas Bates et al.•Journal of Statistical Software•2015

  Incluir item

• Complexity, Accuracy, and Fluency in Second Language Acquisition

  Alex Housen, Folkert Kuiken•Applied Linguistics•2009

  Incluir item

• Syntactic Complexity Measures and their Relationship to L2 Proficiency

  Lourdes Ortega•Applied Linguistics•2003

  Incluir item

• Assessed Levels of Second Language Speaking Proficiency

  Noriko Iwashita, Annie Brown et al.•Applied Linguistics•2007

  Incluir item

• Towards an Organic Approach to Investigating CAF in Instructed SLA

  John M Norris, Lourdes Ortega•Applied Linguistics•2009

  Incluir item

• Why Ordinal Variables Can (Almost) Always Be Treated as Continuous Variables

  Open Access•Alexander Robitzsch•Frontiers in Education•2020

  Incluir item

• Investigating grammatical complexity in L2 English writing research

  Open Access•Douglas Biber, BETHANY GRAY et al.•Journal of English for Academic…•2020

  Incluir item

• Effects of Written Versus Spoken Production Modalities on Syntactic Complexity Measures in Beginning‐Level Child EFL Learners

  Open Access•Haerim Hwang, Hye-Young Jung et al.•Modern Language Journal•2020

  Incluir item

• Measuring Writing Development and Proficiency Gains Using Indices of Lexical and Syntactic Complexity

  Open Access•Olesya Kisselev, Rossina Soyan et al.•Modern Language Journal•2022

  Incluir item

• Assessing syntactic sophistication in L2 writing

  Open Access•Kristopher Kyle, Scott A Crossley et al.•Language Testing•2017

  Incluir item

• Korean Syntactic Complexity Analyzer (Kosca)

  Open Access•Haerim Hwang, Hyunwoo Kim•Language Testing•2024

  Incluir item

• Syllable-Pattern-Based Unknown-Morpheme Segmentation and Estimation for Hybrid Part-of-Speech Tagging of Korean

  Open Access•Gary geunbae Lee, Jeong-Won Cha et al.•Computational Linguistics•2002

  Incluir item

• Proficiency‐related variation in syntactic complexity

  Open Access•Craig Lambert, Sachiko Nakamura•International Journal of Applied…•2018

  Incluir item

• Coh-Metrix

  D S Mcnamara, Max M Louwerse et al.•Discourse Processes•2010

  Incluir item

• Should We Use Characteristics of Conversation to Measure Grammatical Complexity in L2 Writing Development

  Open Access•Douglas Biber, BETHANY GRAY et al.•TESOL Quarterly•2011

  Incluir item

• A Second Look at T-Unit Analysis

  Kathleen Bardovi-Harlig•TESOL Quarterly•1992

  Incluir item

• A Corpus‐Based Evaluation of Syntactic Complexity Measures as Indices of College‐Level ESL Writers' Language Development

  Open Access•Xiaofei Lu•TESOL Quarterly•2011

  Incluir item

• (Generalized Linear) Mixed-Effects Modeling

  Open Access•Stefan Th Grie•Language Learning•2021

  Incluir item

• Assessing Verb-Construction Integration in Young Learners of English as a Foreign Language

  Open Access•Hyunwoo Kim, Haerim Hwang•Language Learning•2022

  Incluir item

• Task Effects on Linguistic Complexity and Accuracy

  Open Access•Theodora Alexopoulou, Marije Michel et al.•Language Learning•2017

  Incluir item