Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Assessing spoken lexical and lexicogrammatical proficiency using features of word, bigram, and dependency bigram use

Bibliographic Data

ID21360202
AuthorsKristopher Kyle (0000-0001-5415-9672, Department of Linguistics University of Oregon Eugene Oregon USA, corresponding author), Masaki Eguchi (0000-0002-0791-4935, Department of Linguistics University of Oregon Eugene Oregon USA)
Year2023
Volume107
Issue2
Pages531-564
Publication date2023-06-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueModern Language Journal (JOURNAL)
Journal identifiersISSN: 0026-7902 • E-ISSN: 1540-4781
PublisherWiley (PUBLISHER • GB)
DOI10.1111/modl.12845
OpenAlexW4380048983
LanguageEN
Citations received7
References cited59

The measurement of second language (L2) productive lexical proficiency has driven a great deal of research over the past two decades. Research has indicated that more proficient speakers and writers tend to use a wider range of words and that more proficient writers tend to use words that are more sophisticated (less frequent in reference corpora). Research over the past 15 years has also demonstrated that the way words are used in context (i.e., collocation use) is also an important indicator of both written and spoken proficiency. In this study, we extend recent research that has modeled writing proficiency using collocation indices based on grammatical dependencies (e.g., verb–direct object) to spoken contexts. In particular, we model speaking proficiency scores from a large corpus of oral proficiency interview responses using a range of well‐known indices of productive proficiency and newly developed grammatical dependency indices. The results indicated that all index types demonstrated small to moderate correlations with speaking proficiency individually but explained a large proportion of the variance when used in a multivariate model that included dependency collocation indices

Bigram · Collocation (remote sensing) · Context (archaeology) · Dependency (UML) · Language proficiency · Linguistics · Natural language processing · Verb · Artificial Intelligence · Computer Science · History · Natural Language Processing Techniques · Psychology · Second Language Acquisition and Learning · Text Readability and Simplification

  • Back to Basics in Measuring Lexical Diversity

    Open Access•Yves Bestgen•Applied Linguistics•2024

  • Measuring vocabulary use in L2 English and L2 French writing

    Open Access•Eva Caltabellotta, Elke Van Steendam et al.•Assessing Writing•2026

  • Usage-based analysis of L2 oral proficiency

    Open Access•Hakyung Sung, Kristopher Kyle•Studies in Second Language…•2025

  • Anaphoric Interpretation Among Chinese EFL Learners

    Open Access•Leyi Qian, Rongrong Huang et al.•Journal of Psycholinguistic…•2026

  • Predictive Effects of Phraseological Complexity on the Quality of Chinese EFL Learners’ L2 Oral Production

    Open Access•Tingting Wang, Dandan Zhou•International Journal of Applied…•2024

  • Text length requirements for stable and genre-sensitive lexical diversity measurement

    Open Access•Wanwan Zheng•Cogent Arts and Humanities•2025

  • Complexity and Difficulty in Second Language Acquisition

    Open Access•Bram Bulté, Alex Housen et al.•Language Learning•2025

  • Imagery and verbal processes.

    Allan Paivio•Imagery and verbal processes.•1971

  • Learning Vocabulary in Another Language

    Open Access•Paul Nation, I S P Nation•Learning Vocabulary in Another…•2001

  • Assessing Vocabulary

    Open Access•John Read•Assessing Vocabulary•2000

  • Automated Evaluation of Text and Discourse with Coh-Metrix

    Open Access•D S Mcnamara, Arthur C Graesser et al.•Automated Evaluation of Text and…•2014

  • Assessing the Validity of Lexical Diversity Indices Using Direct Judgements

    Kristopher Kyle, Scott A Crossley et al.•Language Assessment Quarterly•2021

  • Relative Importance for Linear Regression in R

    Open Access•Ulrike Grömping•Journal of Statistical Software•2006

  • Predicting human judgments of essay quality in both integrated and independent second language writing samples

    Liang Guo, Scott A Crossley et al.•Assessing Writing•2013

  • Word Frequency, Collocational Frequency, L1 Congruency, and Proficiency in L2 Collocational Processing

    Open Access•Brent Wolter, Jun Yamashita et al.•Studies in Second Language…•2018

  • Lexical Sophistication as a Multidimensional Phenomenon

    Open Access•Minkyung Kim, Scott A Crossley et al.•Modern Language Journal•2018

  • Quantifying the development of phraseological competence in L2 English writing

    Open Access•Yves Bestgen, Sylviane Granger•Journal of Second Language Writing•2014

  • Cutting the Gordian Knot

    Michael A Covington, Joe D McFall•Journal of Quantitative Linguistics•2010

  • Concreteness ratings for 40 thousand generally known English word lemmas

    Open Access•Marc Brysbaert, Amy Beth Warriner et al.•Behavior Research Methods•2014

  • Investigating minimum text lengths for lexical diversity indices

    Open Access•Fred Zenker, Kristopher Kyle•Assessing Writing•2021

  • Construction Learning as a Function of Frequency, Frequency Distribution, and Function

    Open Access•Nick C Ellis, Fernando Ferreira-Junior et al.•Modern Language Journal•2009

  • Concreteness, imagery, and meaningfulness values for 925 nouns.

    Allan Paivio, John C Yuille et al.•Journal of Experimental…•1968

  • The tool for the automatic analysis of lexical sophistication (Taales)

    Open Access•Kristopher Kyle, Scott A Crossley et al.•Behavior Research Methods•2018

  • The Corpus of Contemporary American English as the first reliable monitor corpus of English

    Mark Davies•Literary and Linguistic Computing•2010

  • A dynamic usage based perspective on L2 writing

    Open Access•Marjolijn Verspoor, Monika S Schmid et al.•Journal of Second Language Writing•2012

  • The relationship of lexical proficiency to the quality of ESL compositions

    Open Access•Cheryl A Engber, Cheryl Engber•Journal of Second Language Writing•1995

  • The University of South Florida free association, rhyme, and word fragment norms

    Open Access•Douglas L Nelson, Cathy L McEvoy et al.•Behavior Research Methods,…•2004

  • To what extent do native and non-native writers make use of collocations?

    Philip Durrant, Norbert Schmitt•IRAL - International Review of…•2009

  • Equivalence of the Mediation, Confounding and Suppression Effect

    Open Access•David P Mackinnon, Jennifer L Krull et al.•Prevention Science•2000

  • Vocabulary Size and Use

    Berthold Laufer, Paul Nation•Applied Linguistics•1995

  • Lexical Diversity in Writing and Speaking Task Performances

    Guoxing Yu•Applied Linguistics•2010

  • Back to Basics

    Jeanine Treffers‐daller, Jeanine Treffers-Daller et al.•Applied Linguistics•2016

  • Using Native-Speaker Psycholinguistic Norms to Predict Lexical Proficiency and Development in Second-Language Production

    Open Access•Cynthia M Berger, Scott A Crossley et al.•Applied Linguistics•2019

  • Towards an Organic Approach to Investigating CAF in Instructed SLA

    John M Norris, Lourdes Ortega•Applied Linguistics•2009

  • Measuring Longitudinal Writing Development Using Indices of Syntactic Complexity and Sophistication

    Open Access•Kristopher Kyle, Scott A Crossley et al.•Studies in Second Language…•2021

  • Continuing to Explore the Multidimensional Nature of Lexical Sophistication

    Open Access•Masaki Eguchi, Kristopher Kyle•Modern Language Journal•2020

  • Vocd

    Open Access•Philip M McCarthy, Scott Jarvi et al.•Language Testing•2007

  • Assessing syntactic sophistication in L2 writing

    Open Access•Kristopher Kyle, Scott A Crossley et al.•Language Testing•2017

  • Predicting lexical proficiency in language learner texts using computational indices

    Open Access•Scott A Crossley, Tom Salsbury et al.•Language Testing•2011

  • Short texts, best-fitting curves and new measures of lexical diversity

    Open Access•Scott Jarvi, SCOTT JARVIS•Language Testing•2002

  • N-gram measures and L2 writing proficiency

    Open Access•James Garner, Scott A Crossley et al.•System•2018

  • Comparing count-based and band-based indices of word frequency

    Scott A Crossley, Tia Cobb et al.•System•2013

  • The phraseological dimension in interlanguage complexity research

    Open Access•Magali Paquot•Second language Research•2017

  • Rethinking the Word Frequency Effect

    Open Access•Scott A McDonald, Richard Shillcock et al.•Language and Speech•2001

  • Measuring L2 Lexical Growth Using Hypernymic Relationships

    Open Access•Scott A Crossley, Scott Crossley et al.•Language Learning•2009

Unique citing works7
Citations per year3,5
Citation span2024 - 2026 (3)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 7

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae