On the reliability of grammaticality judgement tests in second language acquisition research

The use of grammaticality and metalinguistic judgement tests in second language acquisition (SLA) research has been the subject of considerable scrutiny over the past decade (see, for example, Chaudron, 1983; Birdsong, 1989; Ellis, 1991; Cowan and Hatasa, 1994; Gass, 1994; Davies and Kaplan, 1998).Grammaticality judgement (GJ) test data in research design are used to make inferences about the syntactic structures and rules that constitute learners’ linguistic competence, in the Chomskian sense of the word. One criticism levelled at the use of this type of test, however, is that they are not reliable measures of linguistic competence. The present study compared GJ test data with dehydrated sentence (DS) test data, an assessment tool commonly used in the L2 (second language) classroom. Data were collected from three levels (second, fourth and sixth semester) of adult L2 learners of Spanish about verb movement (Vmovement). The results from the comparison of the two tests indicated that GJ data are reliable measures of linguistic knowledge

Competence (human resources · Grammar · Grammaticality · Judgement · Linguistic competence · Linguistics · Second-language acquisition · Sentence · Test (biology · Verb · EFL/ESL Teaching and Learning · Psychology · Second Language Acquisition and Learning · Syntax, Semantics, Linguistic Variation

• Language Aptitude in First Language Attrition

  Emanuel Bylund, Pedro Ramírez-Galan•Applied Linguistics•2016

  Incluir item

• Grammaticality representation in ChatGPT as compared to linguists and laypeople

  Open Access•Zhuang Qiu, Xufeng Duan et al.•Humanities and Social Sciences…•2025

  Incluir item

• Crosslinguistic influence at the syntax proper

  Open Access•Alejandro Cuza•International Journal of…•2013

  Incluir item

• Evidence of V to I raising in L2 Spanish

  Open Access•Pedro Guijarro-Fuentes, María Pilar Larrañaga et al.•International Journal of…•2011

  Incluir item

• Literacy within a language affects bilinguals’ spoken language processing

  Elena Nicoladis, Pui Ting Chan•International Journal of…•2022

  Incluir item

• Interpreting resultative sentences in German

  Open Access•Michael Richter, Roeland Van Hout•Linguistics•2013

  Incluir item

• Chinese EFL Students’ Awareness of English Epicene Pronouns

  Open Access•Hengwen Yang, Xiufeng Zhang•SAGE Open•2024

  Incluir item

• Frequency Effects in Language Processing

  Open Access•Nick C Ellis•Studies in Second Language…•2002

  Incluir item

• Sentence matching

  Open Access•Susan M Ga, Susan M Gass•Second language Research•2001

  Incluir item

• Exploring second language learners’ grammaticality judgment performance in relation to task design features

  Open Access•Li-Ju Shiu, Şebnem Yalçın et al.•System•2018

  Incluir item

• A systems model of L2 listening comprehension

  Open Access•Hamid Mahdian Rad, Sasan Baleghizadeh•System•2025

  Incluir item

• Performance consistency in second language acquisition and language testing research

  Open Access•Dan Douglas•Second language Research•2001

  Incluir item

• Object pronouns in German L3 syntax

  Open Access•Ylva Falk, Camilla Bardel•Second language Research•2010

  Incluir item

• Russian speakers’ L2 Chinese acquisition of wh -topicalization at the syntax–discourse interface

  Open Access•Esuna Dugarova•Second language Research•2014

  Incluir item

• Weighing the benefits of studying a foreign language at a younger starting age in a minimal input situation

  Open Access•Jenifer Larson‐hall, Jenifer Larson-Hall•Second language Research•2008

  Incluir item

• On the role of experience and age-related effects

  Open Access•Alejandro Cuza, Joshua Frank•Second language Research•2014

  Incluir item

• Learner Accuracy and Learner Performance

  Open Access•Janet Renou, Janet M Renou•Foreign Language Annals•2000

  Incluir item

• Zero Relative in African American English

  Walter Sistrunk•American Speech•2022

  Incluir item

• Processing Instruction and a Role for Output in Second Language Acquisition

  Open Access•Paul D Toth•Language Learning•2006

  Incluir item

• The Definition and Measurement of L2 Explicit Knowledge

  Open Access•Rod Ellis•Language Learning•2004

  Incluir item

• What native speaker judgments tell us about the grammaticalization of a progressive aspectual marker in Dutch

  Open Access•Monique Flecken•Linguistics•2011

  Incluir item

• On Explicit and Negative Data Effecting and Affecting Competence and Linguistic Behavior

  Open Access•Bonnie D Schwartz•Studies in Second Language…•1993

  Incluir item

• Georgetown University Round Table on Languages and Linguistics (Gurt) 2001

  Open Access•Deborah Tannen, James E Alatis•Georgetown University Round Table…•2003

  Incluir item

• Lectures on Government and Binding

  Noam Chomsky•Lectures on Government and Binding•1993

  Incluir item

• Native Speaker vs. L2 Learner Grammaticality Judgements

  W D Davies, Tami Kaplan et al.•Applied Linguistics•1998

  Incluir item

• Long and Short Verb Movement in Second Language Acquisition

  Open Access•Lydia White•The Canadian Journal of…•1992

  Incluir item

• Research on Metalinguistic Judgments

  Open Access•Craig Chraudron•Language Learning•1983

  Incluir item

• Universal Grammar and the acquisition of French verb movement by native speakers of English

  Open Access•Roger Hawkins, Richard Towell et al.•Second language Research•1993

  Incluir item

• V-movement and the licensing of argumental Wh-phrases in Spanish

  Open Access•Margarita Suner•Natural Language and Linguistic…•1994

  Incluir item

• L2 cognitive states and the Full Transfer/Full Access model

  Open Access•Bonnie D Schwartz, Rex A Sprouse•Second language Research•1996

  Incluir item

• The "Pro-drop" Parameter in Adult Second Language Acquisition

  Open Access•Lydia White•Language Learning•1985

  Incluir item