Probing the Internal Validity of the LLAMA Language Aptitude Tests
Bibliographic Data
| ID | 4501729 |
|---|---|
| Authors | Lars Bokander (0000-0002-9857-5878, Linnaeus University, corresponding author), Emanuel Bylund (0000-0001-5203-9175, Stellenbosch University) |
| Year | 2020 |
| Volume | 70 |
| Issue | 1 |
| Pages | 11-47 |
| Publication date | 2020-03-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Language Learning (JOURNAL) |
| Journal identifiers | ISSN: 0023-8333 • E-ISSN: 1467-9922 |
| Publisher | Wiley (PUBLISHER • GB) |
| DOI | 10.1111/lang.12368 |
| OpenAlex | W2964210328 |
| Language | EN |
| Citations received | 28 |
| References cited | 61 |
Over the past decade, the LLAMA language aptitude test battery has come to play an increasingly important role as an instrument in research on individual differences in language development. However, a potentially serious problem that has been pointed out by several scholars is that the LLAMA has not yet been carefully validated. We addressed this issue by examining the internal validity of this test battery. We collected LLAMA data from 350 participants and assessed these data using classical item analysis, Rasch analysis, and principal component analysis within a framework of best practices in educational and psychological test validation. The results show that only one out of the four subtests (LLAMA B) produced scores that fit a latent trait model with sufficient accuracy. This suggests that researchers using the LLAMA battery must treat their results with appropriate carefulness and also that there is potential for refining the LLAMA further
Aptitude · Cognitive psychology · Developmental psychology · Psychometrics · Rasch model · Test (biology) · Test validity · Trait · Computer Science · EFL/ESL Teaching and Learning · Language Development and Disorders · Psychology · Reading and Literacy Development
The role of MLAT subtests in predicting L2 achievement
Detangling experiential, cognitive, and sociopsychological individual differences in second language speech learning
An fMRI validation study of the word-monitoring task as a measure of implicit knowledge
Probing the Construct Validity of Llama_d as a Measure of Implicit Learning Aptitude
The interplay of mindsets, aptitude, grit, and language achievement
Assessing accent anxiety
Language aptitudes and VOT development of L3 Spanish stops in Chinese-English bilinguals
Exploring Syntactic Priming as a Measure of Implicit Language Aptitude
Why Is the Componential Construct of Implicit Language Aptitude So Difficult to Capture
Scrutinizing LLAMA D as a measure of implicit learning aptitude
The role of individual learner differences in explicit language instruction
The Hare and the Tortoise
What Really Drives Language Learning Success
The role of language aptitude probed within extensive instruction experience
The roles of aptitude and working memory in L2 learners’ processing and incidental learning of technical vocabulary during video-lecture-based tasks
Effects of Declarative and Procedural Memory in the Development of Grammatical Structures
Exploring the benefits of translanguaging pedagogies on secondary-school students’ metalinguistic awareness
What factors predict perceived nativelikeness in long-term L2 users
Developing internet-based Tests of Aptitude for Language Learning (Tall)
A Context-Aligned Two Thousand Test
Domain‐General Auditory Processing Partially Explains Second Language Speech Learning in Classroom Settings
A Comparison of Pinyin Invented Spelling and Oddity Test in Measuring Phonological Awareness in L2 Learners of Chinese
The effect of form presentation mode and language learning aptitude on the learning burden and decay of L2 vocabulary knowledge
Cognitive and Sociopsychological Individual Differences, Experience, and Naturalistic Second Language Speech Learning
The Roles of Recasts, Task Complexity, and Aptitude in Child Second Language Development
Measuring Foreign Language Students' Self-Determination
Examining Second Language Listening and Metacognitive Awareness
Background Characteristics and Oral Proficiency Development Over Time in Lower-Division College Foreign Language Programs
Statistical Analyses for Language Assessment
Protocol Analysis
Applying the Rasch Model
Item Response Theory
Attentional requirements of learning
Implicit and Explicit Learning
The Construct Validity of Language Aptitude
Theoretical and Empirical Issues in the Study of Implicit and Explicit Second-Language Learning
The bell curve
Relative Effects of Explicit and Implicit Feedback
Language Aptitude and Long-term Achievement in Early Childhood L2 Learners
The Role of Language Aptitude in First Language Attrition
Improving Data Analysis in Second Language Acquisition by Utilizing Modern Developments in Applied Statistics
Language Aptitude in First Language Attrition
The relationship between aptitude and working memory
Cultures de production, de distribution et de consommation en milieu urbain en Angleterre, 1100-1350
Age of onset, length of residence, language aptitude, and ultimate L2 attainment in three linguistic domains
Foreign language aptitude theory
A Cognitive Approach to Language Learning
Educational Measurement
The Robustness of Aptitude Effects in Near-Native Second Language Acquisition
On Bilingual Aptitude for Learning New Languages
Improving the Validity of Quantitative Measures in Applied Linguistics Research1
Hi-Lab
Individual Differences in Sequence Learning Ability and Second Language Acquisition in Early Childhood and Adulthood
Effects of Sound, Vocabulary, and Grammar Learning Aptitude on Adult Second Language Speech Attainment in Foreign Language Classrooms
The Structural Connectivity Underpinning Language Aptitude, Working Memory, and IQ in the Perisylvian Language Network
An argument-based approach to validity
| Unique citing works | 28 |
|---|---|
| Citations per year | 4,67 |
| Citation span | 2020 - 2026 (7) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 28 |