Reliability and the ACTFL Oral Proficiency Interview
Reporting Indices of Interrater Consistency and Agreement for 19 Languages
Bibliographic Data
| ID | 8935929 |
|---|---|
| Authors | Eric A Surface (0000-0002-6468-1162, corresponding author), Erich C Dierdorff (0000-0001-8929-7653, DePaul University) |
| Year | 2003 |
| Volume | 36 |
| Issue | 4 |
| Pages | 507-519 |
| Publication date | 2003-12-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Foreign Language Annals (JOURNAL) |
| Journal identifiers | ISSN: 0015-718X • E-ISSN: 1944-9720 |
| Publisher | Wiley (PUBLISHER • GB) |
| DOI | 10.1111/j.1944-9720.2003.tb02140.x |
| OpenAlex | W2086799285 |
| Language | EN |
| Citations received | 19 |
| References cited | 11 |
The reliability of the ACTFL Oral Proficiency Interview (OPI) has not been reported since ACTFL revised its speaking proficiency guidelines in 1999. Reliability data for assessments should be reported periodically to provide users with enough information to evaluate the psychometric characteristics of the assessment. This study provided the most comprehensive analysis of ACTFL OPI reliability to date, reporting interrater consistency and agreement data for 19 different languages. Overall, the interrater reliability of the ACTFL OPI was found to be very high. These results demonstrate the importance of using an OPI assessment program that has a well‐designed interview process, a well‐articulated set of criteria for proficiency determination, a solid rater training program, and an experienced cadre of testers. Based on the data reported, educators and employers who use the ACTFL OPI can expect reliable results and use the scores generated from the testing process with increased confidence. Recommendations for future research are discussed
Consistency (knowledge bases · Developmental psychology · Inter-rater reliability · Internal consistency · Language proficiency · Mathematics education · Psychometrics · Rating scale · Reliability (semiconductor · Artificial Intelligence · Clinical Psychology · Computer Science · EFL/ESL Teaching and Learning · Hearing Impairment and Communication · Psychology
Lexico-syntactic complexity and accuracy in heritage language learners at different proficiency levels
Language Proficiency Testing for Teachers
Do I belong?
Charting the development of second language proficiency and intercultural competence in postsecondary education
Writing Proficiency Development of Spanish Heritage Language Learners
Oral Proficiency Assessment
Foreign language enjoyment overcomes anxiety and boredom to boost oral proficiency in the first year of English foreign language learning
A Comparative Discourse Analysis of Spanish Past Narrations From the ACTFL OPI and OPIc
Empirical Validation of Reading Proficiency Guidelines
Assessing Students' Oral Proficiency
Comparing the OPI and the OPIc
Assisted self‐assessment to optimize the OPIc test experience
The presence and absence of race in world language education literature
Understanding Intermediate-Level Speakers’ Strengths and Weaknesses
ACTFL Chinese reading proficiency guidelines
Oral Proficiency Standards and Foreign Language Teacher Candidates
A Rationale for Criterion‐Referenced Proficiency Testing
The Development of Oral Proficiency During a Semester in Germany
Language Use in Six Study Abroad Programs
Research on the comparability of the oral proficiency interview and the simulated oral proficiency interview
An Investigation of the Construct Validity of the ACTFL Proficiency Guidelines and Oral Interview Procedure
Foreign Language Proficiency Levels Attained by Language Majors Near Graduation from College
ACTFL Proficiency Guidelines—Speaking
Assessing Speaking Proficiency in the Undergraduate Curriculum
A Study of Interrater Reliability of the ACTFL Oral Proficiency Interview in Five European Languages
The Construct Validation of the Fsi Oral Interview1
Tests for comparing elements of a correlation matrix
Comparing correlated correlation coefficients
| Unique citing works | 19 |
|---|---|
| Citations per year | 1 |
| Citation span | 2007 - 2026 (20) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 18 |