Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Can We Predict Task Difficulty in an Oral Proficiency Test? Exploring the Potential of an Information-Processing Approach to Task Design

Bibliographic Data

ID4501749
AuthorsNoriko Iwashita (0000-0002-1402-7365, The University of Melbourne), Tim Mcnamara (0000-0001-7044-799X, The University of Melbourne), Catherine Elder (0000-0002-3808-2895, University of Auckland)
Year2001
Volume51
Issue3
Pages401-436
Publication date2001-09-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueLanguage Learning (JOURNAL)
Journal identifiersISSN: 0023-8333 • E-ISSN: 1467-9922
PublisherWiley (PUBLISHER • GB)
DOI10.1111/0023-8333.00160
OpenAlexW2036213814
LanguageEN
Citations received44
References cited16

This study addresses the following question: Are different task characteristics and performance conditions (involving assumed different levels of cognitive demand) associated with different levels of fluency, complexity, or accuracy in test candidate responses? The materials for the were a series of narrative tasks involving a picture stimulus; the participants were 193 pre-university students taking English courses. We varied the conditions for tasks in each dimension and measured the impact of these factors on task performance with both familiar detailed discourse measures and specially constructed rating scales, analyzed using Rasch methods. We found that task performance conditions in each dimension failed to influence task difficulty and task performance as expected. We discuss implications for the design of speaking assessments and broader research

Cognition · Cognitive psychology · Developmental psychology · Dimension (graph theory) · Fluency · Linguistics · Mathematics education · Narrative · Rasch model · Task (project management) · Task Analysis · Test (biology) · Educational and Psychological Assessments · EFL/ESL Teaching and Learning · Psychology · Second Language Acquisition and Learning

  • Prompt effects on assessment of interactional competence in a group oral test

    Open Access•Zhouyang Lv•International Journal of Applied…•2024

  • Working memory capacity and L2 speech production in a picture description task with repetition

    Open Access•Kyria Rebeca Finardi, Kyria Finardi•Revista de Estudos da Linguagem•2008

  • O papel desempenhado pelo tipo de tarefa e pela ortografia na produção de consoantes em final de palavra

    Open Access•Rosane Silveira•Revista de Estudos da Linguagem•2007

  • Cognitive Complexity and Task Sequencing

    Peter Robinson•IRAL - International Review of…•2005

  • Assessed Levels of Second Language Speaking Proficiency

    Noriko Iwashita, Annie Brown et al.•Applied Linguistics•2007

  • Task-Based Language Teaching

    Open Access•Rod Ellis, Peter Skehan et al.•Task-Based Language Teaching•2019

  • Defining and operationalising L2 complexity

    Bram Bulté, Alex Housen•Dimensions of L2 performance and…•2012

  • Measuring Implicit and Explicit Knowledge of a Second Language

    Rod Ellis•Studies in Second Language…•2005

  • Cognitive task complexity and written output in Italian and French as a foreign language

    Open Access•Folkert Kuiken, Ineke Vedder•Journal of Second Language Writing•2008

  • Task complexity and linguistic and discourse features of narrative writing performance

    Open Access•Judit Kormos•Journal of Second Language Writing•2011

  • Modelling Learning Difficulty and Second Language Proficiency

    Rod Ellis•Applied Linguistics•2006

  • Towards an Organic Approach to Investigating CAF in Instructed SLA

    John M Norris, Lourdes Ortega•Applied Linguistics•2009

  • Question -Response in Online Synchronous Videoconferencing Class

    Open Access•Obaida Chaqmaqchee, Shamala Paramasivam•International Journal of…•2021

  • English Language Anxiety and Language Achievement Among EFL Students in Saudi Arabia

    Open Access•Oun Almesaar•Theory and Practice in Language…•2022

  • The path to professionalism

    Open Access•Ute Knoch, Catherine Elder•Australian Review of Applied…•2025

  • Syntactic complexity at multiple proficiency levels of L2 German speech

    Open Access•Colleen Neary-Sundquist, Colleen A Neary‐Sundquist•International Journal of Applied…•2016

  • The interplay of task complexity (± Here-and-Now) and proficiency in shaping written narratives in Spanish as a foreign language

    Open Access•Laura Sanchez, Laura Picazo Sánchez et al.•System•2022

  • The effects of task complexity on learner–learner interaction

    Open Access•Youjin Kim•System•2009

  • Assessing L2 task performance

    Open Access•Parvaneh Tavakoli•System•2009

  • Interactional competence in paired speaking tests

    Open Access•Esma Kot, Esma Kot Artunç et al.•System•2019

  • Test-task Authenticity

    Zhenkun Gan, Zhengdong Gan•Changing English•2012

  • Young learners’ response processes when taking computerized tasks for speaking assessment

    Open Access•Shinhye Lee, Paula Winke•Language Testing•2018

  • Speaking proficiency of young language students

    Open Access•Ching‐Ni Hsieh, Ching-Ni Hsieh et al.•Language Testing•2019

  • Estimating the difficulty of oral proficiency tasks

    Open Access•Catherine Elder, Noriko Iwashita et al.•Language Testing•2002

  • Removing bias towards World Englishes

    Open Access•Tammy Huei-Lien Hsu•Language Testing•2016

  • Judgments of oral proficiency by non-native and native English speaking teacher raters

    Open Access•Ying Zhang, Ying Zhang Ying Zhang et al.•Language Testing•2011

  • Effects of test-taker characteristics and the number of participants in group oral tests

    Open Access•Fumiyo Nakatsuhara•Language Testing•2011

  • Dimensionality of speech fluency

    Open Access•Xun Yan, Ha Ram Kim et al.•Language Testing•2021

  • Do visual chunks and planning impact performance on the graph description task in the SPEAK exam

    Open Access•Xiaoming Xi•Language Testing•2005

  • The effect of test-taker gender, audience and topic on task performance in tape-mediated assessment of speaking

    Open Access•Tom Lumley, Barry O’Sullivan•Language Testing•2005

  • Speaking task design and complexity and fluency features of adolescent English learners

    Open Access•Mark Chapman, Meg Montee et al.•Language Testing•2026

  • A multifaceted approach to investigating pre-task planning effects on paired oral test performance

    Open Access•Ryo Nitta, Fumiyo Nakatsuhara•Language Testing•2014

  • Is anybody listening? The nature of second language listening in integrated listening-to-summarize tasks

    Open Access•Anchana Rukthong, Tineke Brunfaut•Language Testing•2020

  • Aspects of performance on line graph description tasks

    Open Access•Xiaoming Xi, Xiaoming Xi Xiaoming Xi•Language Testing•2010

  • Task difficulty in speaking tests

    Open Access•Glenn Fulcher, Rosina Márquez Reiter•Language Testing•2003

  • Establishing test form and individual task comparability

    Open Access•Cyril J Weir, Jessica R W Wu•Language Testing•2006

  • The impact of pre-task planning on speaking test performance for English-medium university admission

    Open Access•Stefan O'Grady, Stefan O’Grady•Language Testing•2019

  • Understanding test-takers’ perceptions of difficulty in EAP vocabulary tests

    Open Access•Nesrin Oruc Erturk, Simon E Mumford•Language Testing•2017

  • Effects of task repetition on L2 oral performance

    Open Access•Kyria Rebeca Finardi•Trabalhos em Linguística Aplicada•2008

  • Native Speakers and Task Performance

    Open Access•Pamela Foster, Pauline Foster et al.•Language Learning•2009

  • The Role of Task Complexity, Modality, and Aptitude in Narrative Task Performance

    Open Access•Judit Kormos, Anna Trebits•Language Learning•2012

  • Task Design and Second Language Performance

    Open Access•Parvaneh Tavakoli, Pamela Foster et al.•Language Learning•2011

  • Assessing Spoken EFL Without a Common Rating Scale

    Open Access•Henrik Bøhn•SAGE Open•2015

  • The Cognition Hypothesis

    Open Access•Daniel O Jackson, Sakol Suethanapornkul•Language Learning•2013

  • A Cognitive Approach to Language Learning (Oxford Applied Linguistics)

    Peter Skehan•A Cognitive Approach to Language…•1998

  • Task type and task processing conditions as influences on foreign language performance

    Open Access•Peter Skehan, Pamela Foster et al.•Language Teaching Research•1997

  • The Effects of Different Lengths of Time for Planning on Second Language Performance

    Open Access•Uta Mehnert•Studies in Second Language…•1998

  • Planning and Interlanguage Variation

    Open Access•Graham Crookes•Studies in Second Language…•1989

  • The Influence of Planning and Task Type on Second Language Performance

    Open Access•Pamela Foster, Pauline Foster et al.•Studies in Second Language…•1996

  • Planning and Focus on Form in L2 Oral Performance

    Open Access•Lourdes Ortega•Studies in Second Language…•1999

  • Interlanguage Variability in Narrative Discourse

    Open Access•Rod Ellis•Studies in Second Language…•1987

  • Measuring spoken language

    Pamela Foster•Applied Linguistics•2000

  • A Framework for the Implementation of Task-based Instruction

    Peter Skehan•Applied Linguistics•1996

  • Task complexity, task difficulty, and task production

    Peter Robinson•Applied Linguistics•2001

  • An investigation of planning time and proficiency level on oral test discourse

    Open Access•Gillian Wigglesworth•Language Testing•1997

  • The role of video media in listening assessment

    Open Access•Paul Gruba•System•1997

  • Topic and Feedback in Native-Speaker/Nonnative-Speaker Conversation

    Graham Crookes, Kathryn A Rulon•TESOL Quarterly•1988

  • Task Complexity and Second Language Narrative Discourse

    Open Access•Peter Robinson•Language Learning•1995

  • The Influence of Task Structure and Processing Conditions on Narrative Retellings

    Open Access•Peter Skehan, Pamela Foster et al.•Language Learning•1999

  • Research on Negotiation

    Open Access•Teresa Pica•Language Learning•1994

Unique citing works44
Citations per year1,83
Citation span2002 - 2026 (25)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 40

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae