Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Students' voices in the evaluation of their written summaries

Empowerment and democracy for test takers

Bibliographic Data

ID19380143
AuthorsGuoxing Yu (0000-0001-5997-2734, University of Bristol, corresponding author), Guoxing Yu Guoxing Yu (University of Bristol)
Year2007
Volume24
Issue4
Pages539-572
Publication date2007-10-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueLanguage Testing (JOURNAL)
Journal identifiersISSN: 0265-5322 • E-ISSN: 1477-0946
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1177/0265532207080780
OpenAlexW2016753351
LanguageEN
Citations received10
References cited47

Two kinds of scoring templates were empirically derived from summaries written by experts and students to evaluate the quality of summaries written by the students. This paper reports students' attitudes towards the use of the two templates and its differential statistical effects on the judgment of students' summarization performance. It was found that a summary consistently received higher scores when judged by the popular template, regardless of the language and the language order (English then Chinese or Chinese then English) in which a summary was produced. However, the scores from the expert template were slightly better predictors of students' reading abilities as measured by FCE and TOEFL. The majority of the students strongly preferred the expert template. Their arguments centered mainly on the differences between students and experts in their language abilities and experience, their stereotypical status in educational assessment, and the dialectical interpretations of `quantity' and `quality'. Implications of these findings are discussed with specific reference to the value of involving test-takers in assessment criteria development

Automatic summarization · Language assessment · Language proficiency · Linguistics · Mathematics education · Natural language processing · Test of English as a Foreign Language · Computer Science · Discourse Analysis in Language Studies · EFL/ESL Teaching and Learning · Multilingual Education and Policy · Psychology

  • Competing interests of stakeholders in a policy-driven test

    Open Access•Yan Jin, Guoxing Yu•Oxford Review of Education•2025

  • Translanguaging to enhance reading comprehension among first-year medical students

    Open Access•Vimbai Mbirimi-Hungwe•Translation and Translanguaging…•2022

  • Testing via news videos

    Open Access•Jing Zhang, Zhang Jing•International Journal of Applied…•2010

  • The influence of summary writing on the development of reading skills in a foreign language

    Open Access•Małgorzata Marzec-Stawiarska•System•2016

  • A Study of the EFL Writing of Chinese Learners

    Bin Ai•Changing English•2015

  • Self-evaluation of rater bias in written composition assessment

    Open Access•Cvetka Sokolov•Linguistica•2014

  • Examining the consistency of instructor versus large language model ratings on summary content

    Open Access•Yasuyo Sawaki, Yutaka Ishii et al.•Language Testing•2025

  • Test-taker insights for language assessment policies and practices

    Open Access•Yan Jin•Language Testing•2023

  • Reading to summarize in English and Chinese

    Open Access•Guoxing Yu, Guoxing Yu Guoxing Yu•Language Testing•2008

  • Investigating the validity of an integrated listening-speaking task

    Open Access•Kellie Frost, Catherine Elder et al.•Language Testing•2012

  • Applied Multivariate Statistics for the Social Sciences

    James P Stevens•Applied Multivariate Statistics…•2012

  • Statistical Power Analysis for the Behavioral Sciences

    Jacob Cohen•Statistical Power Analysis for…•2013

  • Communities of Practice

    Open Access•Etienne Wenger•Communities of Practice•1998

  • Toward a model of text comprehension and production.

    Walter Kintsch, T A Van Dijk•Psychological Review•1978

  • An Analysis of Summary Protocols of University ESL Students

    Alana Johns, A M JOHNS et al.•Applied Linguistics•1990

  • Cross-cultural Differences and Perceived Quality in Written Paraphrases of English Expository Prose

    Ulla Connor, Peter Mccagg•Applied Linguistics•1983

  • 'Naive' native speakers and judgements of oral proficiency in Spanish

    Open Access•David Barnwell•Language Testing•1989

  • Method effects on reading comprehension test performance

    Open Access•Miyoko Kobayashi•Language Testing•2002

  • Calibrating graded assessments

    Open Access•Alastair Pollitt, Carolyn Hutchinson•Language Testing•1987

  • Modified scoring, traditional item analysis and Sato's caution index used to investigate the reading recall protocol

    Open Access•Craig Deville, Micheline Chalhoub‐deville et al.•Language Testing•1993

  • Analysis of native speaker performance on a cloze test

    Open Access•Robert Lado•Language Testing•1986

  • Native- and nonnative-speaking EFL teachers’ evaluation of Chinese students’ English writing

    Open Access•Ling Shi•Language Testing•2001

  • Does the testing method make a difference? The case of reading comprehension

    Open Access•Elana Shohamy•Language Testing•1984

  • Examining validity in a performance test

    Open Access•Mary Lee Scott, Charles W Stansfield et al.•Language Testing•1996

  • Testing meaning construction

    Open Access•Gissi Sarig•Language Testing•1989

  • Language assessment as social practice

    Open Access•Tim Mcnamara•Language Testing•2001

  • Doctors’ orders for language testers

    Open Access•Kimberly Boyd, Kenneth Boyd et al.•Language Testing•2002

  • Language for Specific Purposes assessment criteria

    Open Access•Dan Douglas•Language Testing•2001

  • A comparison of recall and summary protocols as measures of second language reading comprehension

    Open Access•Gail L Riley, James F Lee•Language Testing•1996

  • Summary Writing

    Léonard P Rivard•Language Culture and Curriculum•2001

  • Teaching reading skills in a foreign language

    Open Access•Sherwood Bruce Arne•System•1984

  • Procedural text

    Carol Bergfeld Mills, Virginia A Diehl et al.•Discourse Processes•1993

  • Rating Scales Derived from Student Samples

    Carolyn E Turner, John A Upshur•TESOL Quarterly•2002

  • Strategic Difficulties in Summarizing Texts

    Peter Winograd, Peter N Winograd•Reading Research Quarterly•1984

  • Using Think‐Alouds to Examine Reader‐Text Interest

    Open Access•Suzanne E Wade, William M Buxton et al.•Reading Research Quarterly•1999

  • Direct Instruction of Summarization Skills

    Victoria Chou Hare, Kathleen M Borchardt•Reading Research Quarterly•1984

  • The Influence of Prior Knowledge on Expert Readers' Main Idea Construction Strategies

    Peter Afflerbach, Peter P Afflerbach•Reading Research Quarterly•1990

  • Learning to Learn

    Open Access•Ann L Brown, Joseph C Campione et al.•Educational Researcher•1981

  • Summary Protocols of "Underprepared" and "Adept" University Students

    Open Access•Ann M Johns•Language Learning•1985

  • The organization of prose and its effects on memory

    Open Access•William A Smalley•Lingua•1976

  • TheNative Speaker

    Alan Davies•The Native Speaker•2003

  • Post-Modernism and the Social Sciences

    Pauline Marie Rosenau•Post-Modernism and the Social…•1992

  • Teaching English as Communication

    Open Access•Sandra J Savignon•World Englishes•2003

Unique citing works10
Citations per year0.56
Citation span2008 - 2025 (18)
Citation velocityrecent
Highly citedNo
Citation typesNeutral: 10

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae