Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

AI and human scoring for postgraduate writing

Evaluating score reliability, variability, and rater behaviours

Bibliographic Data

ID21067784
AuthorsTurgay Han (0000-0002-9196-0618, Ordu University, corresponding author), Ying Zheng (0000-0001-5060-8581, Institute of Linguistics)
Year2026
Volume88
Pages101572
Publication date2026-03-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueStudies In Educational Evaluation (JOURNAL)
Journal identifiersISSN: 0191-491X • E-ISSN: 1879-2529
PublisherElsevier BV (PUBLISHER)
DOI10.1016/j.stueduc.2026.101572
OpenAlexW7128636662
LanguageEN
References cited40

Educational assessment · Evaluation methods · Inter-rater reliability · Program evaluation · Psychometrics · Artificial Intelligence in Healthcare and Education · Expert finding and Q&A systems · Reliability and Agreement in Measurement

  • Students’ voices on generative AI

    Open Access•Cecilia K Y Chan, Wenjie Hu•International Journal of…•2023

  • Automated essay evaluation software in English Language Arts classrooms

    Open Access•Joshua Wilson, Amanda Czik•Computers & Education•2016

  • To resist it or to embrace it? Examining ChatGPT’s potential to support teacher feedback in EFL writing

    Open Access•Kai Guo, Deliang Wang•Education and Information…•2024

  • Exploring the potential of an AI-based Chatbot (ChatGPT) in enhancing English as a Foreign Language (EFL) teaching

    Open Access•Amr M Mohamed•Education and Information…•2024

  • Exploring the potential of using an AI language model for automated essay scoring

    Open Access•Atsushi Mizumoto, Masaki Eguchi•Research Methods in Applied…•2023

  • Using ChatGPT for second language writing

    Open Access•Jessie S Barrot•Assessing Writing•2023

  • The impact of automated writing evaluation on English as a foreign language learners' writing self‐efficacy, self‐regulation, anxiety, and performance

    Open Access•Elif Sari, Elif Sarı et al.•Journal of Computer Assisted…•2024

  • Do experience and text quality matter for raters’ decision-making behaviors

    Open Access•Özgür Şahan, Salim Razı•Language Testing•2020

  • Rater types in writing performance assessments

    Open Access•Thomas Eckes•Language Testing•2008

  • The development and maintenance of rating quality in performance writing assessment

    Open Access•Gad S Lim•Language Testing•2011

  • The influence of rater language background on writing performance assessment

    Open Access•Jeff S Johnson, Gad S Lim•Language Testing•2009

  • Can ChatGPT effectively complement teacher assessment of undergraduate students’ academic writing

    Qi Lu, Y Yao et al.•Assessment & Evaluation in Higher…•2024

  • Hello GPT! Goodbye home examination? An exploratory study of AI chatbots impact on university teachers’ assessment practices

    Open Access•Alexandra Farazouli, Teresa Cerratto Pargman et al.•Assessment & Evaluation in Higher…•2024

  • Teachers in automated writing evaluation (AWE) system-supported ESL writing classes

    Open Access•Zhi Li•System•2021

  • Do English and ESL Faculties Rate Writing Samples Differently

    James Dean Brown•TESOL Quarterly•1991

  • Artificial Intelligence-Generated and Human Expert-Designed Vocabulary Tests

    Open Access•Luo Yunjiu, Wei et al.•SAGE Open•2022

Citation velocityhistorical
Highly citedNo

Tools

Open DOI
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae