Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

A systematic review of educational online peer-review and assessment systems

Charting the landscape

Bibliographic Data

ID21618326
AuthorsDmytro Babik (0000-0001-6464-6028), Edward Gehringer, Jennifer Kidd (0000-0001-9800-1690), Kristine Sunday, David Tinapple (0000-0002-8493-0023), Steven Gilbert
Year2024
Volume72
Issue3
Pages1653-1689
Publication date2024-06-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueEducational Technology Research and Development (JOURNAL)
Journal identifiersISSN: 1042-1629 • E-ISSN: 1556-6501
PublisherSpringer Science and Business Media LLC (PUBLISHER)
DOI10.1007/s11423-024-10349-x
LanguageEN
Citations received1
References cited54

Over the past two decades, there has been an explosion of innovation in software tools that encapsulate and expand the capabilities of the widely used student peer assessment. While the affordances and pedagogical impacts of traditional in-person, “paper-and-pencil” peer assessment have been studied extensively and are relatively well understood, computerized (online) peer assessment introduced not only shifts in scalability and efficiency, but also entirely new capabilities and forms of social learning interactions, instructor leverage, and distributed cognition, that still need to be researched and systematized. Despite the ample research on traditional peer assessment and evidence of its efficacy, common vocabulary and shared understanding of online peer-assessment system design, including the variety of methods, techniques, and implementations, is still missing. We present key findings of a comprehensive survey based on a systematic research framework for examining and generalizing affordances and constraints of online peer-assessment systems. This framework (a) provides a foundation of a design-science metatheory of online peer assessment, (b) helps structure the discussion of user needs and design options, and (c) informs educators and system design practitioners. We identified two major themes in existing and potential research—orientation towards scaffolded learning vs. exploratory learning and system maturity. We also outlined an agenda for future studies

  • Systematic peer back-evaluation was associated with higher-quality feedback and stronger task performance than sampled teacher monitoring in an EFL translation course

    Open Access•Yimin Tong, Christian D Schunn et al.•International Journal of…•2026

  • Educational Design Research

    J J H van den Akker, Jan van den Akker et al.•Educational design research•2006

  • Trends in Peer Learning

    Open Access•Keith J Topping•Educational Psychology•2005

  • Quantitative studies of student self-assessment in higher education

    Open Access•David Boud, Nancy Falchikov•Higher Education•1989

  • Student Self-Assessment in Higher Education

    Open Access•Nancy Falchikov, David Boud•Review of Educational Research•1989

  • The Impact of Peer Assessment on Academic Performance

    Open Access•Kit S Double, Joshua A McGrane et al.•Educational Psychology Review•2020

  • The Impact of Self- and Peer-Grading on Student Learning

    Philip M Sadler, Philip Sadler et al.•Educational Assessment•2006

  • Grounded Theory and Organizational Research

    Open Access•Patricia Yancey Martin, Barry A Turner et al.•The Journal of Applied Behavioral…•1986

  • Online formative assessment in higher education

    Open Access•J W Gikandi, Joyce Gikandi et al.•Computers & Education•2011

  • Scaffolded writing and rewriting in the discipline

    Open Access•Kwangsu Cho, Christian D Schunn•Computers & Education•2007

  • Backward evaluation in peer assessment

    Open Access•Kamila Misiejuk, Barbara Wasson•Computers & Education•2021

  • Effect sizes and research directions of peer assessments

    Open Access•Ching‐Yi Chang, Ching-Yi Chang et al.•Computers & Education•2021

  • An inventory of peer assessment diversity

    Sarah Gielen, Filip Dochy et al.•Assessment & Evaluation in Higher…•2011

  • Does peer assessment promote student learning? A meta-analysis

    Hongli Li, Yao Xiong et al.•Assessment & Evaluation in Higher…•2020

  • Peer assessment in university teaching

    Ineke Van Den Berg, W F Admiraal et al.•Assessment & Evaluation in Higher…•2006

  • Many faces of the concept of culture (and education)

    Open Access•E Matusov, Ana Marjanovic-Shane•Culture & Psychology•2017

  • Intersubjectivity Without Agreement

    E Matusov•Mind Culture and Activity•1996

  • Accountability in peer assessment

    Melissa M Patchan, Christian D Schunn et al.•Studies in Higher Education•2018

  • Digital peer assessment in school teacher education and development

    Open Access•Keith J Topping•Research Papers in Education•2023

  • Transcending conventional credentialing and assessment paradigms with information-rich digital badges

    Carla Casilli, Daniel Hickey et al.•The Information Society•2016

  • The Diffusion of an Innovation Among Physicians

    James Coleman, J J Coleman et al.•Sociometry•1957

  • Peer Assessment Between Students in Colleges and Universities

    Open Access•Keith J Topping, Keith Topping•Review of Educational Research•1998

Unique citing works1
Citations per year1
Citation span2026 - 2026 (1)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 1

Tools

Open DOI
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae