Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Making evaluative legal judgements

Law students’ experiences of criteria-based scoring and comparative judgement

Bibliographic Data

ID22419355
AuthorsKjetil Egelandsdal (0000-0003-2301-4563, University of Bergen, corresponding author), Guri Lindblad (University of Bergen), Eva Hartell (0000-0002-8889-2562, KTH Royal Institute of Technology), Jan-Ove Færstad (University of Bergen)
Year2026
Pages1-21
Publication date2026-06-25
Open AccessYes
TypeARTICLE
VenueAssessment in Education: Principles, Policy & Practice (JOURNAL)
Journal identifiersISSN: 0969-594X • E-ISSN: 1465-329X
PublisherInforma UK Limited (PUBLISHER • GB)
DOI10.1080/0969594x.2026.2692983
OpenAlexW7165911721
LanguageEN
References cited23

This study examines second-year law students’ experiences of evaluating administrative decisions across two successive course implementations. In 2023 (N=250), students were randomly assigned to either an Independent Scoring Format (ISF), where they rated individual decisions, or Comparative Judgement (CJ), where they compared pairs of decisions. Post-activity survey data, including open-ended responses, were analysed for both groups. In 2024 (N=270), Adaptive Comparative Judgement (ACJ) was introduced with a larger pool of decisions and structured written justifications. Ratings of perceived usefulness were positive, with no statistically significant differences between CJ and ISF. The qualitative analysis suggests that comparative formats supported learning through contrast and prioritisation, while ISF highlighted difficulties in applying overlapping criteria consistently to individual texts. ACJ made students’ grounds for preference more explicit, but also increased cognitive demand, underscoring the need for scaffolding and calibration. The findings inform the design of formative assessment for fostering evaluative judgement in legal education.

Clinical judgement · Cognition · Formative assessment · Judgement · Preference · Qualitative research · Legal Education and Practice Innovations · Legal Issues in Education · Student Assessment and Feedback

  • Developing evaluative judgement

    Open Access•Jeanne Tai, Joanna Tai et al.•Higher Education•2018

  • Developing the theory of formative assessment

    Open Access•Paul Black, Dylan Wiliam•Educational Assessment,…•2009

  • Formative assessment and the design of instructional systems

    Open Access•D Royce Sadler•Instructional Science•1989

  • The Complexity of Comparative Judgments in Assessing Argumentative Writing

    Open Access•Marijn Gijsen, Tine Van Daal et al.•Frontiers in Education•2021

  • Aligning assessment with long‐term learning

    David Boud, Nancy Falchikov•Assessment & Evaluation in Higher…•2006

  • Rethinking feedback practices in higher education

    David Nicol, Avril Thomson et al.•Assessment & Evaluation in Higher…•2014

  • Developing evaluative judgement for a time of generative artificial intelligence

    Open Access•Margaret Bearman, Jeanne Tai et al.•Assessment & Evaluation in Higher…•2024

  • Constructive guidance and feedback for learning

    Graham D Hendry, Nikki Bromberger et al.•Assessment & Evaluation in Higher…•2011

  • Exploring the practical feasibility of adaptive comparative judgment as a summative assessment method

    Open Access•Kjetil Egelandsdal, Eva Hartell et al.•Assessment & Evaluation in Higher…•2025

  • Indeterminacy in the use of preset criteria for assessment and grading

    D Royce Sadler•Assessment & Evaluation in Higher…•2009

  • The development of student feedback literacy

    David Carle, David Boud•Assessment & Evaluation in Higher…•2018

  • The Question of Comparison

    Open Access•Ida Petretta•The American Journal of…•2020

  • Using thematic analysis in psychology

    Open Access•Braun, Virginia Braun et al.•Qualitative Research in Psychology•2006

  • Formative assessment and self-regulated learning

    David J Nicol, David Nicol et al.•Studies in Higher Education•2006

Highly citedNo

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae