Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Envisioning the Future of Creative Thinking Assessment

Bibliographic Data

ID7170780
AuthorsMathias Benedek (0000-0001-6258-4476, University of Graz Austria, corresponding author), Roger E Beaty (0000-0001-6114-5973, Penn State University USA)
Year2025
Volume59
Issue2
Publication date2025-06-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueThe Journal of Creative Behavior (JOURNAL)
Journal identifiersISSN: 0022-0175 • E-ISSN: 2162-6057
PublisherWiley (PUBLISHER • GB)
DOI10.1002/jocb.70036
OpenAlexW4410838120
LanguageEN
Citations received7
References cited42

The PISA assessment 2022 of creative thinking was a moonshot effort that introduced significant advancements over existing creativity tests, including a broad range of domains (written, visual, social, and scientific), implementation in many languages, and sophisticated scoring methods. PISA 2022 demonstrated the general feasibility of assessing creative thinking ability comprehensively at an international scale. However, the complexity of its assessment approach—such as time‐consuming scoring requiring human raters—implies the risk that it may not be easily applied by the scientific community and practitioners. In this commentary, we outline important next steps building on the PISA assessment to further enhance future assessments of creative thinking. Crucial future directions include 1) determining what tasks and scorings ensure high psychometric quality including content validity, 2) enabling efficient, objective scoring by applying AI methods such as Large Language Models (LLMs), 3) ensuring high language accessibility via multilingual tests, 4) targeting a broader age group, and 5) facilitating standardized, reproducible assessments via an open online testing platform. In sum, these developments would lead to an efficient, validated multilingual test of creative thinking, which enhances the accessibility of effective creative thinking assessments and thereby supports the democratization and reproducibility of creativity research

Engineering ethics · Management science · Creativity in Education and Neuroscience · Educational Methods and Teacher Development · Engineering · Neuroscience, Education and Cognitive Function · Psychology

  • Solving the paradox between the generalized partial credit model and Pisa’s rating instructions

    Open Access•Nils Myszkowski, Martin Storme•Thinking Skills and Creativity•2026

  • Using machine learning techniques for evaluating creativity in Graphic Combination Task (GCT) among Chinese college students

    Open Access•Yushan Xiao, Yuan Li et al.•Thinking Skills and Creativity•2026

  • Cross-cultural differential item functioning in the Pisa 2022 creative thinking assessment

    Open Access•Jiayi Cen, Christian Bokhove et al.•Thinking Skills and Creativity•2026

  • Investigating the Validity Evidence of Automated Scoring Methods for Divergent Thinking Assessments

    Open Access•Janika Saretzki, Mathias Benedek•Creativity Research Journal•2026

  • Creative Cognition

    Open Access•Wendy Ross, Sergio Agnoli et al.•The Journal of Creative Behavior•2026

  • Commentary

    Open Access•Margaret Mangion, Leonie Baldacchino•The Journal of Creative Behavior•2025

  • AI‐Powered Scoring for Creative Thinking

    Open Access•Ricardo Primi, Roger E Beaty et al.•The Journal of Creative Behavior•2026

  • Pisa 2022 Assessment and Analytical Framework

    OECD OECD•Pisa 2022 Assessment and…•2023

  • Cultural bias and cultural alignment of large language models

    Open Access•Yan Tao, Olga Viberg et al.•PNAS Nexus•2024

  • Are creative ideas novel and useful?

    Jennifer Diedrich, Mathias Benedek et al.•Psychology of Aesthetics…•2015

  • Beyond semantic distance

    Open Access•Peter Organisciak, Acar et al.•Thinking Skills and Creativity•2023

  • Torrance Tests of Creative Thinking as Predictors of Personal and Public Achievement

    Mark A Runco, Garnet Millar et al.•Creativity Research Journal•2010

  • The Standard Definition of Creativity

    Mark A Runco, Garrett J Jaeger•Creativity Research Journal•2012

  • Automated scoring of figural creativity using a convolutional neural network

    David H Cropley, Rebecca L Marrone•Psychology of Aesthetics…•2025

  • Testing equal odds in creativity research

    Boris Forthmann, Carsten Szardenings et al.•Psychology of Aesthetics…•2021

  • Automated assessment of creativity in multilingual narratives

    Simone A Luchini, Ibraheem Muhammad Moosa et al.•Psychology of Aesthetics…•2026

  • An improved taxonomy of creativity measures based on salient task attributes

    Selina Weiss, Oliver Wilhelm et al.•Psychology of Aesthetics…•2024

  • Investigating Lasting Effects of Real-Time Feedback on Originality and Evaluation Accuracy

    Pier‐luc De Chantal, Claudelle Houde-Labrecque et al.•Creativity Research Journal•2026

  • The Patient is Thriving! Current Issues, Recent Advances, and Future Directions in Creativity Assessment

    Open Access•Jonathan A Plucker•Creativity Research Journal•2023

  • Creativity in the West and the East

    Philipp Barth, Georg Stadtmann•Creativity Research Journal•2026

  • Automatic Scoring of Metaphor Creativity with Large Language Models

    Open Access•Paul V DiStefano, John D Patterson et al.•Creativity Research Journal•2025

  • Planning Missing Data Designs for Human Ratings in Creativity Research

    Boris Forthmann, B Goecke et al.•Creativity Research Journal•2025

  • Creativity, Mating, and Reproductive Successes Outside the Weird World

    Izabela Lebuda, P Sorokowski et al.•Creativity Research Journal•2021

  • Measuring original thinking in elementary school

    Open Access•Acar, Dominique Dumas et al.•Journal of Educational Psychology•2024

  • Components of Original Thinking in Gifted Children

    Open Access•Zohreh Zarnegar, Dennis Hocevar et al.•Educational and Psychological…•1988

  • Effects of explicit instructions to “be creative” on the psychological meaning of divergent thinking test scores 1

    Open Access•David M Harrington•Journal of Personality•1975

  • A systematic quantitative review of divergent thinking assessments

    Janika Saretzki, Boris Forthmann et al.•Psychology of Aesthetics…•2024

  • Pisa 2022 Creative Thinking Assessment

    Open Access•B Barbot, James C Kaufman•The Journal of Creative Behavior•2025

  • Investigation of Response Aggregation Methods in Divergent Thinking Assessments

    Open Access•Janika Saretzki, Rosalie Andrae et al.•The Journal of Creative Behavior•2025

  • Creativity in the age of generative AI

    Open Access•Janet Rafner, Roger E Beaty et al.•Nature Human Behaviour•2023

Unique citing works7
Citations per year7
Citation span2025 - 2026 (2)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 7

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae