Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

AI Literacy Scale for Undergraduate Design Students

Development and Validation

Bibliographic Data

ID22006409
AuthorsShuang Lin (0000-0002-3439-2837, Taizhou University, corresponding author), Tan Zhengtang (0000-0002-0862-311X, Hunan Normal University)
Year2026
Volume16
Issue2
Publication date2026-04-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueSAGE Open (JOURNAL)
Journal identifiersISSN: 2158-2440 • E-ISSN: 2158-2440
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1177/21582440261463131
OpenAlexW7166709480
LanguageEN
References cited54

Artificial intelligence (AI) is reshaping design education, yet field-specific instruments to assess AI literacy remain scarce. Drawing on UNESCO’s AI Competency Framework together with Design Thinking, Systems Thinking and human–AI co-creativity, this study reconceptualizes AI literacy for undergraduate design students and develops the AI-CIEI Scale as a four-dimensional measurement tool. An initial item pool was generated through literature synthesis and expert review, and then refined via cognitive interviews and pilot testing. A survey of 485 design majors from eight public universities in China (5-point Likert scale) was conducted; exploratory factor analysis and confirmatory factor analysis supported a 25-item structure comprising Cognition & Collaboration, Implementation & Integration, Ethics & Critical Judgment, and Innovation & Systemic Thinking, with excellent model fit, high internal consistency, and satisfactory convergent and discriminant validity. Criterion-related validity was examined using a MIMIC-type structural equation model including gender, academic year, major, AI training frequency, and AI usage duration as predictors: academic year showed small but consistent positive associations with all four dimensions, whereas the other variables displayed weak and non-significant effects. These findings indicate that AI literacy in design education reflects intertwined cognitive, procedural, ethical and systemic competencies shaped more by program-level learning trajectories than by short-term exposure, and position the AI-CIEI Scale as a theoretically grounded tool for diagnostics, curriculum alignment and future intervention studies

Cognition · Confirmatory factor analysis · Curriculum · Exploratory factor analysis · Instructional design · Likert scale · Literacy · Metacognition · Structural equation modeling · Artificial Intelligence in Healthcare and Education · Ethics and Social Impacts of AI · Teaching and Learning Programming

  • What is AI Literacy? Competencies and Design Considerations

    Open Access•Duri Long, Brian Magerko•Proceedings of the 2020 CHI…•2020

  • A comparison of leading theories for the prediction of goal‐directed behaviours

    Open Access•Richard P Bagozzi, Susan K Kimmel•British Journal of Social…•1995

  • Evaluating Structural Equation Models with Unobservable Variables and Measurement Error

    Open Access•Richard P Bagozzi•Journal of Marketing Research•1981

  • AI Literacy

    Open Access•Davy Tsz Kit Ng, Jac Ka Lok Leung et al.•Proceedings of the Association…•2021

  • The use of expert judges in scale development

    Open Access•David M Hardesty, William O Bearden•Journal of Business Research•2004

  • Integrating Ethics and Career Futures with Technical Learning to Promote AI Literacy for Middle School Students

    Open Access•Helen Zhang, Irene Lee et al.•International Journal of…•2023

  • Wicked Problems in Design Thinking

    Richard Buchanan•Design Issues•1992

  • Learning design to support student-AI collaboration

    Open Access•Jinhee Kim, Hyun-Kyung Lee et al.•Education and Information…•2022

  • Content validity in psychological assessment

    Stephen N Haynes, David C S Richard et al.•Psychological Assessment•1995

  • Conceptualizing AI literacy

    Open Access•Davy Tsz Kit Ng, Jac Ka Lok Leung et al.•Computers and Education:…•2021

  • A Review and Synthesis of the Measurement Invariance Literature

    Open Access•Robert J Vandenberg, Charles E Lance•Organizational Research Methods•2000

  • When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions.

    Mijke Rhemtulla, Patricia E Brosseau-Liard et al.•Psychological Methods•2012

  • The global landscape of AI ethics guidelines

    Open Access•Anna Jobin, Marcello Ienca et al.•Nature Machine Intelligence•2019

  • Common method biases in behavioral research

    Philip M Podsakoff, Scott B Mackenzie et al.•Journal of Applied Psychology•2003

  • A Paradigm for Developing Better Measures of Marketing Constructs

    Open Access•Gilbert A Churchill•Journal of Marketing Research•1979

  • Validity and reliability of a questionnaire developed to explore quality assurance components for teaching and learning in vocational and technical education

    Open Access•Satumari John Wafudu, Yusri Kamin et al.•Humanities and Social Sciences…•2022

  • The impact of Generative AI (GenAI) on practices, policies and research direction in education

    Open Access•Thomas K F Chiu•Interactive Learning Environments•2024

  • Measuring undergraduate students' reliance on Generative AI during problem-solving

    Open Access•Chenyu Hou, Gaoxia Zhu et al.•Computers & Education•2025

  • Measuring user competence in using artificial intelligence

    Bingcheng Wang, Pei‐Luen Patrick Rau et al.•Behaviour and Information…•2023

  • Design and validation of the AI literacy questionnaire

    Open Access•Davy Tsz Kit Ng, Wenjie Wu et al.•British Journal of Educational…•2024

  • Creation and Evaluation of a Pretertiary Artificial Intelligence (AI) Curriculum

    Open Access•Thomas K F Chiu, Helen Meng et al.•IEEE Transactions on Education•2022

  • Holistic competencies and AI in education

    Open Access•Cecilia K Y Chan, Cecilia Chan•Australasian Journal of…•2024

  • Modeling ChatGPT Adoption Among Undergraduates

    Open Access•Sonay Caner•SAGE Open•2025

  • A Scholarly Definition of Artificial Intelligence (AI)

    Homero Gil De Zúñiga, Manuel Goyanes et al.•Political Communication•2024

  • Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research

    Open Access•Godfred O Boateng, Torsten B Neilands et al.•Frontiers in Public Health•2018

  • The ethics of algorithms

    Open Access•Brent Mittelstadt, Brent Daniel Mittelstadt et al.•Big Data & Society•2016

Citation velocityhistorical
Highly citedNo

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae