Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

An Empirical Evaluation of the System Usability Scale

Bibliographic Data

ID23375321
AuthorsAaron Bangor (AT&T Labs, Inc.), Philip Kortum (0000-0002-0460-179X, Rice University, corresponding author), Philip T Kortum (Rice University), James Miller (0000-0003-1666-2343, AT&T (United States)), James T Miller (AT&T Labs, Inc.)
Year2008
Volume24
Issue6
Pages574-594
Publication date2008-07-29
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueInternational Journal of Human–Computer Interaction (JOURNAL)
Journal identifiersISSN: 1044-7318 • E-ISSN: 1532-7590
PublisherInforma UK Limited (PUBLISHER • GB)
DOI10.1080/10447310802205776
OpenAlexW2032191478
LanguageEN
Citations received179
References cited4

This article presents nearly 10 year's worth of System Usability Scale (SUS) data collected on numerous products in all phases of the development lifecycle. The SUS, developed by CitationBrooke (1996), reflected a strong need in the usability community for a tool that could quickly and easily collect a user's subjective rating of a product's usability. The data in this study indicate that the SUS fulfills that need. Results from the analysis of this large number of SUS scores show that the SUS is a highly robust and versatile tool for usability professionals. The article presents these results and discusses their implications, describes nontraditional uses of the SUS, explains a proposed modification to the SUS to provide an adjective rating that correlates with a given score, and provides details of what constitutes an acceptable SUS score.

Human–computer interaction · Pluralistic walkthrough · Product (mathematics) · Rating scale · Scale (ratio) · System usability scale · Usability · Usability goals · Usability inspection · Web usability · Computer Science · Ergonomics and Human Factors · Human-Automation Interaction and Safety · Mathematics · Psychology · Usability and User Interface Design

  • Inklusion digital! Chancen und Herausforderungen inklusiver Bildung im Kontext von Digitalisierung

    Open Access•null :null, Daria Ferencik-Lehmkuhl et al.•Inklusion digital! Chancen und…•2023

  • A digital mindfulness application for African American caregivers of people living with HIV/Aids

    Open Access•K Alexander, S B Carswell et al.•AIDS Care•2026

  • Psychosocial dimensions of immersive learning

    Open Access•An-Chao Tsai, An‐Chao Tsai et al.•Humanities and Social Sciences…•2026

  • Study protocol of the SWORD-study

    Open Access•M A van de Wal, Marieke Gielissen et al.•BMC Psychology•2015

  • Virtual reality delivered exposure for fear of needles

    Open Access•Anna Caltabiano, Taylor Burke et al.•Frontiers in Psychiatry•2025

  • Reliability and Usability Analysis of an Embedded System Capable of Evaluating Balance in Elderly Populations Based on a Modified Wii Balance Board

    Open Access•Ángel Gabriel Estévez-Pedraza, Enrique Hernandez-Laredo et al.•International Journal of…•2022

  • Development of a New Application-Based Chewing Efficiency Test (Mini Dental Assessment) and Its Evaluation by Nursing Staff in Geriatric Care

    Open Access•Alexander Schmidt, Maximiliane Amelie Schlenz et al.•International Journal of…•2021

  • Is My Mooc Learner-Centric? A Framework for Formative Evaluation of Mooc Pedagogy

    Open Access•Veenita Shah, Sahana Murthy et al.•The International Review of…•2023

  • Evaluating and expanding usability and user satisfaction of an online research portal

    Open Access•Christopher J Holt, Zahra Aziz et al.•Australasian Journal of…•2023

  • VR (virtual reality) Educator

    Open Access•Kaushal Kumar Bhagat, Tianchong Wang et al.•Australasian Journal of…•2025

  • Mixed methods feasibility and usability testing of a childhood obesity risk estimation tool

    Open Access•Grace Grove, Nida Ziauddeen et al.•BMC Public Health•2023

  • Inklusion digital! Chancen und Herausforderungen inklusiver Bildung im Kontext von Digitalisierung

    Open Access•Daria Ferencik-Lehmkuhl, Ilham Huynh et al.•Inklusion digital! Chancen und…•2023

  • Designing for Motivation, Engagement and Wellbeing in Digital Experience

    Open Access•Dorian Peters, Rafael A Calvo et al.•Frontiers in Psychology•2018

  • Gamification in theory and action

    Open Access•Katie Seaborn, Deborah I Fels•International Journal of…•2015

  • The System Usability Scale

    James R Lewis•International Journal of…•2018

  • Between Reality and Delusion

    Bahar Irfan, Sanna‐Mari Kuoppamäki et al.•2023

  • Impact of a Smart-Ring-Based Feedback System on the Quality of Chest Compressions in Adult Cardiac Arrest

    Open Access•Chiwon Ahn, Seungjae Lee et al.•International Journal of…•2021

  • Process-Oriented Instrument and Taxonomy for Teaching Surgical Procedures in Medical Training

    Open Access•Víctor Galvez-Yanjari, René de la Fuente et al.•International Journal of…•2020

  • Evaluation of an e-learning platform promoting electronic personal health record competence

    Open Access•Luis Perotti, Oskar Stamm et al.•BMC Public Health•2025

  • Usability Assessment of an Innovative Device in Infusion Therapy

    Open Access•Pedro Parreira, Lia Bezerra Sousa et al.•International Journal of…•2020

  • A framework for the assessment of synthetic personalities according to user perception

    Zoraida Callejas, David Griol et al.•International Journal of…•2014

  • Usability Study of a Multicomponent Exergame Training for Older Adults with Mobility Limitations

    Open Access•Melanie Thalmann, Lisa Ringli et al.•International Journal of…•2021

  • Creating healthy remote store food environments

    Open Access•Amanda Hill, Meaghan S Christian et al.•BMC Public Health•2025

  • Putting the usability of wearable technology in forensic psychiatry to the test

    Open Access•Peter de Looff, Peter C de Looff et al.•Frontiers in Psychiatry•2024

  • Parental emotional adjustment as a primary target for parenting programs

    Open Access•Haley M LaMonica, Victoria Loblay et al.•BMC Psychology•2025

  • The acceptance and commitment therapy matrix mobile app

    Open Access•Michael E Levin, Benjamin Pierce et al.•Journal of Contextual Behavioral…•2017

  • Smartphone App for monitoring Asthma in children and adolescents

    Open Access•Karina Mayoral, Olatz Garín et al.•Quality of Life Research•2021

  • Usability, Feasibility, and Effect of a Biocueing Intervention in Addition to a Moderated Digital Social Therapy-Platform in Young People With Emerging Mental Health Problems

    Open Access•Marilon van Doorn, Laurens A Nijhuis et al.•Frontiers in Psychiatry•2022

  • Implementing biofeedback treatment in a psychosomatic-psychotherapeutic inpatient unit

    Open Access•Kira Schmidt, Drazena Barac-Dammeyer et al.•Frontiers in Psychiatry•2023

  • Evaluation of a Passive Upper Limb Exoskeleton in Healthcare Workers during a Surgical Instrument Cleaning Task

    Open Access•Bastien Arnoux, Anaïs Farr et al.•International Journal of…•2023

  • Usability and acceptability testing of a Plan of Safe Care in a mobile health platform

    Open Access•Krystyna Isaacs, Krystyna R Isaacs et al.•Frontiers in Psychiatry•2023

  • Client’s Experiences Using a Location-Based Technology ICT System during Gambling Treatments’ Crucial Components

    Open Access•Laura Díaz-Sanahuja, I Miralles et al.•International Journal of…•2022

  • Coaching Robots for Older Seniors

    Open Access•Cornelia Schneider, Hafsa Bousbiat•International Journal of…•2023

  • A Pilot Evaluation of mHealth App Accessibility for Three Top-Rated Weight Management Apps by People with Disabilities

    Open Access•Erin Radcliffe, Ben Lippincott et al.•International Journal of…•2021

  • Implementing a Web-Based Cognitive Defusion Program to Target Negative Self-Referential Thoughts in College Students

    Open Access•Clarie-Ann Henriques Wollach, Leeann Cardaciotto et al.•Journal of Contextual Behavioral…•2020

  • Green-Extension Design—A New Strategy to Reduce the Environmental Pressure from the Existing Consumer Electronics

    Open Access•Siliang Yi, Chih‐Fu Wu et al.•International Journal of…•2021

  • Feasibility of Repeated Assessment of Cognitive Function in Older Adults Using a Wireless, Mobile, Dry-EEG Headset and Tablet-Based Games

    Open Access•Esther C McWilliams, Florentine Barbey et al.•Frontiers in Psychiatry•2021

  • Preliminary evaluation of a gamified smartphone intervention (O2O-PEP) for enhancing HIV post-exposure prophylaxis uptake in men who have sex with men

    Open Access•Tianyu Cui, Tianying Li et al.•BMC Public Health•2025

  • Characterizing Breakthrough Cancer Pain Using Ecological Momentary Assessment with a Smartphone App

    Open Access•Francisco Villegas, FRANCISCO JAVIER VILLEGAS-ALZATE et al.•International Journal of…•2021

  • Development of an Online Resource for People Bereaved by Suicide

    Open Access•Edouard Leaune, Laurène Lestienne et al.•Frontiers in Psychiatry•2021

  • Topical fluoride hesitancy among caregivers

    Open Access•Todd C Edwards, A C Carle et al.•Journal of Public Health Dentistry•2023

  • How Can Geographic Information in Text Documents be Visualized to Support Information Exploration in the Humanities

    Open Access•André Bruggmann, Sara Irina Fabrikant et al.•International Journal of…•2020

  • Evaluating Artificial Intelligence on the Efficacy of Preference Assessments for Preservice Speech-Language Pathologists

    Open Access•Brenna Griffen, Elizabeth R Lorah et al.•Journal of Developmental and…•2024

  • Case report

    Open Access•Yuma Nagata, Yuto Satake et al.•Frontiers in Psychiatry•2026

  • MHealth intervention for multiple lifestyle behaviour change among high school students in Sweden (Life4YOUth)

    Open Access•Marcus Bendtsen, Anna Seiterö et al.•BMC Public Health•2021

  • A social media game to increase physical activity among older adult women

    Open Access•Michael C Robertson, Maria C Swartz et al.•BMC Public Health•2024

  • The feasibility of using smartphone apps as treatment components for depressed suicidal outpatients

    Open Access•Chani Nuij, Wouter van Ballegooijen et al.•Frontiers in Psychiatry•2022

  • Feasibility, acceptability and outcomes of a contextual schema therapy-based mobile program for depressive symptoms in adults

    Open Access•Paula Stroian, Daniel David et al.•Journal of Contextual Behavioral…•2024

  • Evaluating usability and acceptance of a socially assistive robot supported cognitive training for depression – results of the randomized controlled pilot study ‘Amiga’

    Open Access•Alfred Haeussl, Ina Zwigl et al.•Frontiers in Psychiatry•2026

  • Discrepancies between Expected and Actual Implementation

    Open Access•Fangyuan Chang, Andréa Eriksson et al.•International Journal of…•2020

  • SPAN Website for Remote Intervention with Autistic Adolescents and Young Adults

    Open Access•Liron Lamash, Eynat Gal et al.•Children•2023

  • Motivation, Usability, and Credibility of an Intelligent Activity-Based Client-Centred Training System to Improve Functional Performance in Neurological Rehabilitation

    Open Access•Els Knippenberg, Ilse Lamers et al.•International Journal of…•2021

  • The Development and Usability of a Mobile App for Parents of Children with ADHD

    Open Access•Costina-Ruxandra Poetar, Reka Kertesz et al.•Children•2023

  • A web-based self-guided program to promote valued-living in college students

    Open Access•Jacob Firestone, Leeann Cardaciotto et al.•Journal of Contextual Behavioral…•2019

  • Adaptation and Psychometric Validation of the Empower-Sustain Usability Questionnaire (E-SUQ) among Patients with Metabolic Syndrome in Primary Care

    Open Access•Nurul Hidayatullaila Sahar, Siti Fatimah Badlishah-Sham et al.•International Journal of…•2021

  • Pilot randomised controlled trial of a culturally aligned smoking cessation app for American Indian persons

    Dana Mowls Carroll, Dylan Jennings et al.•Tobacco Control•2024

  • Moderators of Symptom Self-Ratings in Pediatric Patients with Obsessive-Compulsive Disorder During a Digital Sensor-Assisted Treatment

    Open Access•Carolin S Klein, Larissa Seyboth et al.•Child Psychiatry & Human…•2025

  • An 8-Week Virtual Exercise Environment Intervention for People Post-Stroke

    Open Access•Christen J Mendonca, Sangeetha Mohanraj et al.•INQUIRY The Journal of Health…•2025

  • Evaluation of a web-based acceptance and commitment therapy program for women with trauma-related problems

    Open Access•Devika Fiorillo, Caitlin Mclean et al.•Journal of Contextual Behavioral…•2016

  • The Usability of an Online Tool to Promote the Use of Evidence-Based Smoking Cessation Interventions

    Open Access•Daniëlle N Zijlstra, Catherine Bolman et al.•International Journal of…•2021

  • Higea

    Open Access•Eugenia Castilla, Juan José Escobar et al.•International Journal of…•2022

  • “Design and evaluation of public chatbots for computer crime awareness

    Open Access•Luís Pimentel, Maria do Rosário Matos Bernardo et al.•Universal Access in the…•2026

  • Design practice

    Open Access•Wenhuei Chou, Yaling Ko et al.•Universal Access in the…•2026

  • Delivering remote procedural training on peripheral intravenous cannulation to medical students using the Microsoft Hololens 2

    Open Access•Murray Connolly, Gabriella Iohom et al.•BMC Medical Education•2026

  • Virtual Reality in Veterinary Higher Education

    Open Access•Michela Bullone, Edoardo Battegazzorre et al.•Journal of Educational Computing…•2026

  • Innovating an online language assessment for Malay-speaking primary school-age children with developmental language disorder

    Open Access•Lynette Tan, Yazmin Ahmad Rusli et al.•Child Language Teaching and Therapy•2026

  • Development of a web application for the cognitive stimulation of older adults with mild cognitive impairments, using advanced web scraping techniques and generative artificial intelligence

    Open Access•Nancy Rodríguez, John W Castro et al.•Social Sciences & Humanities Open•2026

  • Car-Em

    Sandhya Jayaraman, Andrew Violette et al.•ACM Transactions on Human-Robot…•2026

  • Comparing E-quizzes (Trivia makerTM) and paper-based tests on cognitive load, usability, and performance outcomes among university students

    Open Access•Amayra Tannoubi, Ibrahim Ouergui et al.•Frontiers in Education•2026

  • A mixed methods evaluation of the usability of Feel Your Best Self

    Open Access•Emily R Auerbach, Emily A Iovino et al.•Frontiers in Education•2024

  • Self-collection of capillary blood and saliva to determine Covid-19 vaccine immunogenicity in patients with immune-mediated inflammatory diseases and health professionals

    Open Access•Caroline Schmetzer, Ekaterina Vogt et al.•Frontiers in Public Health•2022

  • Patient's Perception of Digital Symptom Assessment Technologies in Rheumatology

    Open Access•Johannes Knitza, Felix Muehlensiepen et al.•Frontiers in Public Health•2022

  • Feasibility, Acceptability, and Influence of mHealth-Supported N-of-1 Trials for Enhanced Cognitive and Emotional Well-Being in US Volunteers

    Open Access•Richard L Kravitz, Adrian Aguilera et al.•Frontiers in Public Health•2020

  • System Integrated Digital Empowering and teleRehabilitation to promote patient Activation and well-Being in chronic disabilities

    Open Access•Federica Rossetto, Francesca Borgnis et al.•Frontiers in Public Health•2023

  • An integrated online-to-offline model for HIV post-exposure prophylaxis (O2O-PEP) scale-up among men who have sex with men (MSM)

    Open Access•Qianqian Luo, Yongchuan Luo et al.•Frontiers in Public Health•2022

  • Usability-Focused Development and Usage of NeoTree-Beta, an App for Newborn Care in a Low-Resource Neonatal Unit, Malawi

    Open Access•Caroline Crehan, Msandeni Chiume et al.•Frontiers in Public Health•2022

  • Effectiveness and Usability of a Novel Kinect-Based Tailored Interactive Fall Intervention System for Fall Prevention in Older People

    Open Access•Taekyoung Kim, Shuping Xiong•Frontiers in Public Health•2022

  • Brief report

    Open Access•Robyn N M Sedotto, Alexandra Edwards et al.•Frontiers in Public Health•2024

  • An Augmented Reality-Based Mobile Application Facilitates the Learning about the Spinal Cord

    Open Access•Jacks Fernandes, Andrei Souza Teles et al.•Education Sciences•2020

  • Quantifying Perception-Based Student Success with Generative AI

    Open Access•Seyma Yaman Kayadibi•Education Sciences•2026

  • Technology-Enhanced Feedback System Usability in the Context of Self-Regulation Promotion

    Open Access•Alenka Žerovnik•Education Sciences•2024

  • Retrospective Analysis of Municipal Geoportal Usability in the Context of the Evolution of Online Data Presentation Techniques

    Open Access•Karol Król•ISPRS International Journal of…•2024

  • Developing serious games for CBRN-e training in mixed reality, virtual reality, and computer-based environments

    Open Access•Burak Altan, Servet Gürer et al.•International Journal of Disaster…•2022

  • Citizen participation in flood risk management

    Open Access•Mafalda Cravo, Jacinto Estima et al.•International Journal of Disaster…•2026

  • Empower

    Open Access•Sultan Alyahya, Atheer Alsaif•SAGE Open•2026

  • Virtual Reality Mirror Exposure Combined with Eye-Tracking Attentional Bias Modification in Adolescent Males with Anorexia Nervosa

    Open Access•Franck-Alexandre Meschberger-Annweiler, Marta Carulla-Roig et al.•Cyberpsychology Behavior and…•2026

  • An Evaluation of Perceived Usability

    Open Access•Ebru ERKAN, Tuğba MUTLU•Avrasya Uluslararası Araştırmalar…•2023

  • User perspectives on the Molbio Truenat platform and tuberculosis assays for decentralised testing in Mozambique and Tanzania

    Open Access•María del Mar Castro, Celso Khosa et al.•BMJ Global Health•2026

  • Audiodescripción fílmica y accesibilidad

    Open Access•Xoán Montero Domínguez, Sandra Maria Sanches Alves Santiago•Mutatis Mutandis Revista…•2026

  • Perceived usability evaluation of educational technology using the System Usability Scale (SUS)

    Prokopia Vlachogianni, Nikolaos Tselios•Journal of Research on Technology…•2022

  • Vi̇deo Platformlarinin Kullanilabi̇li̇rli̇kleri̇ni̇n Değerlendi̇ri̇lmesi̇

    Open Access•Erdinç Okulmuş, Arif Cem Topuz•Karadeniz Uluslararası Bilimsel…•2022

  • Evaluating the efficacy of using a novel gaze-based attentive user interface to extend ADHD children’s attention span

    Open Access•Haifeng Shen, Othman Asiry et al.•International Journal of…•2023

  • ‘Address and command’

    Open Access•Panagiotis Vogiatzidakis, Panayiotis Koutsabasis•International Journal of…•2022

  • Visual aesthetics and user experience

    Open Access•Juergen Sauer, A Sonderegger•International Journal of…•2022

  • Using animation to develop a usability questionnaire

    Open Access•Wang YuHui, Zhang Yiyang et al.•International Journal of…•2024

  • Augmented reality robot manipulation with physical mock-up and improved spatial cognition

    Open Access•Fang Xu, Hengxu You et al.•International Journal of…•2025

  • The Interactive Virtual Training for Teachers (IVT-T) to Practice Classroom Behavior Management

    Open Access•Anthony Delamarre, Elisa S Shernoff et al.•International Journal of…•2021

  • Questionnaire experience of the pictorial usability inventory (PUI) – a comparison of pictorial and hybrid usability scales

    Open Access•Juergen Baumgartner, A Sonderegger et al.•International Journal of…•2023

  • Revitalizing wellbeing

    Open Access•Joseph Orji, Gerry Chan et al.•International Journal of…•2025

  • A comprehensive on-site authoring tool for creating augmented reality technical documentation (STAAR-Tech)

    Open Access•Enricoandrea Laviola, Michele Gattullo et al.•International Journal of…•2026

Unique citing works179
Citations per year11,93
Citation span2011 - 2026 (16)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 169

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae