Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Evaluation Methods Applied to Digital Health Interventions

What Is Being Used beyond Randomised Controlled Trials?—A Scoping Review

Bibliographic Data

ID15511574
AuthorsRobert Hrynyschyn (0000-0002-8642-9590, Humboldt-Universität zu Berlin, corresponding author), Christina Prediger (0000-0002-3421-6921, Humboldt-Universität zu Berlin), Cheryl Stock (0000-0001-9379-3844, University of Southern Denmark), Stefanie M Helmer (0000-0002-4435-4041, University of Bremen)
Year2022
Volume19
Issue9
Pages5221-5221
Publication date2022-04-25
Open AccessYes
TypeARTICLE
VenueInternational Journal of Environmental Research and Public Health (JOURNAL)
Journal identifiersISSN: 1661-7827 • E-ISSN: 1660-4601
PublisherMultidisciplinary Digital Publishing Institute (PUBLISHER • CH)
DOI10.3390/ijerph19095221
PMID35564616
OpenAlexW4224866902
LanguageEN
Citations received4
References cited11

Despite the potential of digital health interventions (DHIs), evaluations of their effectiveness face challenges. DHIs are complex interventions and currently established evaluation methods, e.g., the randomised controlled trial (RCT), are limited in their application. This study aimed at identifying alternatives to RCTs as potentially more appropriate evaluation approaches. A scoping review was conducted to provide an overview of existing evaluation methods of DHIs beyond the RCT. Cochrane Central Register of Controlled Trials, MEDLINE, Web of Science, and EMBASE were screened in May 2021 to identify relevant publications, while using defined inclusion and exclusion criteria. Eight studies were extracted for a synthesis comprising four alternative evaluation designs. Factorial designs were mostly used to evaluate DHIs followed by stepped-wedge designs, sequential multiple assignment randomised trials (SMARTs), and micro randomised trials (MRTs). Some of these methods allow for the adaptation of interventions (e.g., SMART or MRT) and the evaluation of specific components of interventions (e.g., factorial designs). Thus, they are appropriate for addressing some specific needs in the evaluation of DHIs. However, it remains unsolved how to establish these alternative evaluation designs in research practice and how to deal with the limitations of the designs

Clinical study design · Clinical trial · Medical physics · MEDLINE · Pathology · Psychological intervention · Randomized controlled trial · Systematic review · Computer Science · Digital Mental Health Interventions · Medicine · Mobile Health and mHealth Applications · Nursing · Telemedicine and Telehealth Implementation

  • Adolescents' perceptions and user experiences with a virtual reality-based alcohol prevention tool in Germany

    Open Access•Robert Hrynyschyn, Christina Prediger et al.•Frontiers in Public Health•2023

  • A Scoping Review of Digital Interventions Targeting Anxiety in Young Children

    Open Access•Georgia Coverdale, Yael Perry et al.•Child & Youth Care Forum•2026

  • Mobile-Based Interventions for Enhancing Health Literacy in Sexually Transmitted Infections

    Taleb Khodaveisi, Hamid Bouraghi et al.•International Journal of Sexual…•2026

  • Real-World Testing of an Artificial Intelligence Conversational Agent as an Early Intervention and Support Tool in the Mental Health Referral Care Pathway

    Open Access•Edward Meinert, Madison Milne-Ives et al.•International Journal of Social…•2026

  • The Science of Evaluation

    Ray Pawson•The Science of Evaluation•2013

  • A scoping review on the conduct and reporting of scoping reviews

    Open Access•Andrea C Tricco, Erin Lillie et al.•BMC Medical Research Methodology•2016

  • The Multiphase Optimization Strategy (Most) and the Sequential Multiple Assignment Randomized Trial (SMART)

    Open Access•Linda M Collins, Susan A Murphy et al.•American Journal of Preventive…•2007

  • Digital Mental Health and Covid-19

    Open Access•John Torous, Keris Jän Myrick et al.•JMIR Mental Health•2020

  • A new framework for developing and evaluating complex interventions

    Open Access•Kathryn Skivington, Lynsay Matthews et al.•BMJ•2021

  • Developing and evaluating complex interventions

    Open Access•Peter Craig, Paul Dieppe et al.•BMJ•2008

  • Methods Used to Evaluate mHealth Applications for Cardiovascular Disease

    Open Access•Felix Holl, Jennifer Kircher et al.•International Journal of…•2021

  • Adaptive goal setting and financial incentives

    Open Access•Mary Alice Adams, Marc A Adams et al.•BMC Public Health•2017

  • A realist diagnostic workshop

    Open Access•Ray Pawson, Ana Manzano et al.•Evaluation•2012

  • Scoping studies

    Hilary Arksey, Lisa O’malley•International Journal of Social…•2005

Citations per year1.33
Citation span2023 - 2026 (4)
Highly citedNo

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae