Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Development of the Digital Health Literacy Instrument

Measuring a Broad Spectrum of Health 1.0 and Health 2.0 Skills

Bibliographic Data

ID23323933
AuthorsRosalie van der Vaart (0000-0002-8787-4186, Leiden University), Constance H C Drossaert (0000-0002-7083-3169, University of Twente, corresponding author)
Year2017
Volume19
Issue1
Pagese27
Publication date2017-01-24
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueJournal of Medical Internet Research (JOURNAL)
Journal identifiersISSN: 1438-8871 • E-ISSN: 1438-8871
PublisherJMIR Publications Inc. (PUBLISHER • CA)
DOI10.2196/jmir.6709
PMID28119275
OpenAlexW2580360748
LanguageEN
Citations received90
References cited33

BACKGROUND: With the digitization of health care and the wide availability of Web-based applications, a broad set of skills is essential to properly use such facilities; these skills are called digital health literacy or eHealth literacy. Current instruments to measure digital health literacy focus only on information gathering (Health 1.0 skills) and do not pay attention to interactivity on the Web (Health 2.0). To measure the complete spectrum of Health 1.0 and Health 2.0 skills, including actual competencies, we developed a new instrument. The Digital Health Literacy Instrument (DHLI) measures operational skills, navigation skills, information searching, evaluating reliability, determining relevance, adding self-generated content, and protecting privacy. OBJECTIVE: Our objective was to study the distributional properties, reliability, content validity, and construct validity of the DHLI's self-report scale (21 items) and to explore the feasibility of an additional set of performance-based items (7 items). METHODS: We used a paper-and-pencil survey among a sample of the general Dutch population, stratified by age, sex, and educational level (T1; N=200). The survey consisted of the DHLI, sociodemographics, Internet use, health status, health literacy and the eHealth Literacy Scale (eHEALS). After 2 weeks, we asked participants to complete the DHLI again (T2; n=67). Cronbach alpha and intraclass correlation analysis between T1 and T2 were used to investigate reliability. Principal component analysis was performed to determine content validity. Correlation analyses were used to determine the construct validity. RESULTS: Respondents (107 female and 93 male) ranged in age from 18 to 84 years (mean 46.4, SD 19.0); 23.0% (46/200) had a lower educational level. Internal consistencies of the total scale (alpha=.87) and the subscales (alpha range .70-.89) were satisfactory, except for protecting privacy (alpha=.57). Distributional properties showed an approximately normal distribution. Test-retest analysis was satisfactory overall (total scale intraclass correlation coefficient=.77; subscale intraclass correlation coefficient range .49-.81). The performance-based items did not together form a single construct (alpha=.47) and should be interpreted individually. Results showed that more complex skills were reflected in a lower number of correct responses. Principal component analysis confirmed the theoretical structure of the self-report scale (76% explained variance). Correlations were as expected, showing significant relations with age (ρ=-.41, P<.001), education (ρ=.14, P=.047), Internet use (ρ=.39, P<.001), health-related Internet use (ρ=.27, P<.001), health status (ρ range .17-.27, P<.001), health literacy (ρ=.31, P<.001), and the eHEALS (ρ=.51, P<.001). CONCLUSIONS: This instrument can be accepted as a new self-report measure to assess digital health literacy, using multiple subscales. Its performance-based items provide an indication of actual skills but should be studied and adapted further. Future research should examine the acceptability of this instrument in other languages and among different populations.

Construct validity · Content validity · Cronbach's alpha · Digital health · eHealth · Environmental health · Health care · Health literacy · Medical education · Population · Psychometrics · Applied Psychology · Clinical Psychology · Health Literacy and Information Accessibility · Medicine · Mobile Health and mHealth Applications · Psychology · Social Media in Health Education

  • Avaliação da qualidade dos vídeos sobre câncer de mama mais visualizados no YouTube

    Open Access•Larissa Silveira Carvalho Villa, Alex Del Cerro Mello et al.•Revista Eletrônica de Comunicação,…•2021

  • Organização do trabalho em saúde e as transformações digitais

    Open Access•Paôlla Layanna Fernandes Rodrigues, Erica Lima Costa De Menezes et al.•Trabalho Educação e Saúde•2025

  • Digital Trends, Digital Literacy, and E-Health Engagement Predictors of Breast and Colorectal Cancer Survivors

    Open Access•Samar J Melhem, Shereen Nabhani‐Gebara et al.•International Journal of…•2023

  • A Community-Based Participatory Research Approach to Developing and Testing Social and Behavioural Interventions to Reduce the Spread of Sars-CoV-2

    Open Access•Alexander Molassiotis, Yao Jie Xie et al.•International Journal of…•2022

  • Digital Health Literacy and Information-Seeking in the Era of Covid-19

    Open Access•Guglielmo Bonaccorsi, Veronica Gallinoro et al.•International Journal of…•2023

  • Black Men and Health Literacy

    Open Access•Evelina Sterling, Laura M Stevens et al.•International Journal of…•2025

  • Evaluation of the Psychometric Properties of the Digital Health Literacy Instrument (DHLI-BrA) for Use in Brazilian Adolescents

    Open Access•Mariane Carolina Faria Barbosa, Ana Luiza Peres Baldiotti et al.•International Journal of…•2024

  • Translation, cultural adaptation and validity assessment of the Dutch version of the eHealth Literacy Questionnaire

    Open Access•Charlotte C Poot, Eline Meijer et al.•BMC Public Health•2023

  • Digital Health Literacy and Web-Based Information-Seeking Behaviors of University Students in Germany During the Covid-19 Pandemic

    Open Access•Kevin Dadaczynski, Orkan Okan et al.•Journal of Medical Internet…•2021

  • Sociodemographic determinants of digital health literacy

    Open Access•Marta Estrela, Guilherme Semedo et al.•International Journal of Medical…•2023

  • Health Literacy, Digital Health Literacy, and Covid-19 Pandemic Attitudes and Behaviors in U.S. College Students

    Open Access•Uday Patil, Uliana Kostareva et al.•International Journal of…•2021

  • Digital literacy as a new determinant of health

    Open Access•Maria del Pilar Arias López, Bradley A Ong et al.•PLOS Digital Health•2023

  • School principals’ Covid-19 health literacy and its association with mental health

    Open Access•Marlene Meyer, Kevin Dadaczynski et al.•Health Promotion International•2026

  • Evaluating digital health literacy interventions for adults 45+ years

    Open Access•Rachel Sinanan, George Van Doorn et al.•Health Promotion International•2026

  • A data-based participatory approach for health equity and digital inclusion

    Open Access•Aristea Fotopoulou, Harriet Barratt et al.•Health Promotion International•2023

  • Online health information-seeking behaviour and mental well-being among Finnish higher education students during Covid-19

    Open Access•Hanna Rouvinen, Hannele Turunen et al.•Health Promotion International•2023

  • Factor structure of self-reported health literacy scales

    Open Access•Chihiro Moriishi, Keisuke Takano et al.•Health Promotion International•2025

  • Health literacy and digital health literacy profiles of final year Health and Physical Education pre-service teachers

    Open Access•Louisa R Peralta, Cassidy Kealy-Ashby et al.•Health Promotion International•2026

  • The multifaceted relationship between health promotion and health literacy

    Open Access•Lisa Gugglberger•Health Promotion International•2019

  • A Personalized Intervention to Increase Environmental Health Literacy and Readiness to Change in a Northern Nevada Population

    Open Access•Johanna R Rochester, Carol F Kwiatkowski et al.•International Journal of…•2024

  • Comparison of eHealth Literacy Scale (eHeals) and Digital Health Literacy Instrument (DHLI) in Assessing Electronic Health Literacy in Chinese Older Adults

    Open Access•Luyao Xie, Phoenix K H Mo•International Journal of…•2023

  • Sorting the Healthy Diet Signal from the Social Media Expert Noise

    Open Access•Theo Lynn, Pierangelo Rosati et al.•International Journal of…•2020

  • Validation of a Questionnaire Developed to Evaluate a Pediatric eHealth Website for Parents

    Open Access•Bruno José Nievas‐Soriano, Sonia García Duarte et al.•International Journal of…•2020

  • Validation of the extended e-health literacy scale

    Open Access•Gregor Petrič, Sara Atanasova•BMC Public Health•2024

  • Moderation modelling of Covid-19 digital health literacy and sense of coherence across subjective social class and age among university students in Ghana

    Open Access•Isaac Oduro Amoako, Isaac Amoako et al.•BMC Psychology•2023

  • Validation of the Covid-19 Digital Health Literacy Instrument in the Italian Language

    Open Access•Chiara Lorini, Veronica Velasco et al.•International Journal of…•2022

  • EHealth literacy level and its predictors among primary school teachers

    Open Access•Mehdi Khankolabi, Zahra Nowrozian et al.•BMC Public Health•2025

  • Digital health literacy among people with bipolar disorder in Germany – a cross-sectional survey

    Open Access•Linda Kokwaro, Helena Kruger et al.•Frontiers in Psychiatry•2025

  • Association of Digital Health Literacy with Future Anxiety as Mediated by Information Satisfaction and Fear of Covid-19

    Open Access•Sheng‐Chih Chen, Lê Đức Huy et al.•International Journal of…•2022

  • Use of Digital Technology as a Collaborative Tool among Nursing Students—Survey Study and Validation

    Open Access•Natalia Fischer-Suárez, David Lozano‐Paniagua et al.•International Journal of…•2022

  • The mediating role of mindfulness in the relationship between digital health literacy and e-healthy nutrition literacy

    Open Access•Canan Keleş Ertürk, Emine ARSLAN KILIÇOĞLU•BMC Psychology•2026

  • Facing the Growing Covid-19 Infodemic

    Open Access•Mitja Vrdelja, Sanja Vrbovšek et al.•International Journal of…•2021

  • Digital health literacy and associated factors among internet users from China

    Open Access•Bing-Yue Zhao, Long Huang et al.•BMC Public Health•2024

  • Infodemic Preparedness and Covid-19

    Open Access•Rafaela Rosário, Inês Fronteira et al.•International Journal of…•2022

  • Digital Health Literacy Related to Covid-19

    Open Access•María F Rivadeneira, María J Miranda-Velasco et al.•International Journal of…•2022

  • Competence and Attitude of Family Physicians towards Sexuality Regarding Their Sexual Orientation, Age, or Having a Partner—Survey Study and Validation

    Open Access•Javier Ramírez-Santos, Gracia Castro‐Luna et al.•International Journal of…•2022

  • Differences in digital health literacy and future anxiety between health care and other university students in England during the Covid-19 pandemic

    Open Access•Daniel Frings, Sophia Syke et al.•BMC Public Health•2022

  • Digital Health Literacy and Information-Seeking Behavior among University College Students during the Covid-19 Pandemic

    Open Access•Carsten Kronborg Bak, Jeanne Ø Krammer et al.•International Journal of…•2022

  • Association between social capital, mental health, and digital health literacy among the university students in China

    Open Access•Jiajia Zhao, Limei Nie et al.•BMC Public Health•2024

  • Associations between Covid-19-Related Digital Health Literacy and Online Information-Seeking Behavior among Portuguese University Students

    Open Access•Rafaela Rosário, Maria do Rosário Oliveira Martins et al.•International Journal of…•2020

  • Digital Stress Scale (DSC)

    Open Access•Agathi Argyriadi, Dimitra V Katsarou et al.•International Journal of…•2025

  • Validating the Digital Health Literacy Instrument in Relation to Covid-19 Information (Covid-DHL-K) among South Korean Undergraduates

    Open Access•H Chun, Eun-Ja Park et al.•International Journal of…•2022

  • Covid-19 and Health Information Seeking Behavior

    Open Access•Rubeena Zakar, Sarosh Iqbal et al.•International Journal of…•2021

  • Current status and influencing factors of digital health literacy among community-dwelling older adults in Southwest China

    Open Access•Siqi Liu, Hongyan Zhao et al.•BMC Public Health•2022

  • Development and psychometric validation of the measure of alternative care and support (Macs) for community-dwelling older adults

    Open Access•Anu Mohan, Teddy Andrews Jaihind Jothikaran et al.•Cogent Social Sciences•2026

  • The media literacy dilemma

    Open Access•Wei Peng, Jingbo Meng et al.•Frontiers in Communication•2024

  • The impact of health information exposure frequency on youth sleep quality under algorithmic recommendation

    Open Access•Siqi Chen, Jing Cao et al.•Frontiers in Public Health•2026

  • Addressing Health Literacy in Schools in Germany

    Open Access•Tessa Schulenkorf, Verena Krah et al.•Frontiers in Public Health•2021

  • Validation of the digital health literacy assessment among the university students in China

    Open Access•Limei Nie, Jiajia Zhao et al.•Frontiers in Public Health•2024

  • Research progress on digital health literacy of older adults

    Open Access•Xinxin Wang, Wei Luan•Frontiers in Public Health•2022

  • Digital health literacy and infodemic awareness among preschool teachers

    Open Access•Aslihan Çelik Çoban, Aslıhan Çelik Çoban et al.•Frontiers in Public Health•2026

  • Piloting a cancer awareness app across six European countries

    Open Access•Furqan Ahmed, Silvana Melissa Romero Saletti et al.•Frontiers in Public Health•2025

  • The influencing factors and generation path of digital health literacy among adolescents

    Open Access•Yi Wang, Qingwei Zeng et al.•Frontiers in Public Health•2026

  • Latent profiles of digital health literacy and perceived stigma in burn patients

    Open Access•Fengwen Yue, Liping Liu et al.•Frontiers in Public Health•2026

  • Lessons learned from a multi-site collaborative working toward a digital health use screening tool

    Open Access•Ann Marie Hernandez, Elaine C Khoong et al.•Frontiers in Public Health•2024

  • Digital health literacy and subjective wellbeing in the context of Covid-19

    Open Access•María F Rivadeneira, Carmen Salvador Coloma et al.•Frontiers in Public Health•2023

  • People behavioral during health information searching in Covid-19 era

    Open Access•Haitham Alzghaibi•Frontiers in Public Health•2023

  • Factors associated with Covid-19 misinformation rebuttal among college students

    Open Access•Yi Shan, Meng Ji•Frontiers in Public Health•2023

  • Research into the relationship between digital health literacy and healthy lifestyle behaviors

    Open Access•Murat Cetin, Rojan Gümüş•Frontiers in Public Health•2023

  • Adapted digital health literacy and health information seeking behavior among lower income groups in Malaysia during the Covid-19 pandemic

    Open Access•Roy Rillera Marzo, Hana Chen et al.•Frontiers in Public Health•2022

  • The negative association between health status and digital health literacy among Chinese youth

    Open Access•Peng Hou•Frontiers in Public Health•2026

  • Measuring digital health literacy and its associations with determinants and health outcomes in 13 countries

    Open Access•Diane Levin‐Zamir, Diane Levin-Zamir et al.•Frontiers in Public Health•2025

  • Assessing nurses’ digital competence for public health systems

    Open Access•Monika Wojcieszko, Mariusz Duplaga•Frontiers in Public Health•2026

  • Developing a digital health competency assessment framework for public health services

    Open Access•Yibei Yao, Jindan Cao et al.•Frontiers in Public Health•2025

  • Digital health literacy among older adults in China

    Open Access•Xingxia Zhang, Yongqing Yuan et al.•Frontiers in Public Health•2025

  • Predictors of well-being, future anxiety, and multiple recurrent health complaints among university students during the Covid-19 pandemic

    Open Access•Chiara Lorini, Giuseppe Cavallo et al.•Frontiers in Public Health•2023

  • Digital health literacy among primary and secondary school teachers—a quantitative study

    Open Access•Pia Rangnow, Lisa Fischer et al.•Frontiers in Public Health•2024

  • Investigating older adults users’ willingness to adopt wearable devices by integrating the technology acceptance model (UTAUT2) and the Technology Readiness Index theory

    Open Access•Chengzhen Wu, Gyoo Gun Lim•Frontiers in Public Health•2024

  • The digital health capital framework

    Open Access•Fen Lin, Pei Zhi et al.•Information Communication & Society•2026

  • Patient–Provider Discussions About Online Health Information in the Health Information National Trends Survey

    Open Access•Nicole Senft, Nicole Senft Everson et al.•Health Education & Behavior•2026

  • Profiling Cancer Patients Based on Their Motives for Seeking Informational and Emotional Support Online

    Open Access•Song L L Duimel, Annemiek J Linn et al.•Health Communication•2023

  • Emerging generative AI divide

    Open Access•Atsushi Nakagomi, Noriyuki Abe et al.•Telematics and Informatics•2026

  • The association between digital media literacy and technophobia among older adults

    Open Access•Niyazi Ayhan•Educational Gerontology•2026

  • Understanding Predictors of Adolescent Well‐Being in a Digital Age

    Open Access•Lies Sercu, Daniël Van Nijlen•Journal of Adolescence•2026

  • The Effect of Digital Literacy on Depression Among Older Adults With Chronic Diseases

    Open Access•Hyein Seo, Subin Yu•The International Journal of…•2026

  • Gender digital health literacy gap across age

    Open Access•John Elvis Hagan, Frank Quansah et al.•Psychology in the Schools•2023

  • Sustainable entrepreneurship education

    Open Access•Melinda Timea Fülöp, Javier Cifuentes-Faura•Sustainable Development•2024

  • Digital health literacy and trust in health information sources

    Open Access•Hirono Ishikawa, Rina Miyawaki et al.•SSM - Population Health•2025

  • Associations between digital literacy, health literacy, and digital health behaviors among rural residents

    Open Access•Hao Ji, Junqiang Dong et al.•International Journal for Equity…•2024

  • Covid-19 vaccine hesitancy and confidence in the Philippines and Malaysia

    Open Access•Ken Brackstone, Roy Rillera Marzo et al.•PLOS Global Public Health•2022

  • Respectful Patient–Provider Communication and Patient Portal Usage in Pregnant People of Color

    Open Access•Amy H Goh, Christopher Lee et al.•Health Equity•2025

  • U.S. Vietnamese Parents' Perceptions of Different Approaches for Confirming Adolescent HPV Vaccination Records in Research Studies

    Open Access•Lilian N Bui, Valerie Espinoza et al.•Health Expectations•2025

  • From Classroom to Cabinet

    Open Access•Warwick Young, Kristian Suen•Canadian Public Administration•2026

  • Digital Health Literacy Predictors and Covid-19 Online Information-Seeking Behaviors Among University Students from Romania

    Open Access•Emilia A Glodici, Monica Georgina Brînzac et al.•SAGE Open•2024

  • O uso do humor no mundo digital como banalização do Letramento em Saúde

    Open Access•Ana Carolina Ferreira Gonçalves, Sabrina Rocha Aguilar et al.•Cuadernos de Educación y Desarrollo•2025

  • Understanding eHealth Literacy From a Privacy Perspective

    Open Access•Xiaoqian Li•American Behavioral Scientist•2018

  • Instrumento de Conhecimento, Atitudes e Práticas (CAP) para enfrentamento de epidemias e pandemias

    Open Access•Mauro Renato Pascotini, Michele Bueno De Melo et al.•Saúde em Debate•2025

  • Validity of the evidence of the Health Literacy Scale and eHeals for older people

    Open Access•Leonardo Pestillo De Oliveira, Rosane Clys Barros Souza et al.•Saúde em Debate•2022

  • Evidência de validade da Escala de Literacia em Saúde e eHeals para idosos

    Open Access•Leonardo Pestillo De Oliveira, Rosane Clys Barros Souza et al.•Saúde em Debate•2022

  • Prospective relationship between electronic health literacy and health-promoting lifestyle among Chinese older adults

    Open Access•Luyao Xie, Phoenix K H Mo•Social Science & Medicine•2025

  • Patterns of Technology Use Among Older Adults With and Without Disabilities

    Nancy Gell, Nancy M Gell et al.•The Gerontologist•2015

  • The rand 36‐item health survey 1.0

    Open Access•Ron D Hays, Cathy Donald Sherbourne et al.•Health Economics•1993

  • Verbal reports as data.

    K Anders Ericsson, Herbert A Simon•Psychological Review•1980

  • eHeals

    Open Access•Cameron D Norman, Harvey A Skinner•Journal of Medical Internet…•2006

  • The Digital Divide Among Low-Income Homebound Older Adults

    Open Access•Namkee G Choi, Diana M Dinitto•Journal of Medical Internet…•2013

  • eHealth Literacy

    Open Access•Efrat Neter, Esther Brainin•Journal of Medical Internet…•2012

  • Low Health Literacy and Evaluation of Online Health Information

    Open Access•Nicola Diviani, Bas Van Den Putte et al.•Journal of Medical Internet…•2015

  • eHealth Literacy

    Open Access•Cameron D Norman, Harvey A Skinner•Journal of Medical Internet…•2006

  • Quick Assessment of Literacy in Primary Care

    Open Access•B D Weiss, Becki Weiss•The Annals of Family Medicine•2005

  • The Rand-36 measure of health-related quality of life

    Open Access•Ron D Hays, Leo S Morales•Annals of Medicine•2001

  • The prevalence of limited health literacy

    Michael K Paasche-Orlow, Michael K Paasche‐Orlow et al.•Journal of General Internal…•2005

  • Quality criteria were proposed for measurement properties of health status questionnaires

    Open Access•Caroline B Terwee, Sandra D M Bot et al.•Journal of Clinical Epidemiology•2007

  • Survey research methods

    Robert J Stimson•Handbook of Research Methods and…•2014

  • Coefficient alpha and the internal structure of tests

    Open Access•Lee J Cronbach•Psychometrika•1951

  • Rethinking Internet skills

    Open Access•Alexander J A M Van Deursen, Jan A G M Van Dijk et al.•Poetics•2011

Unique citing works90
Citations per year11,25
Citation span2018 - 2026 (9)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 82
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae