Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

The Quality of Mixed Methods Studies in Health Services Research

Bibliographic Data

ID23325166
AuthorsAlicia O’cathain (0000-0003-4033-506X, University of Sheffield), Alicia O'Cathain (University of Sheffield), Elizabeth Murphy (0000-0003-0846-7943, University of Nottingham), Jon Nicholl (0000-0001-5436-1264, University of Sheffield)
Year2008
Volume13
Issue2
Pages92-98
Publication date2008-04-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueJournal of Health Services Research & Policy (JOURNAL)
Journal identifiersISSN: 1355-8196 • E-ISSN: 1758-1060
PublisherSAGE Publications (PUBLISHER • US)
DOI10.1258/jhsrp.2007.007074
PMID18416914
OpenAlexW2152129467
LanguageEN
Citations received195
References cited23

OBJECTIVES: To assess the quality of mixed methods studies in health services research (HSR). METHODS: We identified 118 mixed methods studies funded by the Department of Health in England between 1994 and 2004, and obtained proposals and/or final reports for 75. We applied a set of quality questions to both the proposal and report of each study, addressing the success of the study, the mixed methods design, the individual qualitative and quantitative components, the integration between methods and the inferences drawn from completed studies. RESULTS: Most studies were completed successfully. Researchers mainly ignored the mixed methods design and described only the separate components of a study. There was a lack of justification for, and transparency of, the mixed methods design in both proposals and reports, and this had implications for making judgements about the quality of individual components in the context of the design used. There was also a lack of transparency of the individual methods in terms of clear exposition of data collection and analysis, and this was more a problem for the qualitative than the quantitative component: 42% (19/45) versus 18% (8/45) of proposals (p = 0.011). Judgements about integration could rarely be made due to the absence of an attempt at integration of data and findings from different components within a study. CONCLUSIONS: The HSR community could improve mixed methods studies by giving more consideration to describing and justifying the design, being transparent about the qualitative component, and attempting to integrate data and findings from the individual components.

Component (thermodynamics) · Context (archaeology) · Data collection · Data quality · Data science · Management science · Multimethodology · Operations management · Process management · Qualitative property · Qualitative research · Quality (philosophy) · Research design · Set (abstract data type) · Sociology · Statistics · Transparency (behavior) · Computer Science · Engineering · Focus Groups and Qualitative Methods · Health Policy Implementation Science · Mathematics · Meta-analysis and systematic reviews · Psychology

  • Motivators of Sexual Violence Disclosures and Mental Health

    Open Access•Rannveig Sigurvinsdottir, Karen Birna Þorvaldsdóttir et al.•Violence Against Women•2026

  • Inpatient non-communicable disease patterns and influencing factors at two tertiary hospitals in New Zealand and China

    Open Access•Yanhua Liu, Mengxue Zeng et al.•Global Health Action•2026

  • Problematic caregiving activities among family carers of older adults with disabilities

    Oladele Ademola Atoyebi, Maude Beaudoin et al.•International Journal of Care and…•2021

  • Emerging Adulthood Uses and Gratifications of Social Media During the Covid-19 Pandemic

    Open Access•J V Cleofas, Blulean Terosa Albao et al.•Emerging Adulthood•2022

  • Scaling Up a Community-Based Exercise Program for Women in Difficult Life Situations in Germany—The BIG Project as a Case-Study

    Open Access•Annika Herbert-Maul, Karim Abu-Omar et al.•International Journal of…•2021

  • Care Recommendations for the Chronic Risk of Covid-19

    Open Access•Alexandra González Aguña, Marta Fernández Batalla et al.•International Journal of…•2022

  • Physicians’ Perspectives on the Implementation of the Second Opinion Directive in Germany—An Exploratory Sequential Mixed-Methods Study

    Open Access•Susann May, Dunja Bruch et al.•International Journal of…•2022

  • Improving Health Care for Patients with Multimorbidity

    Open Access•Cathrine Bell, Charlotte Appel et al.•International Journal of…•2022

  • Operational challenges of engaging development partners in district health planning in Tanzania

    Open Access•James C Kiologwe, Ukio Kusirye et al.•BMC Public Health•2022

  • Between now and later

    Open Access•Vivian Wan-Cheong Yim, Qianyun Wang et al.•BMC Public Health•2024

  • Covid-19 Crisis – Lasting Effects on Seafarers’ Well-Being and Its Potential Impact on Retention

    Open Access•María Carrera-Arce, Raphaël Baumler et al.•INQUIRY The Journal of Health…•2025

  • Process evaluation of complex interventions

    Open Access•Gary F Moore, Suzanne Audrey et al.•BMJ•2015

  • Validity

    Open Access•Nancy L Leech, Amy B Dellinger et al.•Encyclopedia of Applied Linguistics•2012

  • Validity in Mixed Methods Research

    Open Access•Nancy L Leech, Amy B Dellinger et al.•Encyclopedia of Applied Linguistics•2026

  • Describing and Illustrating Data in Mixed Methods Research

    Open Access•Pamela M Wesely•Encyclopedia of Applied Linguistics•2025

  • Integrating Quantitative and Qualitative Results in Health Science Mixed Methods Research Through Joint Displays

    Open Access•Timothy C Guetterman, Michael D Fetters et al.•The Annals of Family Medicine•2015

  • Convergent and sequential synthesis designs

    Open Access•Quan Nha Hong, Pierre Pluye et al.•Systematic Reviews•2017

  • Factors influencing variation in implementation outcomes of the redesigned community health fund in the Dodoma region of Tanzania

    Open Access•Albino Kalolo, Lara Gautier et al.•BMC Public Health•2021

  • A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews

    Open Access•Pierre Pluye, Marie‐pierre Gagnon et al.•International Journal of Nursing…•2009

  • Using mixed methods in health research

    Open Access•Shema Tariq, Justin Woodman et al.•JRSM Short Reports•2013

  • Perceived barriers to smoking cessation in selected vulnerable groups

    Open Access•Laura Twyman, Billie Bonevski et al.•BMJ Open•2014

  • Republished research: Implementation research: what it is and how to do it

    David H Peters, Thomas Adam et al.•British Journal of Sports Medicine•2014

  • Combining qualitative and quantitative research within mixed method research designs

    Open Access•Ulrika Östlund, Lisa Kidd et al.•International Journal of Nursing…•2011

  • Quick and dirty? A systematic review of the use of rapid ethnographies in healthcare organisation and delivery

    Cecilia Vindrola-Padros, Bruno Vindrola-Padrós•BMJ Quality & Safety•2018

  • ‘Are we getting through to them? And in what way?’ Communicating physical activity with adolescents

    Open Access•Caera L Grady, Elaine Murtagh et al.•Health Promotion International•2025

  • Perceived Social Support and Associated Factors among Caregivers of Individuals with Heart Failure

    Open Access•Ahtisham Younas, Marco Di Nitto et al.•Health & Social Care in the…•2023

  • Interventions Targeting the Mental Health and Well-being of Care-Experienced Children and Young People

    Open Access•Rhiannon E Evans, Rhiannon Evans et al.•The British Journal of Social Work•2024

  • Mental and Physical Well-Being and Burden in Palliative Care Nursing

    Open Access•Susann May, Franziska Gabb et al.•International Journal of…•2022

  • Motivations to exercise in young men following a residential weight loss programme conducted in National Service - a mixed methods study

    Open Access•Alexander Wilhelm Gorny, Mui Cheng Low et al.•BMC Public Health•2021

  • It Needs a Full-Time Dedicated Person to Do This Job in Our Local Communities with Our Aboriginal Health Services”—Aboriginal and Torres Strait Islander Health Workers and Practitioners Perspectives on Supporting Smoking Cessation during Pregnancy

    Open Access•Amanual G Mersha, Richard Maddox et al.•International Journal of…•2022

  • Patient and Public Involvement in Paediatric Pragmatic Randomized Controlled Trials

    Open Access•Shelley Vanderhout, Shipra Taneja et al.•Children•2025

  • Implementing a Physical Activity Promoting Program in a Flex-Office

    Open Access•Viktoria Wahlström, Anncristine Fjellman-Wiklund et al.•International Journal of…•2019

  • On the Road to Net Zero Health Care Systems

    Open Access•Léa Elisa Weimann, Léa Weimann et al.•International Journal of…•2022

  • The Impact of Telepresence Robots on Family Caregivers and Residents in Long-Term Care

    Open Access•Lillian Hung, Jennifer S Wong et al.•International Journal of…•2025

  • Effects of Aquatic Therapy for Children with Autism Spectrum Disorder on Social Competence and Quality of Life

    Open Access•Javier Güeita‐Rodríguez, Anna Ogonowska-Słodownik et al.•International Journal of…•2021

  • Nurses’ Involvement in the Development and Usability Assessment of an Innovative Peripheral Intravenous Catheterisation Pack

    Open Access•Paulo Santos-Costa, Mariana Alves et al.•International Journal of…•2022

  • Infection prevention and control measures for Ebola disease and their outcomes from the perspective of health care workers

    Open Access•Gladys N Honein-AbouHaidar, Gladys Honein-AbouHaidar et al.•BMC Public Health•2026

  • An opportunity to sleep well in hospital

    Open Access•Anna Hurley‐Wallace, Anna Louise Hurley-Wallace et al.•BMC Psychology•2024

  • Interprofessional Training on Substance Misuse and Addiction

    Open Access•Liz Paola Domingues, Elaine Lucas Dos Santos et al.•International Journal of…•2023

  • Health literacy in individuals with knee pain—a mixed methods study

    Open Access•Charlotte Sylwander, Astrid Klopstad Wahl et al.•BMC Public Health•2023

  • Instructors’ Views on and Experiences with Last Aid Courses as a Means for Public Palliative Care Education—A Longitudinal Mixed-Methods Study

    Open Access•Georg Bollig, Sindy Müller-Koch et al.•International Journal of…•2025

  • Consensus Recommendations for Maintaining Neurorehabilitation Quality During Healthcare Crises

    Open Access•P Ferré, Diana Zidarov et al.•INQUIRY The Journal of Health…•2025

  • Influence of Provider and Leader Perspectives about Concurrent Tobacco-Use Care during Substance-Use Treatment on Their Tobacco Intervention Provision with Clients

    Open Access•Maggie Britton, Isabel M Leal et al.•International Journal of…•2023

  • Prevalence vs impact

    Open Access•Amanda Drury, Payne et al.•Quality of Life Research•2021

  • Development of a Digital Intervention Incorporating Habit Formation Techniques for Medication Adherence

    Open Access•Sung Kyung Kim, Hye Ri Hwang et al.•INQUIRY The Journal of Health…•2025

  • Health Equity Implications of the Covid-19 Lockdown and Visitation Strategies in Long-Term Care Homes in Ontario

    Open Access•Ammar Saad, Olivia Magwood et al.•International Journal of…•2022

  • Between Restrictive and Supportive Devices in the Context of Physical Restraints

    Open Access•Alvisa Palese, Jessica Longhini et al.•International Journal of…•2021

  • How Should Job Crafting Interventions Be Implemented to Make Their Effects Last? Protocol for a Group Concept Mapping Study

    Open Access•Marta Roczniewska, Emma Hedberg Rundgren et al.•International Journal of…•2022

  • How social representations of sexually transmitted infections influence experiences of genito-urinary symptoms and care-seeking in Britain

    Open Access•Fiona Mapp, Ford Hickson et al.•BMC Public Health•2016

  • Exploring Families’ Acceptance of Wearable Activity Trackers

    Open Access•Amy Creaser, Amy V Creaser et al.•International Journal of…•2022

  • Perception and Performance of Physical Activity Behavior after Head and Neck Cancer Treatment

    Open Access•M J Sealy, Martijn M Stuiver et al.•International Journal of…•2021

  • Towards an understanding of community-engaged efforts in addressing the youth substance use in the Democratic Republic of the Congo

    Open Access•Muqian Deng, Minghui Deng et al.•BMC Public Health•2025

  • School nursing in Germany - a developing field

    Open Access•Jana Kaden, Birte Berger‐Höger•BMC Public Health•2025

  • Utilization of Participatory Research Theory and a National Framework to Advance a State Food Security Research Agenda

    Open Access•Barbara Gordon, Jenifer Reader et al.•International Journal of…•2024

  • Access to Refugee and Migrant Mental Health Care Services during the First Six Months of the Covid-19 Pandemic

    Open Access•Joseph Benjamen, Girard et al.•International Journal of…•2021

  • Evidencing the relational and situated aspects of complex social systems affecting health

    Open Access•Catherine Goodfellow, Chloé Bate et al.•SSM - Mental Health•2026

  • Building multi-sectoral alliances to co-design and pilot a gender-transformative comprehensive sexuality education intervention for adolescents

    Open Access•Alejandra López Gómez, Maria Lohan et al.•Reproductive Health•2026

  • Management of miscarriage

    Open Access•M Galeotti, G Mitchell et al.•Reproductive Health•2026

  • Development and evaluation of ‘Learning-Bytes’

    Open Access•Sarah McMullen-Roach, Caroline Fryer et al.•BMC Medical Education•2026

  • Trainee nurses and midwives’ perception and experiences of psychological safety and interactive communication in the classroom and clinical settings in Ghana

    Open Access•Olivia Nyarko Mensah, Elizabeth Boatemaa et al.•BMC Medical Education•2026

  • Feasibility of a blended learning approach to teaching comprehensive geriatric assessment

    Open Access•Xiaoting Huang, K Sri Karpageshwary et al.•BMC Medical Education•2026

  • Blended peer-led research curriculum with AI integration improves postgraduate students’ academic performance and satisfaction

    Open Access•Zuhair S Natto•BMC Medical Education•2026

  • From mannequins to humans – are manual therapy motor skills transferable? A mixed-methods study

    Open Access•Martha Funabashi, Nicole M Smith et al.•BMC Medical Education•2026

  • Minority language, Mandarin, and English in contact

    Open Access•Leng Cuojie, Mohd Rashid Bin Mohd Saad et al.•Journal of Multilingual and…•2026

  • Wellbeing Ways

    Open Access•Kate Anderson, Katharine A Anderson et al.•Frontiers in Education•2026

  • Effect of formative feedback on human anatomy learning

    Open Access•Noelia Arroyo, Constanza Quizás et al.•Frontiers in Education•2025

  • Videoconferencing fatigue and online student engagement among Filipino senior high school students

    Open Access•Mikaela Jasmin F Dacillo, Jhoana Katrina M Dizon et al.•Frontiers in Education•2022

  • The Effect of Mentoring on Undergraduate Mentors

    Open Access•Andrew S Leavitt, Kari L Nelson et al.•Frontiers in Education•2022

  • Factors Influencing Fidelity to a Calorie Posting Policy in Public Hospitals

    Open Access•Claire Kerins, Colette Kelly et al.•Frontiers in Public Health•2021

  • Reforming the white coat economy

    Open Access•Zhiling Shen, Jiao Guo et al.•Frontiers in Public Health•2026

  • Potential effectiveness of an Icope-based long-term care intervention program for old patients with disabilities in nursing homes

    Open Access•Rixin Qin, Kexin Huang et al.•Frontiers in Public Health•2025

  • Oral health literacy and its related factors among community-dwelling older adults

    Open Access•Yiqing Liang, Jingjing Wang et al.•Frontiers in Public Health•2026

  • Trainees’ experience and expectations of cerebrocardiac health advisors training programs in China

    Open Access•Chun Zhang, Xiaojuan Su et al.•Frontiers in Public Health•2026

  • Bridging the gap between policy and practice

    Open Access•Juanmiao Shi, Gu Jintu et al.•Frontiers in Public Health•2026

  • Chronic disease management

    Open Access•Jie Xue, Wei Jiang et al.•Frontiers in Public Health•2026

  • Adapted Portuguese folk dance intervention for subacute rehabilitation post-stroke

    Open Access•Júlio Alexandre Belo Andrade Fernandes, Júlio Belo Fernandes et al.•Frontiers in Public Health•2023

  • Long-term burden of war injuries among civilians in LMICs

    Open Access•Elsa Kobeissi, José Mercade et al.•Frontiers in Public Health•2023

  • Application of persuasive system design in mobile health interventions for chronic disease management

    Open Access•Kai Zhang, Yurong Jiang et al.•Frontiers in Public Health•2025

  • Influence of social determinants on lifestyle modification adherence in people with prediabetes

    Open Access•Ana Carvalho-Azevedo, Manuela Abbate et al.•Frontiers in Public Health•2025

  • Associated factors of home hospice care utilization by the terminally ill older adults

    Open Access•Jie Peng, Xiaoling Feng et al.•Frontiers in Public Health•2025

  • Perception and attitude of specialist nurses on “Internet + Nursing Service”

    Open Access•Mengfan Ma, Daishan Li et al.•Frontiers in Public Health•2026

  • The anatomy of AI implementation skepticism in Polish healthcare

    Open Access•Jarosław Garski, Dariusz Walkowiak•Frontiers in Public Health•2026

  • Perceived value and educational implications of traditional Chinese medicine nursing

    Open Access•Luxin Wang, Weihong Zhang et al.•Frontiers in Public Health•2026

  • Online Physical Education

    Open Access•Ronit Ben Amotz, Gary Green et al.•Education Sciences•2025

  • Exploring Technological Challenges and Growth in Faculty Transition to Remote Teaching during the Covid-19 Pandemic

    Open Access•Driscoll DeVaul, Angela Burrell et al.•Education Sciences•2023

  • The Impact of Covid-19 on Faculty Technological Knowledge Development at an Academic Medical Center

    Open Access•Xiaoshan Zhu Gordy, Driscoll DeVaul et al.•Education Sciences•2022

  • A Mixed Methods Evaluation of Wearable Technology

    Open Access•Patricia K Doyle–Baker, Jennie Petersen et al.•ISPRS International Journal of…•2024

  • Exploring local responses to coastal risks in Khulna City slums

    Open Access•M A Rakib, Ksheeten Roy et al.•International Journal of Disaster…•2025

  • Ethics as Situated Practice

    Open Access•Daniel Emeric-Méaulle, Pablo A Cantero-Garlito et al.•Social Sciences•2026

  • Bridging research integrity and global health epidemiology (BRIDGE) statement

    Open Access•Sandra Alba, Kristien Verdonck et al.•BMJ Global Health•2020

  • Supporting caregivers of children living with disability in a humanitarian context

    Open Access•Natalie Evans, Noorwhiza Ahmadi et al.•BMJ Global Health•2024

  • Bridging research integrity and global health epidemiology (BRIDGE) guidelines

    Open Access•Sandra Alba, Annick Lenglet et al.•BMJ Global Health•2020

  • Exploring the perceived impact and influence of women leaders across sub-Saharan Africa on health policy and gender equity

    Open Access•Anna Kalbarczyk, Milly Nakatabira et al.•BMJ Global Health•2025

  • Lessons learned from Covid-19 modelling efforts for policy decision-making in lower- and middle-income countries

    Open Access•Collins J Owek, Fatuma Hassan Guleid et al.•BMJ Global Health•2024

  • Rethinking paediatric sepsis care through local provider voices and lived systems

    Open Access•Charles Martyn‐Dickens, Charles Martyn-Dickens et al.•BMJ Global Health•2026

  • Delivering nutrition interventions to women and children in conflict settings

    Open Access•Shailja Shah, Zahra Ali Padhani et al.•BMJ Global Health•2021

  • Informed consent for polygenic risk score test in type 2 diabetes

    Open Access•Elisa Airikkala, Marja Kaunonen et al.•Research Ethics•2026

  • Years of the National Policy for Comprehensive Men’s Health Care in Brazil

    Open Access•Nilo Manoel Pereira Vieira Barreto, Jeferson Santos Araújo et al.•American Journal of Men s Health•2025

  • Predictive Factors for Depression and Anxiety in Men During the Perinatal Period

    Open Access•Jasleen Chhabra, Wendy W Li et al.•American Journal of Men s Health•2022

  • The role of music in improving academic performance and reducing stress among Chinese youth

    Open Access•Junhui Zhao, Peng Gao•Current Psychology•2025

  • Mixed methodology

    Abbas Tashakkori•Mixed methodology•1998

  • Linking Data

    Nigel Fielding, Jane Fielding•Linking Data•1986

  • Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field

    Open Access•Nicholas Mays, Catherine Pope et al.•Journal of Health Services…•2005

  • Qualitative research methods in health technology assessment

    Open Access•Murphy Murphy, Robert Dingwall et al.•Health Technology Assessment•1998

  • Toward Integrating Qualitative and Quantitative Methods

    Open Access•Allan Steckler, Kenneth R McLeroy et al.•Health Education Quarterly•1992

  • Designing A Mixed Methods Study In Primary Care

    Open Access•John W Creswell•The Annals of Family Medicine•2004

  • Qualitative research in health care

    Open Access•Catherine Pope•BMJ•2000

  • Research design

    Open Access•Marcellus Caldas, Miguel Pinto Caldas•Revista de Administração…•2003

  • Mixing Methods

    Julia Brannen•Mixing Methods•2017

  • Integration and Publications as Indicators of "Yield" From Mixed Methods Studies

    Open Access•Alicia O’cathain, Elizabeth Murphy et al.•Journal of Mixed Methods Research•2007

  • Quantity and Quality in Social Research

    Alan Bryman, June Audrey True•Quantity and quality in social…•2003

  • Designing and Conducting Mixed Methods Research

    John W Creswell, Vicki L Plano Clark•Designing and Conducting Mixed…•2017

  • Quantity and quality in social research

    Alan Bryman•Quantity and quality in social…•1992

  • What's Wrong With Ethnography

    M Hammersley•What's Wrong with Ethnography?•2013

Unique citing works195
Citations per year11,47
Citation span2009 - 2026 (18)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 187

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae