Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Lessons learned in evaluating system interdependencies using qualitative methods

Bibliographic Data

ID12347353
AuthorsEric Souvannasacd (0000-0003-3027-8612, The University of North Dakota, School of Medicine and Health Sciences, Grand Forks, ND, USA, corresponding author), Heather Engblom (The University of North Dakota, School of Medicine and Health Sciences, Grand Forks, ND, USA), Richard Van Eck (0000-0002-9826-9774, The University of North Dakota, School of Medicine and Health Sciences, Grand Forks, ND, USA), Ralph Renger (0000-0002-0224-1444, Just Evaluation Services, LLC, AZ, USA), Marc D Basson (0000-0001-9696-2789, University of North Dakota), Marc Basson (The University of North Dakota, School of Medicine and Health Sciences, Grand Forks, ND, USA)
Year2022
Volume22
Issue2
Pages108-125
Publication date2022-02-14
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueEvaluation Journal of Australasia (JOURNAL)
Journal identifiersISSN: 1035-719X • E-ISSN: 2515-9372
PublisherSAGE Publishing (PUBLISHER • US)
DOI10.1177/1035719x211066961
PMID36051982
OpenAlexW4293225104
LanguageEN
Citations received4
References cited57

This article shares lessons learned while evaluating the system interdependencies for a clinical and translational research centre (CTR). It explores the methodological challenge of discussing system concepts (e.g., cascading failures, feedback loops, and reflex arcs) with layperson participants during evaluation interviews. The article discusses the iterative process of moving from structured interview approaches in favor of an open narrative approach for data collection and lessons learned

Interdependence · Iterative and incremental development · Knowledge management · Layperson · Narrative · Political science · Process (computing · Process management · Sociology · Software engineering · Complex Systems and Decision Making · Computer Science · Engineering · Evaluation and Performance Assessment · Health Policy Implementation Science · Psychology

  • Applying the Renger System Test to Determine Whether a System Evaluation Is Fit for Evaluating a Complex Intervention

    Open Access•Ralph Renger, Elias Samuels et al.•American Journal of Evaluation•2025

  • A comparative case study illustrating the influence of a system perspective on the outcome evaluation of simple versus complex interventions

    Open Access•Ralph Renger, Jessica Renger et al.•Evaluation Journal of Australasia•2023

  • Application of Multi-Attribute Utility Analysis as a Methodological Framework in Academic–Clinical Partnership Evaluation

    Open Access•Sara North•American Journal of Evaluation•2024

  • Four suppositions about emergent properties of complex interventions that operate and function as systems

    Open Access•Ralph Renger, Jessica Renger et al.•Evaluation Journal of Australasia•2023

  • Learning From Strangers

    Robert S Weiss•Learning From Strangers•1995

  • The Systems View of Life

    Open Access•Fritjof Capra, Pier Luigi Luisi•Systems View of Life•2014

  • Evaluation Methodology Basics

    E Jane Davidson, E Davidson•Evaluation Methodology Basics•2005

  • Complexity Theory and the Social Sciences

    David Byrne, Gillian Callaghan•Complexity Theory and the Social…•2013

  • Qualitative research method-interviewing and observation

    Shazia Jamshed•Journal of Basic and Clinical…•2014

  • Cognitive load theory, learning difficulty, and instructional design

    Open Access•John Sweller•Learning and Instruction•1994

  • Critical discourse analysis

    Norman Fairclough•The Routledge handbook of…•2015

  • A Definition of Systems Thinking

    Open Access•Ross D Arnold, Ross Arnold et al.•Procedia Computer Science•2015

  • Cognitive Load Theory and Complex Learning

    Open Access•Jeroen J G Van Merriënboer, John Sweller•Educational Psychology Review•2005

  • Qualitative research and its place in psychological science.

    Anna Madill, Brendan Gough•Psychological Methods•2008

  • Rethinking the ClockWork of Work

    Open Access•Erin L Kelly, Phyllis Moen•Advances in Developing Human…•2007

  • Do people use language production to make predictions during comprehension?

    Open Access•Martin J Pickering, Simon Garrod•Trends in Cognitive Sciences•2007

  • Narrative-based evaluation demonstrates the value of a higher education professional learning network

    Open Access•Coralie Mccormack, Trudy Ambler et al.•Studies In Educational Evaluation•2016

  • (The Need for) A Model of Translational Mind Science Justice Research

    Open Access•Phillip Atiba Goff, Avital Mentovich et al.•Journal of Social and Political…•2013

  • Resistance to Evaluation

    Open Access•Sandy Taut, Dieter Brauns•Evaluation•2003

  • Systems thinking and evaluation

    Open Access•Richard Hummelbrunner•Evaluation•2011

  • Using Root Cause Analysis for Evaluating Program Improvement

    Open Access•Rebekah Coşkun, Abigail O Akande et al.•Evaluation Journal of Australasia•2012

  • System evaluation theory (SET)

    Open Access•Ralph Renger•Evaluation Journal of Australasia•2015

  • Lessons learned in evaluating the infrastructure of a Centre for Translational Research

    Open Access•Ralph Renger, Marc D Basson et al.•Evaluation Journal of Australasia•2020

  • Reworks

    Open Access•Ralph Renger, Brain Keogh et al.•Evaluation Journal of Australasia•2018

  • Heard any really good stories lately? A critique of the critics of narrative in educational research

    Open Access•Walter Doyle•Teaching and Teacher Education•1997

  • Utilization-Focused Evaluation

    John G Heilman, Michael Quinn Patton•The Western Political Quarterly•1979

  • A Guide to Conducting Consensual Qualitative Research

    Open Access•Clara E Hill, B J Thompson et al.•The Counseling Psychologist•1997

  • Using thematic analysis in psychology

    Open Access•Braun, Virginia Braun et al.•Qualitative Research in Psychology•2006

  • Qualitative inquiry and research design

    John W Creswell•Qualitative inquiry and research…•2013

  • Quality and trustworthiness in qualitative research in counseling psychology

    Susan L Morrow•Journal of Counseling Psychology•2005

  • The qualitative research interview

    Open Access•Barbara Dicicco-Bloom, Barbara DiCicco‐Bloom et al.•Medical Education•2006

  • Under Construction

    Karri Holley, Karri A Holley et al.•Theory Into Practice•2012

  • Reflections on the Narrative Research Approach

    Open Access•Torill Moen•International Journal of…•2006

  • The art(fulness) of open-ended interviewing

    Open Access•T Rapley, Timothy John Rapley•Qualitative Research•2001

Unique citing works4
Citations per year1.33
Citation span2023 - 2025 (3)
Citation velocityrecent
Highly citedNo
Citation typesNeutral: 4

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae