Towards rigorous practice
A framework for assessing naturalistic evaluations in the development sector
Bibliographic Data
| ID | 12567575 |
|---|---|
| Authors | Tracey E Phillips (University of Cape Town), Tracey Phillips (University of Cape Town), Jacques P De Wet (University of Cape Town), Jacques De Wet (0000-0002-5581-0567, University of Cape Town, corresponding author) |
| Year | 2017 |
| Volume | 23 |
| Issue | 1 |
| Pages | 102-120 |
| Publication date | 2017-01-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Evaluation (JOURNAL) |
| Journal identifiers | ISSN: 1356-3890 • E-ISSN: 1461-7153 |
| Publisher | SAGE Publishing (PUBLISHER • US) |
| DOI | 10.1177/1356389016682777 |
| OpenAlex | W2575551993 |
| Language | EN |
| Citations received | 4 |
| References cited | 26 |
This article reflects on the design and application of a framework for assessing the rigour of naturalistic evaluations in the development sector. The framework was employed in a review of a naturalistic evaluation ‘model’. It focused on the quality of evaluation results generated by the application of this model to outcome and impact assessments of development programmes. Naturalistic evaluation research is frequently portrayed as lacking in rigour, so we wanted to know whether the outcomes of development interventions could be assessed with an appropriate level of rigour when a naturalistic evaluation approach is used. The assessment entailed a meta-evaluation of five outcome/impact evaluations; these were undertaken by a Cape Town-based development consultancy over a four-year period. Using Lincoln and Guba’s trustworthiness criteria as the foundation for a meta-evaluation framework, we demonstrated that hallmarks of rigorous practice could be developed and applied to evaluations that employ a naturalistic evaluation model
Credibility · Engineering ethics · Epistemology · Foundation (evidence · Management science · Naturalism · Naturalistic observation · Outcome (game theory · Political science · Program evaluation · Psychological intervention · Rigour · Trustworthiness · Applied Psychology · Community Development and Social Impact · Engineering · Evaluation and Performance Assessment · Psychology · Public Policy and Administration Research · Social Psychology
Reliability and Validity in Qualitative Research
A Summative Evaluation of RCT Methodology
Checklists for improving rigour in qualitative research
Qualitative Data Analysis in Health Psychology
Problems of Reliability and Validity in Ethnographic Research
Fourth-Generation Evaluation
A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009
What Doesn’t Work? Three Failures, Many Answers
Experimentalism and development evaluation
Evaluating Methods for Estimating Program Effects
Handbook of Qualitative Research
Naturalistic inquiry
Verification Strategies for Establishing Reliability and Validity in Qualitative Research
Quality in Qualitative Research
Qualitative Quality
| Unique citing works | 4 |
|---|---|
| Citations per year | 0,8 |
| Citation span | 2021 - 2023 (3) |
| Citation velocity | historical |
| Highly cited | No |
| Citation types | Neutral: 4 |