Empty rituals? A qualitative study of users' experience of monitoring & evaluation systems in HIV interventions in western India
Bibliographic Data
| ID | 4602268 |
|---|---|
| Authors | Anuprita Shukla (0000-0001-5277-3732, Glasgow Caledonian University, corresponding author), Paul Teedon (0000-0002-4045-3659, Glasgow Caledonian University), F Cornish (0000-0002-3404-9385, London School of Economics and Political Science) |
| Year | 2016 |
| Volume | 168 |
| Pages | 7-15 |
| Publication date | 2016-11-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Social Science & Medicine (JOURNAL) |
| Journal identifiers | ISSN: 0277-9536 • E-ISSN: 1873-5347 |
| Publisher | Elsevier BV (PUBLISHER) |
| DOI | 10.1016/j.socscimed.2016.08.041 |
| PMID | 27632362 |
| OpenAlex | W2507663023 |
| Language | EN |
| Citations received | 12 |
| References cited | 27 |
In global health initiatives, particularly in the context of private philanthropy and its 'business minded' approach, detailed programme data plays an increasing role in informing assessments, improvements, evaluations, and ultimately continuation or discontinuation of funds for individual programmes. The HIV/AIDS literature predominantly treats monitoring as unproblematic. However, the social science of audit and indicators emphasises the constitutive power of indicators, noting that their effects at a grassroots level are often at odds with the goals specified in policy. This paper investigates users' experiences of Monitoring and Evaluation (M&E) systems in the context of HIV interventions in western India. Six focus groups (totalling 51 participants) were held with employees of 6 different NGOs working for government or philanthropy-funded HIV interventions for sex workers in western India. Ten donor employees were interviewed. Thematic analysis was conducted. NGO employees described a major gap between what they considered their "real work" and the indicators used to monitor it. They could explain the official purposes of M&E systems in terms of programme improvement and financial accountability. More cynically, they valued M&E experience on their CVs and the rhetorical role of data in demonstrating their achievements. They believed that inappropriate and unethical means were being used to meet targets, including incentives and coercion, and criticised indicators for being misleading and inflexible. Donor employees valued the role of M&E in programme improvement, financial accountability, and professionalising NGO-donor relationships. However, they were suspicious that NGOs might be falsifying data, criticised the insensitivity of indicators, and complained that data were under-used. For its users, M& E appears an 'empty ritual', enacted because donors require it, but not put to local use. In this context, monitoring is constituted as an instrument of performance management rather than as a means of rational programme improvement
Environmental health · Family medicine · Human immunodeficiency virus (HIV · Psychological intervention · Qualitative research · Social science · Sociology · Gender Studies · Global Maternal and Child Health · HIV/AIDS Research and Interventions · Medicine · Nursing · Poverty, Education, and Child Welfare · Psychology · Gerontology
NGO perspectives on the challenges and opportunities for real-world evaluation
Building coherent monitoring and evaluation plans with the Evaluation Planning Tool for global health
The performativity of monitoring and evaluation in international development interventions
Professionalisation experiences of a ‘business-minded’ HIV targeted intervention NGO in India
The use of monitoring data and community feedback mechanisms to increase HIV testing among men during a cluster-randomised community mobilisation trial in South Africa
Why the pseudo matters to global health
Doing Civil Society-Driven Social Accountability in a Disaster Context
An Integrated Merla (Monitoring, Evaluation, Research, Learning, and Adapting) Framework for Evidence-Based Program Improvement
Making global health knowledge
Collective demands and secret codes
Risk and Respectability
Burden of Proof
Foundations of Program Evaluation
Why is patient safety so hard in low-income countries? A qualitative study of healthcare workers’ views in two African hospitals
Development cooperation for health
Sex workers in HIV prevention
Local pain, global prescriptions? Using scale to analyse the globalisation of the HIV/Aids response
Evaluating aid
Unintended Consequences of Community-Based Monitoring Systems
Learning about scale, measurement and community mobilisation
Monitoring community mobilisation and organisational capacity among high-risk groups in a large-scale HIV prevention programme in India
The teacher's soul and the terrors of performativity
From brothel to boardroom
Reassembling epidemiology
Trust, accountability, and face-to-face interaction in North-South NGO relations
Thematic networks
Global Health Business
| Citations per year | 0.21 |
|---|---|
| Citation span | 1969 - 2024 (56) |
| Highly cited | No |