IDEAS home Printed from https://ideas.repec.org/a/eee/socmed/v168y2016icp7-15.html
   My bibliography  Save this article

Empty rituals? A qualitative study of users’ experience of monitoring & evaluation systems in HIV interventions in western India

Author

Listed:
  • Shukla, Anuprita
  • Teedon, Paul
  • Cornish, Flora

Abstract

In global health initiatives, particularly in the context of private philanthropy and its ‘business minded’ approach, detailed programme data plays an increasing role in informing assessments, improvements, evaluations, and ultimately continuation or discontinuation of funds for individual programmes. The HIV/AIDS literature predominantly treats monitoring as unproblematic. However, the social science of audit and indicators emphasises the constitutive power of indicators, noting that their effects at a grassroots level are often at odds with the goals specified in policy. This paper investigates users' experiences of Monitoring and Evaluation (M&E) systems in the context of HIV interventions in western India. Six focus groups (totalling 51 participants) were held with employees of 6 different NGOs working for government or philanthropy-funded HIV interventions for sex workers in western India. Ten donor employees were interviewed. Thematic analysis was conducted. NGO employees described a major gap between what they considered their “real work” and the indicators used to monitor it. They could explain the official purposes of M&E systems in terms of programme improvement and financial accountability. More cynically, they valued M&E experience on their CVs and the rhetorical role of data in demonstrating their achievements. They believed that inappropriate and unethical means were being used to meet targets, including incentives and coercion, and criticised indicators for being misleading and inflexible. Donor employees valued the role of M&E in programme improvement, financial accountability, and professionalising NGO-donor relationships. However, they were suspicious that NGOs might be falsifying data, criticised the insensitivity of indicators, and complained that data were under-used. For its users, M& E appears an ‘empty ritual’, enacted because donors require it, but not put to local use. In this context, monitoring is constituted as an instrument of performance management rather than as a means of rational programme improvement.

Suggested Citation

  • Shukla, Anuprita & Teedon, Paul & Cornish, Flora, 2016. "Empty rituals? A qualitative study of users’ experience of monitoring & evaluation systems in HIV interventions in western India," Social Science & Medicine, Elsevier, vol. 168(C), pages 7-15.
    • Handle: RePEc:eee:socmed:v:168:y:2016:i:c:p:7-15
    DOI: 10.1016/j.socscimed.2016.08.041
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0277953616304774
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socscimed.2016.08.041?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lorway, Robert & Khan, Shamshad, 2014. "Reassembling epidemiology: Mapping, monitoring and making-up people in the context of HIV prevention in India," Social Science & Medicine, Elsevier, vol. 112(C), pages 51-62.
    2. Biradavolu, Monica R. & Blankenship, Kim M. & George, Annie & Dhungana, Nimesh, 2015. "Unintended Consequences of Community-Based Monitoring Systems: Lessons from an HIV Prevention Intervention for Sex Workers in South India," World Development, Elsevier, vol. 67(C), pages 1-10.
    3. Hood, Christopher, 1995. "The "new public management" in the 1980s: Variations on a theme," Accounting, Organizations and Society, Elsevier, vol. 20(2-3), pages 93-109.
    4. Power, Michael, 1999. "The Audit Society: Rituals of Verification," OUP Catalogue, Oxford University Press, number 9780198296034.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nimesh Dhungana, 2020. "Doing Civil Society-Driven Social Accountability in a Disaster Context: Evidence from Post-Earthquake Nepal," Politics and Governance, Cogitatio Press, vol. 8(4), pages 395-406.
    2. Vijayakumar, Gowri, 2018. "Collective demands and secret codes: The multiple uses of “community” in “community mobilization”," World Development, Elsevier, vol. 104(C), pages 173-182.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wæraas, Arild, 2015. "Putting on the velvet glove: The paradox of "soft" core values in "hard" organizations," Working Paper Series 09-2015, Norwegian University of Life Sciences, School of Economics and Business.
    2. Mehrpouya, Afshin & Salles-Djelic, Marie-Laure, 2019. "Seeing like the market; exploring the mutual rise of transparency and accounting in transnational economic and market governance," Accounting, Organizations and Society, Elsevier, vol. 76(C), pages 12-31.
    3. Vijayakumar, Gowri, 2018. "Collective demands and secret codes: The multiple uses of “community” in “community mobilization”," World Development, Elsevier, vol. 104(C), pages 173-182.
    4. Guénin-Paracini, Henri & Malsch, Bertrand & Paillé, Anne Marché, 2014. "Fear and risk in the audit process," Accounting, Organizations and Society, Elsevier, vol. 39(4), pages 264-288.
    5. Ian Hodge & William M. Adams, 2016. "Short-Term Projects versus Adaptive Governance: Conflicting Demands in the Management of Ecological Restoration," Land, MDPI, vol. 5(4), pages 1-17, November.
    6. Ball, Amanda & Craig, Russell, 2010. "Using neo-institutionalism to advance social and environmental accounting," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 21(4), pages 283-293.
    7. Robbins, Geraldine & Lapsley, Irvine, 2015. "From secrecy to transparency: Accounting and the transition from religious charity to publicly-owned hospital," The British Accounting Review, Elsevier, vol. 47(1), pages 19-32.
    8. Rosta, Miklós, 2013. "New Public Management: opportunity for the Centre, thread for the Periphery," MPRA Paper 68474, University Library of Munich, Germany.
    9. Federica De Santis, 2016. "Auditing Standard Change and Auditors' Everyday Practice: A Field Study," International Business Research, Canadian Center of Science and Education, vol. 9(12), pages 41-54, December.
    10. Tóth, Balázs, 2021. "Milyen kapcsolatban állnak a közszféra reformjai a gazdaságpolitikai paradigmákkal? [How reforms of the public sector relate to the paradigms of economic policy]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(2), pages 205-222.
    11. Karim Jamal, 2008. "Mandatory Audit of Financial Reporting: A Failed Strategy for Dealing with Fraud," Accounting Perspectives, John Wiley & Sons, vol. 7(2), pages 97-110, May.
    12. Maria Rosaria Alfano & Anna Laura Baraldi & Claudia Cantabene, 2023. "Eppur si muove: an evaluation of museum policy reform in Italy," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 47(1), pages 97-131, March.
    13. Habersam, Michael & Piber, Martin & Skoog, Matti, 2013. "Knowledge balance sheets in Austrian universities: The implementation, use, and re-shaping of measurement and management practices," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 24(4), pages 319-337.
    14. Loke-Min Foo & Darinka Asenova & Stephen Bailey & John Hood, 2011. "Stakeholder Engagement and Compliance Culture," Public Management Review, Taylor & Francis Journals, vol. 13(5), pages 707-729, June.
    15. Sari Suomalainen & Outi Tahvonen & Helena Kahiluoto, 2022. "From Participation to Involvement in Urban Open Space Management and Maintenance," Sustainability, MDPI, vol. 14(19), pages 1-19, October.
    16. Mennicken, Andrea, 2006. "Translation and standardisation: audit world building in Post-Soviet Russia," LSE Research Online Documents on Economics 3033, London School of Economics and Political Science, LSE Library.
    17. Mr. Richard I Allen & Yasemin Hurcan & Peter Murphy & Mr. Maximilien Queyranne & Mr. Sami Yläoutinen, 2015. "The Evolving Functions and Organization of Finance Ministries," IMF Working Papers 2015/232, International Monetary Fund.
    18. repec:cuf:journl:y:2017:v:18:i:1:moreno-enguix is not listed on IDEAS
    19. repec:dau:papers:123456789/3505 is not listed on IDEAS
    20. Heli Hookana, 2011. "Measurement of Effectiveness, Efficiency and Quality in Public Sector Services: Interventionist Empirical Investigations," MIC 2011: Managing Sustainability? Proceedings of the 12th International Conference, Portorož, 23–26 November 2011 [Selected Papers],, University of Primorska, Faculty of Management Koper.
    21. Nolas, Sevasti-Melissa, 2011. "Reflections on the enactment of children's participation rights through research: Between transactional and relational spaces," Children and Youth Services Review, Elsevier, vol. 33(7), pages 1196-1202, July.
    22. Ferry, Laurence & Zakaria, Zamzulaila & Zakaria, Zarina & Slack, Richard, 2018. "Framing public governance in Malaysia: Rhetorical appeals through accrual accounting," Accounting forum, Elsevier, vol. 42(2), pages 170-183.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:socmed:v:168:y:2016:i:c:p:7-15. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/315/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.