IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/5245.html
   My bibliography  Save this paper

Using mixed methods in monitoring and evaluation : experiences from international development

Author

Listed:
  • Bamberger, Michael
  • Rao, Vijayendra
  • Woolcock, Michael

Abstract

This paper provides an overview of the various ways in which mixing qualitative and quantitative methods could add value to monitoring and evaluating development projects. In particular it examines how qualitative methods could address some of the limitations of randomized trials and other quantitative impact evaluation methods; it also explores the importance of examining"process"in addition to"impact", distinguishing design from implementation failures, and the value of mixed methods in the real-time monitoring of projects. It concludes by suggesting topics for future research -- including the use of mixed methods in constructing counterfactuals, and in conducting reasonable evaluations within severe time and budget constraints.

Suggested Citation

  • Bamberger, Michael & Rao, Vijayendra & Woolcock, Michael, 2010. "Using mixed methods in monitoring and evaluation : experiences from international development," Policy Research Working Paper Series 5245, The World Bank.
  • Handle: RePEc:wbk:wbrwps:5245
    as

    Download full text from publisher

    File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2010/03/23/000158349_20100323100628/Rendered/PDF/WPS5245.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Abhijit Vinayak Banerjee & Alice H. Amsden & Robert H. Bates & Jagdish Bhagwati & Angus Deaton & Nicholas Stern, 2007. "Making Aid Work," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262026155, April.
    2. Angus Deaton, 2009. "Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development," Working Papers 1128, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
    3. Linda G. Morra Imas & Ray C. Rist, . "The Road to Results : Designing and Conducting Effective Development Evaluations," World Bank Publications, The World Bank, number 2699, September.
    4. T. Paul Schultz & John A. Strauss (ed.), 2008. "Handbook of Development Economics," Handbook of Development Economics, Elsevier, edition 1, volume 4, number 5.
    5. Ban, Radu & Rao, Vijayendra, 2009. "Is deliberation equitable ? evidence from transcripts of village meetings in south India," Policy Research Working Paper Series 4928, The World Bank.
    6. Jha, Saumitra & Rao, Vijayendra & Woolcock, Michael, 2007. "Governance in the Gullies: Democratic Responsiveness and Leadership in Delhi's Slums," World Development, Elsevier, vol. 35(2), pages 230-246, February.
    7. Christopher Gibson & Michael Woolcock, 2007. "Empowerment, Deliberative Development and Local Level Politics in Indonesia: Participatory Projects as a Source of Countervailing Power," Global Development Institute Working Paper Series 0807, GDI, The University of Manchester.
    8. Ravallion, Martin, 2008. "Evaluating Anti-Poverty Programs," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 59, pages 3787-3846, Elsevier.
    9. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009.pdf is not listed on IDEAS
    10. Lant Pritchett, 2002. "It pays to be ignorant: A simple political economy of rigorous program evaluation," Journal of Economic Policy Reform, Taylor & Francis Journals, vol. 5(4), pages 251-269.
    11. repec:pri:rpdevs:instruments_of_development.pdf is not listed on IDEAS
    12. François Bourguignon & Maurizio Bussolo & Luiz A. Pereira da Silva, 2008. "The Impact of Macroeconomic Policies on Poverty and Income Distribution : Macro-Micro Evaluation Techniques and Tools," World Bank Publications - Books, The World Bank Group, number 6586.
    13. Rao, Vijayendra & Gupta, Indrani & Jana, Smarajit, 2000. "Sex workers and the cost of safe sex - the compensating differential for condom use in Calcutta," Policy Research Working Paper Series 2334, The World Bank.
    14. Vijayendra Rao & Paromita Sanyal, 2010. "Dignity through Discourse: Poverty and the Culture of Deliberation in Indian Village Democracies," The ANNALS of the American Academy of Political and Social Science, , vol. 629(1), pages 146-172, May.
    15. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009 is not listed on IDEAS
    16. Vijayendra Rao, 2000. "Price Heterogeneity And “Real” Inequality: A Case Study Of Prices And Poverty In Rural South India," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 46(2), pages 201-211, June.
    17. Rao, Vijayendra & Gupta, Indrani & Lokshin, Michael & Jana, Smarajit, 2003. "Sex workers and the cost of safe sex: the compensating differential for condom use among Calcutta prostitutes," Journal of Development Economics, Elsevier, vol. 71(2), pages 585-603, August.
    18. Benjamin A. Olken, 2007. "Monitoring Corruption: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 115(2), pages 200-249.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gisselquist, Rachel & Niño-Zarazúa, Miguel, 2013. "What can experiments tell us about how to improve governance?," MPRA Paper 49300, University Library of Munich, Germany.
    2. Lant Pritchett & Salimah Samji & Jeffrey S. Hammer, 2012. "It's All about MeE: Using Structured Experiential Learning ('e') to Crawl the Design Space," WIDER Working Paper Series wp-2012-104, World Institute for Development Economic Research (UNU-WIDER).
    3. Gisselquist, Rachel & Niño-Zarazúa, Miguel, 2013. "What can experiments tell us about how to improve governance?," MPRA Paper 49300, University Library of Munich, Germany.
    4. William Easterly, 2009. "Can the West Save Africa?," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 373-447, June.
    5. Lant Pritchett & Salimah Samji & Jeffrey Hammer, 2012. "It’s All About MeE: Using Structured Experiential Learning (‘e’) to Crawl the Design Space," CID Working Papers 249, Center for International Development at Harvard University.
    6. Antonio Estache, 2010. "A survey of impact evaluations of infrastructure projects, programs and policies," Working Papers ECARES 2010_005, ULB -- Universite Libre de Bruxelles.
    7. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    8. Benedikte Bjerge & Nathan Clark & Peter Fisker & Emmanuel Raju, 2016. "Technology and Information Sharing in Disaster Relief," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-20, September.
    9. Niklas Jakobsson & Andreas Kotsadam, 2013. "The law and economics of international sex slavery: prostitution laws and trafficking for sexual exploitation," European Journal of Law and Economics, Springer, vol. 35(1), pages 87-107, February.
    10. Marina Giusta & Maria Tommaso & Steinar Strøm, 2009. "Who is watching? The market for prostitution services," Journal of Population Economics, Springer;European Society for Population Economics, vol. 22(2), pages 501-516, April.
    11. Mazzutti, Caio Cícero Toledo Piza da Costa, 2016. "Three essays on the causal impacts of child labour laws in Brazil," Economics PhD Theses 0616, Department of Economics, University of Sussex Business School.
    12. Maren Duvendack & Richard Palmer-Jones, 2012. "High Noon for Microfinance Impact Evaluations: Re-investigating the Evidence from Bangladesh," Journal of Development Studies, Taylor & Francis Journals, vol. 48(12), pages 1864-1880, December.
    13. Miriam Bruhn & David McKenzie, 2009. "In Pursuit of Balance: Randomization in Practice in Development Field Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 200-232, October.
    14. Krauss, Alexander, 2021. "Assessing the overall validity of randomised controlled trials," LSE Research Online Documents on Economics 112576, London School of Economics and Political Science, LSE Library.
    15. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    16. Boris Bravo-Ureta & William Greene & Daniel Solís, 2012. "Technical efficiency analysis correcting for biases from observed and unobserved variables: an application to a natural resource management project," Empirical Economics, Springer, vol. 43(1), pages 55-72, August.
    17. Rao, Vijayendra & Ananthpur, Kripa & Malik, Kabir, 2017. "The Anatomy of Failure: An Ethnography of a Randomized Trial to Deepen Democracy in Rural India," World Development, Elsevier, vol. 99(C), pages 481-497.
    18. Margaret Grosh & Carlo del Ninno & Emil Tesliuc & Azedine Ouerghi, 2008. "For Protection and Promotion : The Design and Implementation of Effective Safety Nets," World Bank Publications - Books, The World Bank Group, number 6582.
    19. Jakobsson, Niklas & Kotsadam, Andreas, 2009. "What explains attitudes toward prostitution?," Working Papers in Economics 349, University of Gothenburg, Department of Economics.
    20. Jeffrey R. Vincent, 2016. "Impact Evaluation of Forest Conservation Programs: Benefit-Cost Analysis, Without the Economics," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 63(2), pages 395-408, February.

    More about this item

    Keywords

    Poverty Monitoring&Analysis; Scientific Research&Science Parks; Science Education; Poverty Impact Evaluation; Statistical&Mathematical Sciences;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:5245. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.