IDEAS home Printed from https://ideas.repec.org/p/hal/wpaper/ird-01445209.html
   My bibliography  Save this paper

L'étalon-or des évaluations randomisées : du discours de la méthode à l'économie politique

Author

Listed:
  • Florent Bedecarrats

    (AFD - Agence française de développement)

  • Isabelle Guérin

    (IRD [France-Sud] - Institut de Recherche pour le Développement, DIAL - Développement, institutions et analyses de long terme)

  • François Roubaud

    (IRD [France-Sud] - Institut de Recherche pour le Développement, DIAL - Développement, institutions et analyses de long terme, LEDa - Laboratoire d'Economie de Dauphine - Université Paris Dauphine-PSL - PSL - Université Paris Sciences et Lettres)

Abstract

This last decade has seen the emergence of a new field of research in development economics: randomised control trials. This paper explores the contrast between the (many) limitations and (very narrow) real scope of these methods and their success in sheer number and media coverage. Our analysis suggests that the paradox is due to a particular economic and political mix driven by the innovative strategies used by this new school's researchers and by specific interests and preferences in the academic world and the donor community.

Suggested Citation

  • Florent Bedecarrats & Isabelle Guérin & François Roubaud, 2017. "L'étalon-or des évaluations randomisées : du discours de la méthode à l'économie politique," Working Papers ird-01445209, HAL.
    • Handle: RePEc:hal:wpaper:ird-01445209
    Note: View the original document on HAL open archive server: https://ird.hal.science/ird-01445209
    as

    Download full text from publisher

    File URL: https://ird.hal.science/ird-01445209/document
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Angus Deaton, 2009. "Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development," Working Papers 1128, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
    2. Michael Rosholm & Lars Skipper, 2009. "Is labour market training a curse for the unemployed? Evidence from a social experiment," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(2), pages 338-365, March.
    3. Paul Shaffer, 2011. "Against Excessive Rhetoric in Impact Assessment: Overstating the Case for Randomised Controlled Experiments," Journal of Development Studies, Taylor & Francis Journals, vol. 47(11), pages 1619-1635.
    4. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    5. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    6. Martin Ravallion, 2009. "Evaluation in the Practice of Development," The World Bank Research Observer, World Bank, vol. 24(1), pages 29-53, March.
    7. James J. Heckman, 1991. "Randomization and Social Policy Evaluation Revisited," NBER Technical Working Papers 0107, National Bureau of Economic Research, Inc.
    8. Rodrik, Dani, 2008. "The New Development Economics: We Shall Experiment, but How Shall We Learn?," Working Paper Series rwp08-055, Harvard University, John F. Kennedy School of Government.
    9. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009.pdf is not listed on IDEAS
    10. Glenn W. Harrison, 2011. "Randomisation and Its Discontents," Journal of African Economies, Centre for the Study of African Economies, vol. 20(4), pages 626-652, August.
    11. Christopher B. Barrett & Michael R. Carter, 2010. "The Power and Pitfalls of Experiments in Development Economics: Some Non-random Reflections," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 32(4), pages 515-548.
    12. Abhijit Banerjee & Dean Karlan & Jonathan Zinman, 2015. "Six Randomized Evaluations of Microcredit: Introduction and Further Steps," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 1-21, January.
    13. Abhijit Banerjee & Esther Duflo & Rachel Glennerster & Cynthia Kinnan, 2015. "The Miracle of Microfinance? Evidence from a Randomized Evaluation," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 22-53, January.
    14. repec:pri:rpdevs:instruments_of_development.pdf is not listed on IDEAS
    15. Rachel Glennerster, 2012. "The Power of Evidence: Improving the Effectiveness of Government by Investing in More Rigorous Evaluation," National Institute Economic Review, National Institute of Economic and Social Research, vol. 219(1), pages 4-14, January.
    16. Howard White, 2014. "Current Challenges in Impact Evaluation," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 26(1), pages 18-30, January.
    17. Labrousse, Agnès, 2010. "Nouvelle économie du développement et essais cliniques randomisés : une mise en perspective d’un outil de preuve et de gouvernement," Revue de la Régulation - Capitalisme, institutions, pouvoirs, Association Recherche et Régulation, vol. 7.
    18. James Heckman & Jeffrey Smith & Christopher Taber, 1998. "Accounting For Dropouts In Evaluations Of Social Programs," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 1-14, February.
    19. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009 is not listed on IDEAS
    20. Florent Bédécarrats, 2012. "L'impact de la microfinance : un enjeu politique au prisme de ses controverses scientifiques," Mondes en développement, De Boeck Université, vol. 0(2), pages 127-142.
    21. Lant Pritchett, Justin Sandefur, 2013. "Context Matters for Size: Why External Validity Claims and Development Practice Don't Mix-Working Paper 336," Working Papers 336, Center for Global Development.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Florent Bédécarrats & Isabelle Guérin & François Roubaud, 2019. "All that Glitters is not Gold. The Political Economy of Randomized Evaluations in Development," Development and Change, International Institute of Social Studies, vol. 50(3), pages 735-762, May.
    2. Florent Bédécarrats & Isabelle Guérin & François Roubaud, 2015. "The gold standard for randomized evaluations: from discussion of method to political economy," Working Papers DT/2015/01, DIAL (Développement, Institutions et Mondialisation).
    3. Florent Bédécarrats & Isabelle Guérin & François Roubaud, 2015. "The gold standard for randomised evaluations: from discussion of method to political economics," Working Papers CEB 15-009, ULB -- Universite Libre de Bruxelles.
    4. Florent BEDECARRATS & Isabelle GUERIN & François ROUBAUD, 2017. "L'étalon-or des évaluations randomisées : économie politique des expérimentations aléatoires dans le domaine du développement," Working Paper 753120cd-506f-4c5f-80ed-7, Agence française de développement.
    5. McHugh, Neil & Biosca, Olga & Donaldson, Cam, 2015. "Microfinance, health and randomised trials," Health Economics Working Paper Series 201501, Glasgow Caledonian University, Yunus Centre.
    6. Ksoll, Christopher & Lilleør, Helene Bie & Lønborg, Jonas Helth & Rasmussen, Ole Dahl, 2016. "Impact of Village Savings and Loan Associations: Evidence from a cluster randomized trial," Journal of Development Economics, Elsevier, vol. 120(C), pages 70-85.
    7. Krauss, Alexander, 2021. "Assessing the overall validity of randomised controlled trials," LSE Research Online Documents on Economics 112576, London School of Economics and Political Science, LSE Library.
    8. Reddy, Sanjay G., 2012. "Randomise This! On Poor Economics," Review of Agrarian Studies, Foundation for Agrarian Studies, vol. 2(2), December.
    9. Lota Tamini & Ibrahima Bocoum & Ghislain Auger & Kotchikpa Gabriel Lawin & Arahama Traoré, 2019. "Enhanced Microfinance Services and Agricultural Best Management Practices: What Benefits for Smallholders Farmers? An Evidence from Burkina Faso," CIRANO Working Papers 2019s-11, CIRANO.
    10. Ralitza Dimova, 2019. "A Debate that Fatigues…: To Randomise or Not to Randomise; What’s the Real Question?," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 31(2), pages 163-168, April.
    11. Basu, Kaushik, 2013. "The method of randomization and the role of reasoned intuition," Policy Research Working Paper Series 6722, The World Bank.
    12. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials [Microcredit impacts: Evidence from a randomized microcredit program placement experiment by Compartamos Banco]," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
    13. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    14. Arnab Acharya & Giulia Greco & Edoardo Masset, 2010. "The economics approach to evaluation of health interventions in developing countries through randomised field trial," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 2(4), pages 401-420.
    15. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Documents de travail du Centre d'Economie de la Sorbonne 22008, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    16. Dahal, Mahesh & Fiala, Nathan, 2020. "What do we know about the impact of microfinance? The problems of statistical power and precision," World Development, Elsevier, vol. 128(C).
    17. Dammert, Ana C. & de Hoop, Jacobus & Mvukiyehe, Eric & Rosati, Furio C., 2018. "Effects of public policy on child labor: Current knowledge, gaps, and implications for program design," World Development, Elsevier, vol. 110(C), pages 104-123.
    18. Boris E. Bravo-Ureta, 2014. "Stochastic frontiers, productivity effects and development projects," Economics and Business Letters, Oviedo University Press, vol. 3(1), pages 51-58.
    19. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Post-Print halshs-03623394, HAL.
    20. Sylvester Ochieng Ogutu & Andrea Fongar & Theda Gödecke & Lisa Jäckering & Henry Mwololo & Michael Njuguna & Meike Wollni & Matin Qaim, 2020. "How to make farming and agricultural extension more nutrition-sensitive: evidence from a randomised controlled trial in Kenya [Agricultural extension: good intentions and hard realities]," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 47(1), pages 95-118.

    More about this item

    Keywords

    Evaluation d'impact; Essai randomisé; méthode expérimentale; Méthodologie; Economie politique; Développement;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:wpaper:ird-01445209. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.