IDEAS home Printed from https://ideas.repec.org/p/avg/wpaper/fr899.html
   My bibliography  Save this paper

L'étalon-or des évaluations randomisées : économie politique des expérimentations aléatoires dans le domaine du développement

Author

Listed:
  • Florent BEDECARRATS
  • Isabelle GUERIN
  • François ROUBAUD

Abstract

La dernière décennie a vu l'émergence d'un nouveau champ de recherche en économie du développement : les méthodes expérimentales d'évaluation d'impacts par assignation aléatoire. Cet article explore le contraste entre d‘une part les limites (nombreuses) et la circonscription (très étroite) du champ réel d'application de ces méthodes et d‘autre part leur succès, attesté à la fois par leur nombre et leur forte médiatisation. L’analyse suggère que ce contraste est le fruit d‘une conjonction économique et politique particulière, émanant de stratégies novatrices de la part des chercheurs de cette nouvelle école, et d‘intérêts et de préférences spécifiques provenant à la fois du monde académique et de la communauté des bailleurs de fond.

Suggested Citation

  • Florent BEDECARRATS & Isabelle GUERIN & François ROUBAUD, 2017. "L'étalon-or des évaluations randomisées : économie politique des expérimentations aléatoires dans le domaine du développement," Working Paper 753120cd-506f-4c5f-80ed-7, Agence française de développement.
    • Handle: RePEc:avg:wpaper:fr899
    as

    Download full text from publisher

    File URL: https://www.afd.fr/sites/afd/files/imported-files/44-papiers-recherche.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    2. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    3. Bobba, Matteo & Frisancho, Veronica, 2016. "Learning about Oneself: The Effects of Performance Feedback on School Choice," IZA Discussion Papers 10360, Institute of Labor Economics (IZA).
    4. Duflo, Esther & Dupas, Pascaline & Kremer, Michael, 2015. "School governance, teacher incentives, and pupil–teacher ratios: Experimental evidence from Kenyan primary schools," Journal of Public Economics, Elsevier, vol. 123(C), pages 92-110.
    5. Florent Bédécarrats & Isabelle Guérin & François Roubaud, 2015. "The gold standard for randomised evaluations: from discussion of method to political economics," Working Papers CEB 15-009, ULB -- Universite Libre de Bruxelles.
    6. Michael Woolcock, 2013. "Using Case Studies to Explore the External Validity of ‘Complex’ Development Interventions," CID Working Papers 270, Center for International Development at Harvard University.
    7. Gonzalez-Vega, Claudio & Meyer, Richard L. & Navajas, Sergio & Schreiner, Mark & Rodriguez-Meza, Jorge & Monje, Guillermo F., 1996. "Microfinance Market Niches And Client Profiles In Bolivia," Economics and Sociology Occasional Papers - ESO Series 28332, Ohio State University, Department of Agricultural, Environmental and Development Economics.
    8. Isabelle Nocus & Philipe Guimard and Agnès Florin, 2017. "Evaluation of the « Ecole et langues nationales en Afrique » program: Methodological Aspects and Interim Assessment," Working Paper c18af23f-0bf0-4bc8-9ea5-f, Agence française de développement.
    9. Tanguy Bernard & Jocelyne Delarue & Jean-David Naudet, 2012. "Impact evaluations: a tool for accountability? Lessons from experience at Agence Française de D�veloppement," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 4(2), pages 314-327, June.
    10. Michael Rosholm & Lars Skipper, 2009. "Is labour market training a curse for the unemployed? Evidence from a social experiment," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(2), pages 338-365, March.
    11. Paul Shaffer, 2011. "Against Excessive Rhetoric in Impact Assessment: Overstating the Case for Randomised Controlled Experiments," Journal of Development Studies, Taylor & Francis Journals, vol. 47(11), pages 1619-1635.
    12. John A. List & Robert Metcalfe, 2014. "Field experiments in the developed world: an introduction," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 30(4), pages 585-596.
    13. Mathias KUEPIE & Eric Patrick FEUBI PAMEN, 2017. "An Application of the Alkire-Foster’s Multidimensional Poverty Index to Data from Madagascar: Taking Into Account the Dimensions of Employment and Gender Inequality," Working Paper 6ca04615-044d-41a0-8737-9, Agence française de développement.
    14. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    15. Florent Bédécarrats & Isabelle Guérin & François Roubaud, 2015. "The gold standard for randomized evaluations: from discussion of method to political economy," Working Papers DT/2015/01, DIAL (Développement, Institutions et Mondialisation).
    16. Morvant-Roux, Solène & Guérin, Isabelle & Roesch, Marc & Moisseron, Jean-Yves, 2014. "Adding Value to Randomization with Qualitative Analysis: The Case of Microcredit in Rural Morocco," World Development, Elsevier, vol. 56(C), pages 302-312.
    17. Martin Ravallion, 2009. "Evaluation in the Practice of Development," The World Bank Research Observer, World Bank, vol. 24(1), pages 29-53, March.
    18. James J. Heckman, 1991. "Randomization and Social Policy Evaluation Revisited," NBER Technical Working Papers 0107, National Bureau of Economic Research, Inc.
    19. Daron Acemoglu, 2010. "Theory, General Equilibrium, and Political Economy in Development Economics," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 17-32, Summer.
    20. Avitabile, Ciro & Bobba, Matteo & Pariguana, Marco, 2017. "High School Track Choice and Liquidity Constraints: Evidence from Urban Mexico," IZA Discussion Papers 10506, Institute of Labor Economics (IZA).
    21. Angus Deaton & Nancy Cartwright, 2016. "Understanding and Misunderstanding Randomized Controlled Trials," Working Papers august_25.pdf, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
    22. Rodrik, Dani, 2008. "The New Development Economics: We Shall Experiment, but How Shall We Learn?," Working Paper Series rwp08-055, Harvard University, John F. Kennedy School of Government.
    23. Woolcock, Michael, 2013. "Using Case Studies to Explore the External Validity of 'Complex' Development Interventions," Working Paper Series rwp13-048, Harvard University, John F. Kennedy School of Government.
    24. Anda David & Mohamed Ali Marouani, 2017. "Migration Patterns and Labor Market Outcomes in Tunisia," Working Papers 1166, Economic Research Forum, revised 12 2017.
    25. Lant Pritchett & Salimah Samji & Jeffrey S. Hammer, 2012. "It's All about MeE: Using Structured Experiential Learning ('e') to Crawl the Design Space," WIDER Working Paper Series wp-2012-104, World Institute for Development Economic Research (UNU-WIDER).
    26. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    27. Glenn W. Harrison, 2011. "Randomisation and Its Discontents," Journal of African Economies, Centre for the Study of African Economies, vol. 20(4), pages 626-652, August.
    28. Christopher B. Barrett & Michael R. Carter, 2010. "The Power and Pitfalls of Experiments in Development Economics: Some Non-random Reflections," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 32(4), pages 515-548.
    29. Cahuc, Pierre & Le Barbanchon, Thomas, 2010. "Labor market policy evaluation in equilibrium: Some lessons of the job search and matching model," Labour Economics, Elsevier, vol. 17(1), pages 196-205, January.
    30. Ciro Avitabiley & Matteo Bobba and Marco Pariguanax, 2017. "High School Track Choice and Liquidity Constraints: Evidence from Urban Mexico," Working Paper 0195be34-77f6-4879-a68d-e, Agence française de développement.
    31. Godquin, Marie, 2004. "Microfinance Repayment Performance in Bangladesh: How to Improve the Allocation of Loans by MFIs," World Development, Elsevier, vol. 32(11), pages 1909-1926, November.
    32. Eble, Alex & Boone, Peter & Elbourne, Diana, 2013. "Risk and evidence of bias in randomized controlled trials in economics," LSE Research Online Documents on Economics 121784, London School of Economics and Political Science, LSE Library.
    33. Eva Vivalt, 0. "How Much Can We Generalize From Impact Evaluations?," Journal of the European Economic Association, European Economic Association, vol. 18(6), pages 3045-3089.
    34. Rohen D'AIGLEPIERRE & Arthur Bauer, 2017. "The choice of arabo-islamic education in sub-Saharan Africa: findings from a comparative study," Working Paper 1b845da2-5276-4b82-88ef-c, Agence française de développement.
    35. Easterly, William, 2007. "The White Man's Burden: Why the West's Efforts to Aid the Rest Have Done So Much Ill And So Little Good," OUP Catalogue, Oxford University Press, number 9780199226115.
    36. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    37. Rachel Glennerster, 2012. "The Power of Evidence: Improving the Effectiveness of Government by Investing in More Rigorous Evaluation," National Institute Economic Review, National Institute of Economic and Social Research, vol. 219(1), pages 4-14, January.
    38. Labrousse, Agnès, 2010. "Nouvelle économie du développement et essais cliniques randomisés : une mise en perspective d’un outil de preuve et de gouvernement," Revue de la Régulation - Capitalisme, institutions, pouvoirs, Association Recherche et Régulation, vol. 7.
    39. Giné, Xavier & Karlan, Dean S., 2014. "Group versus individual liability: Short and long term evidence from Philippine microcredit lending groups," Journal of Development Economics, Elsevier, vol. 107(C), pages 65-83.
    40. James Heckman & Jeffrey Smith & Christopher Taber, 1998. "Accounting For Dropouts In Evaluations Of Social Programs," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 1-14, February.
    41. Sharma, Manohar & Zeller, Manfred, 1997. "Repayment performance in group-based credit programs in Bangladesh: An empirical analysis," World Development, Elsevier, vol. 25(10), pages 1731-1742, October.
    42. Eva Vivalt, 2020. "How Much Can We Generalize From Impact Evaluations?," Journal of the European Economic Association, European Economic Association, vol. 18(6), pages 3045-3089.
    43. Florent Bédécarrats, 2012. "L'impact de la microfinance : un enjeu politique au prisme de ses controverses scientifiques," Mondes en développement, De Boeck Université, vol. 0(2), pages 127-142.
    44. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    45. Dominique Gentil, 1996. "Les avatars du modèle « Grameen Bank »," Revue Tiers Monde, Programme National Persée, vol. 37(145), pages 115-133.
    46. Levine, David & Polimeni, Rachel & Ramage, Ian, 2016. "Insuring health or insuring wealth? An experimental evaluation of health insurance in rural Cambodia," Journal of Development Economics, Elsevier, vol. 119(C), pages 1-15.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Post-Print halshs-03623394, HAL.
    2. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Documents de travail du Centre d'Economie de la Sorbonne 22008, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    3. Fatoumata Nankoto Cissé, 2022. "How impact evaluation methods influence the outcomes of development projects? Evidence from a meta-analysis on decentralized solar nano projects," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-03623394, HAL.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Florent Bédécarrats & Isabelle Guérin & François Roubaud, 2019. "All that Glitters is not Gold. The Political Economy of Randomized Evaluations in Development," Development and Change, International Institute of Social Studies, vol. 50(3), pages 735-762, May.
    2. Florent Bédécarrats & Isabelle Guérin & François Roubaud, 2015. "The gold standard for randomized evaluations: from discussion of method to political economy," Working Papers DT/2015/01, DIAL (Développement, Institutions et Mondialisation).
    3. Florent Bédécarrats & Isabelle Guérin & François Roubaud, 2015. "The gold standard for randomised evaluations: from discussion of method to political economics," Working Papers CEB 15-009, ULB -- Universite Libre de Bruxelles.
    4. Florent Bedecarrats & Isabelle Guérin & François Roubaud, 2017. "L'étalon-or des évaluations randomisées : du discours de la méthode à l'économie politique," Working Papers ird-01445209, HAL.
    5. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    6. Cristina Corduneanu-Huci & Michael T. Dorsch & Paul Maarek, 2017. "Learning to constrain: Political competition and randomized controlled trials in development," THEMA Working Papers 2017-24, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    7. Cameron, Lisa & Olivia, Susan & Shah, Manisha, 2019. "Scaling up sanitation: Evidence from an RCT in Indonesia," Journal of Development Economics, Elsevier, vol. 138(C), pages 1-16.
    8. Ashis Das & Jed Friedman & Eeshani Kandpal, 2018. "Does involvement of local NGOs enhance public service delivery? Cautionary evidence from a malaria‐prevention program in India," Health Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 172-188, January.
    9. Rohen d’Aiglepierre & Arthur Bauer, 2017. "Teacher training based on the results of research on their actual practices in the context of Sub-Saharan Africa: The OPERA project in Burkina Faso, issues and challenges," Working Paper cacf7616-2ec5-4da2-93df-8, Agence française de développement.
    10. Omar Al-Ubaydli & John List & Claire Mackevicius & Min Sok Lee & Dana Suskind, 2019. "How Can Experiments Play a Greater Role in Public Policy? 12 Proposals from an Economic Model of Scaling," Artefactual Field Experiments 00679, The Field Experiments Website.
    11. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    12. Faraz Usmani & Marc Jeuland & Subhrendu K. Pattanayak, 2018. "NGOs and the effectiveness of interventions," WIDER Working Paper Series wp-2018-59, World Institute for Development Economic Research (UNU-WIDER).
    13. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    14. Faraz Usmani & Marc Jeuland & Subhrendu K. Pattanayak, 2024. "NGOs and the Effectiveness of Interventions," The Review of Economics and Statistics, MIT Press, vol. 106(6), pages 1690-1708, November.
    15. Ralitza Dimova, 2019. "A Debate that Fatigues…: To Randomise or Not to Randomise; What’s the Real Question?," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 31(2), pages 163-168, April.
    16. Annie Duflo & Jessica Kiessel & Adrienne Lucas, 2020. "Experimental Evidence on Alternative Policies to Increase Learning at Scale," NBER Working Papers 27298, National Bureau of Economic Research, Inc.
    17. Woolcock, Michael, 2013. "Using Case Studies to Explore the External Validity of 'Complex' Development Interventions," Working Paper Series rwp13-048, Harvard University, John F. Kennedy School of Government.
    18. Lant Pritchett, Justin Sandefur, 2013. "Context Matters for Size: Why External Validity Claims and Development Practice Don't Mix-Working Paper 336," Working Papers 336, Center for Global Development.
    19. Kabeer, Naila, 2020. "‘Misbehaving’ RCTs: The confounding problem of human agency," World Development, Elsevier, vol. 127(C).

    More about this item

    JEL classification:

    • Q - Agricultural and Natural Resource Economics; Environmental and Ecological Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:avg:wpaper:fr899. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AFD (email available below). General contact details of provider: https://edirc.repec.org/data/afdgvfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.