IDEAS home Printed from https://ideas.repec.org/a/sae/pubfin/v43y2015i2p282-286.html
   My bibliography  Save this article

A Reply to “A Replication of “Counting Chickens When They Hatch†(Economic Journal 2012)â€

Author

Listed:
  • Samuel Bazzi
  • Rikhil Bhavnani

Abstract

The regressions in Clemens et al. (2012) are fully replicable with open-access data and code. Roodman (2015) alters the regression specifications in that paper by adding twice-lagged aid, after which he cannot reject the null hypothesis of a zero effect of aid on growth. We show, with Roodman’s data and code, that his altered specifications have very low power to reject the null–roughly 0.1 to 0.2. In other words, there is an 80-90% chance that Roodman’s altered regressions fail to reject the null by construction. This renders the exercise uninformative about the robustness of the findings in Clemens et al. (2012) or, more generally, about the effect of aid on growth.

Suggested Citation

  • Samuel Bazzi & Rikhil Bhavnani, 2015. "A Reply to “A Replication of “Counting Chickens When They Hatch†(Economic Journal 2012)â€," Public Finance Review, , vol. 43(2), pages 282-286, March.
    • Handle: RePEc:sae:pubfin:v:43:y:2015:i:2:p:282-286
    DOI: 10.1177/1091142114539751
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/1091142114539751
    Download Restriction: no
    File URL: https://libkey.io/10.1177/1091142114539751?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michael A. Clemens & Steven Radelet & Rikhil R. Bhavnani & Samuel Bazzi, 2012. "Counting Chickens when they Hatch: Timing and the Effects of Aid on Growth," Economic Journal, Royal Economic Society, vol. 122(561), pages 590-617, June.
    2. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Civelli, Andrea & Horowitz, Andrew & Teixeira, Arilton, 2018. "Foreign aid and growth: A Sp P-VAR analysis using satellite sub-national data for Uganda," Journal of Development Economics, Elsevier, vol. 134(C), pages 50-67.
    2. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    3. Eduardo Fernández-Arias & Ricardo Hausmann & Ugo Panizza, 2020. "Smart Development Banks," Journal of Industry, Competition and Trade, Springer, vol. 20(2), pages 395-420, June.
    4. Ashish Arora & Michelle Gittelman & Sarah Kaplan & John Lynch & Will Mitchell & Nicolaj Siggelkow & Aaron K. Chatterji & Michael Findley & Nathan M. Jensen & Stephan Meier & Daniel Nielson, 2016. "Field experiments in strategy research," Strategic Management Journal, Wiley Blackwell, vol. 37(1), pages 116-132, January.
    5. Patrick Guillaumont, 2011. "Aid effectiveness for poverty reduction:macroeconomic overview and emerging issues," CERDI Working papers halshs-00554285, HAL.
    6. Carattini, Stefano & Gillingham, Kenneth & Meng, Xiangyu & Yoeli, Erez, 2024. "Peer-to-peer solar and social rewards: Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 219(C), pages 340-370.
    7. Dreher, Axel & Fuchs, Andreas & Langlotz, Sarah, 2019. "The effects of foreign aid on refugee flows," European Economic Review, Elsevier, vol. 112(C), pages 127-147.
    8. Juliana Yael Milovich, 2018. "Does Aid Reduce Poverty?," OPHI Working Papers ophiwp122.pdf, Queen Elizabeth House, University of Oxford.
    9. Askarov, Zohid & Doucouliagos, Hristos, 2015. "Spatial aid spillovers during transition," European Journal of Political Economy, Elsevier, vol. 40(PA), pages 79-95.
    10. María laura Alzúa & Guillermo Cruces & Carolina Lopez, 2016. "Long-Run Effects Of Youth Training Programs: Experimental Evidence From Argentina," Economic Inquiry, Western Economic Association International, vol. 54(4), pages 1839-1859, October.
    11. Denizer, Cevdet & Kaufmann, Daniel & Kraay, Aart, 2013. "Good countries or good projects? Macro and micro correlates of World Bank project performance," Journal of Development Economics, Elsevier, vol. 105(C), pages 288-302.
    12. Matthias Busse & Ruth Hoekstra & Robert Darko Osei, 2017. "The Effectiveness of aid in Improving Regulations: An Empirical Assessment," South African Journal of Economics, Economic Society of South Africa, vol. 85(3), pages 368-385, September.
    13. Antonia Grohmann & Lukas Menkhoff & Helke Seitz, 2022. "The Effect of Personalized Feedback on Small Enterprises’ Finances in Uganda," Economic Development and Cultural Change, University of Chicago Press, vol. 70(3), pages 1197-1227.
    14. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
    15. Anke Hoeffler & Patricia Justino, 2024. "Aid and fragile states," Chapters, in: Raj M. Desai & Shantayanan Devarajan & Jennifer L. Tobin (ed.), Handbook of Aid and Development, chapter 14, pages 225-246, Edward Elgar Publishing.
    16. Stanley, T. D. & Doucouliagos, Chris, 2019. "Practical Significance, Meta-Analysis and the Credibility of Economics," IZA Discussion Papers 12458, Institute of Labor Economics (IZA).
    17. Tsiboe, Francis & Nalley, Lawton Lanier & Dixon, Bruce L. & Popp, Jennie S. & Luckstead, Jeff, 2014. "Cost-Benefit Analysis of the Cocoa Livelihoods Program in Sub-Saharan Africa," 2015 Annual Meeting, January 31-February 3, 2015, Atlanta, Georgia 195775, Southern Agricultural Economics Association.
    18. Atonu Rabbani, 2017. "Can Leaders Promote Better Health Behavior? Learning from a Sanitation and Hygiene Communication Experiment in Rural Bangladesh," Working Papers id:11904, eSocialSciences.
    19. Martin, Will, 2021. "Tools for measuring the full impacts of agricultural interventions," IFPRI-MCC technical papers 2, International Food Policy Research Institute (IFPRI).
    20. Christopher Kilby & Christopher Kline, 2012. "To Invest or Insure? A Comment on Wright (2008)," Villanova School of Business Department of Economics and Statistics Working Paper Series 21, Villanova School of Business Department of Economics and Statistics.

    More about this item

    Keywords

    aid; growth; finance; replication;
    All these keywords.

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. A Replication of “Counting Chickens When They Hatch” (PFR 2015) in ReplicationWiki

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:pubfin:v:43:y:2015:i:2:p:282-286. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.