IDEAS home Printed from https://ideas.repec.org/p/egc/wpaper/1054.html
   My bibliography  Save this paper

External Validity in a Stochastic World

Author

Listed:
  • Mark Rosenzweig

    (Economic Growth Center,Yale University)

  • Christopher Udry

    (Economic Growth Center, Yale University)

Abstract

We examine the generalizability of internally valid estimates of causal effects in a fixed population over time when that population is subject to aggregate shocks. This temporal external validity is shown to depend upon the distribution of the aggregate shocks and the interaction between these shocks and the casual effects. We show that returns to investment in agriculture, small and medium enterprises and human capital differ significantly from year to year. We also show how returns to investments interact with specific aggregate shocks, and estimate the parameters of the distributions of these shocks. We show how to use these estimates to appropriately widen estimated confidence intervals to account for aggregate shocks.

Suggested Citation

  • Mark Rosenzweig & Christopher Udry, 2016. "External Validity in a Stochastic World," Working Papers 1054, Economic Growth Center, Yale University.
    • Handle: RePEc:egc:wpaper:1054
    as

    Download full text from publisher

    File URL: http://egcenter.economics.yale.edu/sites/default/files/files/CDP-cdp1001-cdp1100/cdp1054.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Esther Duflo & Michael Kremer & Jonathan Robinson, 2011. "Nudging Farmers to Use Fertilizer: Theory and Experimental Evidence from Kenya," American Economic Review, American Economic Association, vol. 101(6), pages 2350-2390, October.
    2. Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2021. "From Local to Global: External Validity in a Fertility Natural Experiment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 217-243, January.
    3. Joshua D. Angrist & Alan B. Krueger, 1991. "Estimating the Payoff to Schooling Using the Vietnam-era Draft Lottery," Working Papers 670, Princeton University, Department of Economics, Industrial Relations Section..
    4. de Mel, Suresh & McKenzie, David J. & Woodruff, Christopher, 2009. "Measuring microenterprise profits: Must we ask how the sausage is made?," Journal of Development Economics, Elsevier, vol. 88(1), pages 19-31, January.
    5. Nicholas Bloom & Benn Eifert & Aprajit Mahajan & David McKenzie & John Roberts, 2013. "Does Management Matter? Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(1), pages 1-51.
    6. Esther Duflo, 2001. "Schooling and Labor Market Consequences of School Construction in Indonesia: Evidence from an Unusual Policy Experiment," American Economic Review, American Economic Association, vol. 91(4), pages 795-813, September.
    7. Alan B. Krueger, 1993. "How Computers Have Changed the Wage Structure: Evidence from Microdata, 1984–1989," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(1), pages 33-60.
    8. Giorgio Di Pietro & Lucas Pedace, 2008. "Changes in the Returns to Education in Argentina," Journal of Applied Economics, Taylor & Francis Journals, vol. 11(2), pages 259-279, November.
    9. Eric V. Edmonds & Nina Pavcnik & Petia Topalova, 2010. "Trade Adjustment and Human Capital Investments: Evidence from Indian Tariff Reform," American Economic Journal: Applied Economics, American Economic Association, vol. 2(4), pages 42-75, October.
    10. Dean Karlan & Robert Osei & Isaac Osei-Akoto & Christopher Udry, 2014. "Agricultural Decisions after Relaxing Credit and Risk Constraints," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(2), pages 597-652.
    11. Hunt Allcott, 2015. "Site Selection Bias in Program Evaluation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(3), pages 1117-1165.
    12. Abhijit V. Banerjee & Esther Duflo, 2014. "Do Firms Want to Borrow More? Testing Credit Constraints Using a Directed Lending Program," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 572-607.
    13. Foster, Andrew D & Rosenzweig, Mark R, 1995. "Learning by Doing and Learning from Others: Human Capital and Technical Change in Agriculture," Journal of Political Economy, University of Chicago Press, vol. 103(6), pages 1176-1209, December.
    14. Gin, Xavier & Yang, Dean, 2009. "Insurance, credit, and technology adoption: Field experimental evidencefrom Malawi," Journal of Development Economics, Elsevier, vol. 89(1), pages 1-11, May.
    15. Esther Duflo & Christopher Udry, 2003. "Intrahousehold Resource Allocation in Côte D'ivoire: Social Norms, Separate Accounts and Consumption Choices," Working Papers 857, Economic Growth Center, Yale University.
    16. Suresh de Mel & David McKenzie & Christopher Woodruff, 2009. "Returns to Capital in Microenterprises: Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(1), pages 423-423.
    17. Hooker, Mark A., 1996. "What happened to the oil price-macroeconomy relationship?," Journal of Monetary Economics, Elsevier, vol. 38(2), pages 195-213, October.
    18. Hongbin Cai & Yuyu Chen & Hanming Fang & Li-An Zhou, 2015. "The Effect of Microinsurance on Economic Activities: Evidence from a Randomized Field Experiment," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 287-300, May.
    19. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    20. Abhijit Banerjee & Esther Duflo & Rachel Glennerster & Cynthia Kinnan, 2015. "The Miracle of Microfinance? Evidence from a Randomized Evaluation," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 22-53, January.
    21. Philip Oreopoulos & Till von Wachter & Andrew Heisz, 2012. "The Short- and Long-Term Career Effects of Graduating in a Recession," American Economic Journal: Applied Economics, American Economic Association, vol. 4(1), pages 1-29, January.
    22. Lin, Justin Yifu, 1992. "Rural Reforms and Agricultural Growth in China," American Economic Review, American Economic Association, vol. 82(1), pages 34-51, March.
    23. Rema Hanna & Sendhil Mullainathan & Joshua Schwartzstein, 2014. "Learning Through Noticing: Theory and Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1311-1353.
    24. Hooker, Mark A., 1996. "This is what happened to the oil price-macroeconomy relationship: Reply," Journal of Monetary Economics, Elsevier, vol. 38(2), pages 221-222, October.
    25. Hamilton, James D, 1983. "Oil and the Macroeconomy since World War II," Journal of Political Economy, University of Chicago Press, vol. 91(2), pages 228-248, April.
    26. Fafchamps, Marcel, 1993. "Sequential Labor Decisions under Uncertainty: An Estimable Household Model of West-African Farmers," Econometrica, Econometric Society, vol. 61(5), pages 1173-1197, September.
    27. Robert Jensen, 2010. "The (Perceived) Returns to Education and the Demand for Schooling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 515-548.
    28. Abhijit Banerjee & Sylvain Chassang & Erik Snowberg, 2016. "Decision Theoretic Approaches to Experiment Design and External Validity," NBER Working Papers 22167, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andrew Dustan & Stanislao Maldonado & Juan Manuel Hernandez-Agramonte, 2018. "Motivating bureaucrats with non-monetary incentives when state capacity is weak: Evidence from large-scale field experiments in Peru," Working Papers 136, Peruvian Economic Association.
    2. Andrew Dustan & Juan Manuel Hernandez-Agramonte & Stanislao Maldonado, 2018. "Motivating bureaucrats with non-monetary incentives when state capacity is weak: Evidence from large-scale," Natural Field Experiments 00664, The Field Experiments Website.
    3. Kate Ambler & Alan de Brauw & Susan Godlonton, 0. "Cash Transfers and Management Advice for Agriculture: Evidence from Senegal," The World Bank Economic Review, World Bank, vol. 34(3), pages 597-617.
    4. Arthur Lewbel, 2019. "The Identification Zoo: Meanings of Identification in Econometrics," Journal of Economic Literature, American Economic Association, vol. 57(4), pages 835-903, December.
    5. Gauri, Varun & Jamison, Julian C. & Mazar, Nina & Ozier, Owen, 2021. "Motivating bureaucrats through social recognition: External validity—A tale of two states," Organizational Behavior and Human Decision Processes, Elsevier, vol. 163(C), pages 117-131.
    6. repec:nbr:nberch:13946 is not listed on IDEAS
    7. Troost, Christian & Huber, Robert & Bell, Andrew R. & van Delden, Hedwig & Filatova, Tatiana & Le, Quang Bao & Lippe, Melvin & Niamir, Leila & Polhill, J. Gareth & Sun, Zhanli & Berger, Thomas, 2023. "How to keep it adequate: A protocol for ensuring validity in agent-based simulation," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 159, pages 1-21.
    8. Kevin Donovan & Wyatt Brooks, 2017. "Eliminating Uncertainty in Market Access: The Impact of New Bridges in Rural Nicaragua," 2017 Meeting Papers 1607, Society for Economic Dynamics.
    9. Gauri, Varun & Jamison, Julian C. & Mazar, Nina & Ozier, Owen, 2019. "Motivating Bureaucrats through Social Recognition: External Validity — A Tale of Two States," IZA Discussion Papers 12251, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    2. Benjamin A. Olken, 2020. "Banerjee, Duflo, Kremer, and the Rise of Modern Development Economics," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(3), pages 853-878, July.
    3. Mark Rosenzweig & christopher Udry, 2013. "Forecasting Profitability," Working Papers 1029, Economic Growth Center, Yale University.
    4. David Alfaro‐Serrano & Tanay Balantrapu & Ritam Chaurey & Ana Goicoechea & Eric Verhoogen, 2021. "Interventions to promote technology adoption in firms: A systematic review," Campbell Systematic Reviews, John Wiley & Sons, vol. 17(4), December.
    5. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    6. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    7. Paulina Oliva & B. Kelsey Jack & Samuel Bell & Elizabeth Mettetal & Christopher Severen, 2020. "Technology Adoption under Uncertainty: Take-Up and Subsequent Investment in Zambia," The Review of Economics and Statistics, MIT Press, vol. 102(3), pages 617-632, July.
    8. Karlan, Dean S. & Knight, Ryan & Udry, Christopher R., 2012. "Hoping to Win, Expected to Lose: Theory and Lessons on Micro Enterprise Development," Center Discussion Papers 133405, Yale University, Economic Growth Center.
    9. Dominik Naeher, 2022. "Technology Adoption Under Costly Information Processing," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(2), pages 699-753, May.
    10. Satadru Mukherjee, 2020. "Access to Formal Banks and New Technology Adoption: Evidence from India," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(5), pages 1532-1556, October.
    11. B Kelsey Jack, "undated". "Market Inefficiencies and the Adoption of Agricultural Technologies in Developing Countries," CID Working Papers 50, Center for International Development at Harvard University.
    12. Miriam Bruhn & Dean Karlan & Antoinette Schoar, 2018. "The Impact of Consulting Services on Small and Medium Enterprises: Evidence from a Randomized Trial in Mexico," Journal of Political Economy, University of Chicago Press, vol. 126(2), pages 635-687.
    13. David Atkin & Azam Chaudhry & Shamyla Chaudry & Amit K. Khandelwal & Eric Verhoogen, 2017. "Organizational Barriers to Technology Adoption: Evidence from Soccer-Ball Producers in Pakistan," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(3), pages 1101-1164.
    14. Joshua D Merfeld, 2020. "Moving Up or Just Surviving? Nonfarm Self‐Employment in India," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(1), pages 32-53, January.
    15. Emerick, Kyle & Kelley, Erin & De Janvry, Alain & Sadoulet, Elisabeth, 2019. "Endogenous Information Sharing and the Gains from Using Network Information to Maximize Technology Adoption," CEPR Discussion Papers 13507, C.E.P.R. Discussion Papers.
    16. Marianna Battaglia & Selim Gulesci & Andreas Madestam, 2024. "Repayment Flexibility and Risk Taking: Experimental Evidence from Credit Contracts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(5), pages 2635-2675.
    17. Stephen J. Anderson & Rajesh Chandy & Bilal Zia, 2018. "Pathways to Profits: The Impact of Marketing vs. Finance Skills on Business Performance," Management Science, INFORMS, vol. 64(12), pages 5559-5583, December.
    18. Lori Beaman & Dean Karlan & Bram Thuysbaert & Christopher Udry, 2023. "Selection Into Credit Markets: Evidence From Agriculture in Mali," Econometrica, Econometric Society, vol. 91(5), pages 1595-1627, September.
    19. Mohamed Abouaziza, 2022. "Farmer constraints and relational contracts: evidence from agricultural value chains in East Africa," Economics PhD Theses 0122, Department of Economics, University of Sussex Business School.
    20. Aparicio, Gabriela & Bobic, Vida & De Olloqui, Fernando & Carmen, María & Diez, María Carmen Fernández & Gerardino, Maria Paula & Mitnik, Oscar A. & Macedo, Sebastian Vargas, 2021. "Liquidity or Capital? The Impacts of Easing Credit Constraints in Rural Mexico," IZA Discussion Papers 14477, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    returns to investment; heterogeneity; treatment effect;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • O1 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development
    • O13 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Agriculture; Natural Resources; Environment; Other Primary Products
    • O14 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Industrialization; Manufacturing and Service Industries; Choice of Technology
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:egc:wpaper:1054. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Benjamin King (email available below). General contact details of provider: https://edirc.repec.org/data/egyalus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.