IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v235y2023i2p1589-1624.html
   My bibliography  Save this article

Identifying causal effects in experiments with spillovers and non-compliance

Author

Listed:
  • DiTraglia, Francis J.
  • García-Jimeno, Camilo
  • O’Keeffe-O’Donovan, Rossa
  • Sánchez-Becerra, Alejandro

Abstract

This paper shows how to use a randomized saturation experimental design to identify and estimate causal effects in the presence of spillovers–one person’s treatment may affect another’s outcome–and one-sided non-compliance—subjects can only be offered treatment, not compelled to take it up. Two distinct causal effects are of interest in this setting: direct effects quantify how a person’s own treatment changes her outcome, while indirect effects quantify how her peers’ treatments change her outcome. We consider the case in which spillovers occur within known groups, and take-up decisions are invariant to peers’ realized offers. In this setting we point identify the effects of treatment-on-the-treated, both direct and indirect, in a flexible random coefficients model that allows for heterogeneous treatment effects and endogenous selection into treatment. We go on to propose a feasible estimator that is consistent and asymptotically normal as the number and size of groups increases. We apply our estimator to data from a large-scale job placement services experiment, and find negative indirect treatment effects on the likelihood of employment for those willing to take up the program. These negative spillovers are offset by positive direct treatment effects from own take-up.

Suggested Citation

  • DiTraglia, Francis J. & García-Jimeno, Camilo & O’Keeffe-O’Donovan, Rossa & Sánchez-Becerra, Alejandro, 2023. "Identifying causal effects in experiments with spillovers and non-compliance," Journal of Econometrics, Elsevier, vol. 235(2), pages 1589-1624.
  • Handle: RePEc:eee:econom:v:235:y:2023:i:2:p:1589-1624
    DOI: 10.1016/j.jeconom.2023.01.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407623000210
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2023.01.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bruno Crépon & Esther Duflo & Marc Gurgand & Roland Rathelot & Philippe Zamora, 2013. "Do Labor Market Policies have Displacement Effects? Evidence from a Clustered Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 531-580.
    2. Michael Callen & Suresh de Mel & Craig McIntosh & Christopher Woodruff, 2019. "What Are the Headwaters of Formal Savings? Experimental Evidence from Sri Lanka," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(6), pages 2491-2529.
    3. Charles F. Manski, 2013. "Identification of treatment response with social interactions," Econometrics Journal, Royal Economic Society, vol. 16(1), pages 1-23, February.
    4. Girum Abebe & A Stefano Caria & Marcel Fafchamps & Paolo Falco & Simon Franklin & Simon Quinn, 2021. "Anonymity or Distance? Job Search and Labour Market Exclusion in a Growing African City [Endogenous Stratification in Randomized Experiments]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(3), pages 1279-1310.
    5. Guido W. Imbens & Whitney K. Newey, 2009. "Identification and Estimation of Triangular Simultaneous Equations Models Without Additivity," Econometrica, Econometric Society, vol. 77(5), pages 1481-1512, September.
    6. Matthew A. Masten & Alexander Torgovitsky, 2016. "Identification of Instrumental Variable Correlated Random Coefficients Models," The Review of Economics and Statistics, MIT Press, vol. 98(5), pages 1001-1005, December.
    7. Callen, Michael & De Mel, Suresh & McIntosh, Craig & Woodruff, Christopher, 2019. "What are the headwaters of formal savings? Experimental evidence from Sri Lanka," LSE Research Online Documents on Economics 103022, London School of Economics and Political Science, LSE Library.
    8. Wooldridge, Jeffrey M., 2003. "Further results on instrumental variables estimation of average treatment effects in the correlated random coefficient model," Economics Letters, Elsevier, vol. 79(2), pages 185-191, May.
    9. Michael Callen & Suresh De Mel & Craig McIntosh & Christopher Woodruff, 2014. "What are the Headwaters of Formal Savings? Experimental Evidence from Sri Lanka," NBER Working Papers 20736, National Bureau of Economic Research, Inc.
    10. Joseph G. Altonji & Rosa L. Matzkin, 2005. "Cross Section and Panel Data Estimators for Nonseparable Models with Endogenous Regressors," Econometrica, Econometric Society, vol. 73(4), pages 1053-1102, July.
    11. Leonardo Bursztyn & Davide Cantoni & David Y. Yang & Noam Yuchtman & Y. Jane Zhang, 2021. "Persistent Political Engagement: Social Interactions and the Dynamics of Protest Movements," American Economic Review: Insights, American Economic Association, vol. 3(2), pages 233-250, June.
    12. Matteo Bobba & Jérémie Gignoux, 2014. "Neighborhood effects and take-up of transfers in integrated social policies: Evidence from Progresa," Working Papers halshs-00646590, HAL.
    13. Graham, Bryan S. & Pinto, Cristine Campos de Xavier, 2022. "Semiparametrically efficient estimation of the average linear regression function," Journal of Econometrics, Elsevier, vol. 226(1), pages 115-138.
    14. Esther Duflo & Emmanuel Saez, 2003. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 815-842.
    15. Gustavo J. Bobonis & Frederico Finan, 2009. "Neighborhood Peer Effects in Secondary School Enrollment Decisions," The Review of Economics and Statistics, MIT Press, vol. 91(4), pages 695-716, November.
    16. Manuela Angelucci & Giacomo De Giorgi, 2009. "Indirect Effects of an Aid Program: How Do Cash Transfers Affect Ineligibles' Consumption?," American Economic Review, American Economic Association, vol. 99(1), pages 486-508, March.
    17. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    18. Hudgens, Michael G. & Halloran, M. Elizabeth, 2008. "Toward Causal Inference With Interference," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 832-842, June.
    19. Sarah Baird & Craig McIntosh & Berk Özler, 2011. "Cash or Condition? Evidence from a Cash Transfer Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1709-1753.
    20. Jeffrey M. Wooldridge, 2004. "Estimating average partial effects under conditional moment independence assumptions," CeMMAP working papers CWP03/04, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    21. James Heckman & Edward Vytlacil, 1998. "Instrumental Variables Methods for the Correlated Random Coefficient Model: Estimating the Average Rate of Return to Schooling When the Return is Correlated with Schooling," Journal of Human Resources, University of Wisconsin Press, vol. 33(4), pages 974-987.
    22. Yi, Hongmei & Song, Yingquan & Liu, Chengfang & Huang, Xiaoting & Zhang, Linxiu & Bai, Yunli & Ren, Baoping & Shi, Yaojiang & Loyalka, Prashant & Chu, James & Rozelle, Scott, 2015. "Giving kids a head start: The impact and mechanisms of early commitment of financial aid on poor students in rural China," Journal of Development Economics, Elsevier, vol. 113(C), pages 1-15.
    23. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    24. Wooldridge, Jeffrey M., 1997. "On two stage least squares estimation of the average treatment effect in a random coefficient model," Economics Letters, Elsevier, vol. 56(2), pages 129-133, October.
    25. Johannes Haushofer & Jeremy Shapiro, 2016. "The Short-term Impact of Unconditional Cash Transfers to the Poor: ExperimentalEvidence from Kenya," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1973-2042.
    26. Sarah Baird & J. Aislinn Bohren & Craig McIntosh & Berk Özler, 2018. "Optimal Design of Experiments in the Presence of Interference," The Review of Economics and Statistics, MIT Press, vol. 100(5), pages 844-860, December.
    27. Robert M. Bond & Christopher J. Fariss & Jason J. Jones & Adam D. I. Kramer & Cameron Marlow & Jaime E. Settle & James H. Fowler, 2012. "A 61-million-person experiment in social influence and political mobilization," Nature, Nature, vol. 489(7415), pages 295-298, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francis J. DiTraglia & Camilo Garcia-Jimeno & Rossa O'Keeffe-O'Donovan & Alejandro Sanchez-Becerra, 2020. "Identifying Causal Effects in Experiments with Spillovers and Non-compliance," Papers 2011.07051, arXiv.org, revised Jan 2023.
    2. Sarah Baird & Aislinn Bohren & Berk Ozler & Craig McIntosh, 2014. "Designing Experiments to Measure Spillover Effects," Working Papers 2014-11, The George Washington University, Institute for International Economic Policy.
    3. Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2017. "Optimal Design of Experiments in the Presence of Interference*, Second Version," PIER Working Paper Archive 16-025, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 30 Nov 2017.
    4. Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2015. "Designing Experiments to Measure Spillover Effects, Second Version," PIER Working Paper Archive 15-021, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 01 Jun 2015.
    5. Dennis Egger & Johannes Haushofer & Edward Miguel & Paul Niehaus & Michael Walker, 2022. "General Equilibrium Effects of Cash Transfers: Experimental Evidence From Kenya," Econometrica, Econometric Society, vol. 90(6), pages 2603-2643, November.
    6. Guillermo Cruces & Dario Tortarolo & Gonzalo Vazquez-Bare, 2022. "Design of two-stage experiments with an application to spillovers in tax compliance," IFS Working Papers W22/32, Institute for Fiscal Studies.
    7. Rafael P. Ribas, 2020. "Liquidity constraints, spillovers, and entrepreneurship: evidence from a cash transfer program," Small Business Economics, Springer, vol. 55(4), pages 1131-1158, December.
    8. Dario Tortarolo & Guillermo Cruces & Gonzalo Vazquez-Bare, 2023. "Design of partial population experiments with an application to spillovers in tax compliance," IFS Working Papers W23/17, Institute for Fiscal Studies.
    9. Vazquez-Bare, Gonzalo, 2023. "Identification and estimation of spillover effects in randomized experiments," Journal of Econometrics, Elsevier, vol. 237(1).
    10. Heitzig, Chris & O’Keeffe-O’Donovan, Rossa, 2024. "Spillover Effects and Diffusion of Savings Groups," World Development, Elsevier, vol. 173(C).
    11. Alejandro Sanchez-Becerra, 2022. "The Network Propensity Score: Spillovers, Homophily, and Selection into Treatment," Papers 2209.14391, arXiv.org.
    12. Michael P. Leung, 2020. "Treatment and Spillover Effects Under Network Interference," The Review of Economics and Statistics, MIT Press, vol. 102(2), pages 368-380, May.
    13. Gonzalo Vazquez-Bare, 2017. "Identification and Estimation of Spillover Effects in Randomized Experiments," Papers 1711.02745, arXiv.org, revised Jan 2022.
    14. Tiziano Arduini & Eleonora Patacchini & Edoardo Rainone, 2020. "Treatment Effects With Heterogeneous Externalities," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(4), pages 826-838, October.
    15. Baylis, Kathy & Ham, Andres, 2015. "How important is spatial correlation in randomized controlled trials?," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205586, Agricultural and Applied Economics Association.
    16. Abramitzky, Ran & Lavy, Victor & Pérez, Santiago, 2021. "The long-term spillover effects of changes in the return to schooling," Journal of Public Economics, Elsevier, vol. 196(C).
    17. Rafael P. Ribas, 2014. "Liquidity Constraints, Informal Financing, and Entrepreneurship: Direct and Indirect Effects of a Cash Transfer Programme," Working Papers 131, International Policy Centre for Inclusive Growth.
    18. Zhu, Xun & Jin, Zequn, 2023. "Some identification results in a correlated random coefficients sample selection model," Economics Letters, Elsevier, vol. 233(C).
    19. Matteo Bobba & Jérémie Gignoux, 2011. "Policy-induced Social Interactions and Schooling Decisions," PSE Working Papers halshs-00962478, HAL.
    20. Pierre Bachas & Paul Gertler & Sean Higgins & Enrique Seira, 2021. "How Debit Cards Enable the Poor to Save More," Journal of Finance, American Finance Association, vol. 76(4), pages 1913-1957, August.

    More about this item

    Keywords

    Spillovers; Non-compliance; Randomized saturation; Treatment effects;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:235:y:2023:i:2:p:1589-1624. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.