IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2011.07051.html
   My bibliography  Save this paper

Identifying Causal Effects in Experiments with Spillovers and Non-compliance

Author

Listed:
  • Francis J. DiTraglia

    (Department of Economics University of Oxford)

  • Camilo Garcia-Jimeno

    (Federal Reserve Bank of Chicago)

  • Rossa O'Keeffe-O'Donovan

    (Department of Economics University of Oxford)

  • Alejandro Sanchez-Becerra

    (Department of Quantitative Theory and Methods, Emory University)

Abstract

This paper shows how to use a randomized saturation experimental design to identify and estimate causal effects in the presence of spillovers--one person's treatment may affect another's outcome--and one-sided non-compliance--subjects can only be offered treatment, not compelled to take it up. Two distinct causal effects are of interest in this setting: direct effects quantify how a person's own treatment changes her outcome, while indirect effects quantify how her peers' treatments change her outcome. We consider the case in which spillovers occur within known groups, and take-up decisions are invariant to peers' realized offers. In this setting we point identify the effects of treatment-on-the-treated, both direct and indirect, in a flexible random coefficients model that allows for heterogeneous treatment effects and endogenous selection into treatment. We go on to propose a feasible estimator that is consistent and asymptotically normal as the number and size of groups increases. We apply our estimator to data from a large-scale job placement services experiment, and find negative indirect treatment effects on the likelihood of employment for those willing to take up the program. These negative spillovers are offset by positive direct treatment effects from own take-up.

Suggested Citation

  • Francis J. DiTraglia & Camilo Garcia-Jimeno & Rossa O'Keeffe-O'Donovan & Alejandro Sanchez-Becerra, 2020. "Identifying Causal Effects in Experiments with Spillovers and Non-compliance," Papers 2011.07051, arXiv.org, revised Jan 2023.
    • Handle: RePEc:arx:papers:2011.07051
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2011.07051
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bruno Crépon & Esther Duflo & Marc Gurgand & Roland Rathelot & Philippe Zamora, 2013. "Do Labor Market Policies have Displacement Effects? Evidence from a Clustered Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 531-580.
    2. James Heckman & Edward Vytlacil, 1998. "Instrumental Variables Methods for the Correlated Random Coefficient Model: Estimating the Average Rate of Return to Schooling When the Return is Correlated with Schooling," Journal of Human Resources, University of Wisconsin Press, vol. 33(4), pages 974-987.
    3. Charles F. Manski, 2013. "Identification of treatment response with social interactions," Econometrics Journal, Royal Economic Society, vol. 16(1), pages 1-23, February.
    4. Abhijit Banerjee & Raghabendra Chattopadhyay & Esther Duflo & Daniel Keniston & Nina Singh, 2012. "Can Institutions be Reformed from Within? Evidence from a Randomized Experiment with the Rajasthan Police," Working Papers id:4813, eSocialSciences.
    5. Yi, Hongmei & Song, Yingquan & Liu, Chengfang & Huang, Xiaoting & Zhang, Linxiu & Bai, Yunli & Ren, Baoping & Shi, Yaojiang & Loyalka, Prashant & Chu, James & Rozelle, Scott, 2015. "Giving kids a head start: The impact and mechanisms of early commitment of financial aid on poor students in rural China," Journal of Development Economics, Elsevier, vol. 113(C), pages 1-15.
    6. Guido W. Imbens & Whitney K. Newey, 2009. "Identification and Estimation of Triangular Simultaneous Equations Models Without Additivity," Econometrica, Econometric Society, vol. 77(5), pages 1481-1512, September.
    7. Matthew A. Masten & Alexander Torgovitsky, 2016. "Identification of Instrumental Variable Correlated Random Coefficients Models," The Review of Economics and Statistics, MIT Press, vol. 98(5), pages 1001-1005, December.
    8. repec:hal:pseose:halshs-00840901 is not listed on IDEAS
    9. Jeffrey M. Wooldridge, 2004. "Estimating average partial effects under conditional moment independence assumptions," CeMMAP working papers 03/04, Institute for Fiscal Studies.
    10. Wooldridge, Jeffrey M., 2003. "Further results on instrumental variables estimation of average treatment effects in the correlated random coefficient model," Economics Letters, Elsevier, vol. 79(2), pages 185-191, May.
    11. Betsy Sinclair & Margaret McConnell & Donald P. Green, 2012. "Detecting Spillover Effects: Design and Analysis of Multilevel Experiments," American Journal of Political Science, John Wiley & Sons, vol. 56(4), pages 1055-1069, October.
    12. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    13. Matteo Bobba & Jérémie Gignoux, 2014. "Neighborhood effects and take-up of transfers in integrated social policies: Evidence from Progresa," Working Papers halshs-00646590, HAL.
    14. Esther Duflo & Emmanuel Saez, 2003. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 815-842.
    15. Wooldridge, Jeffrey M., 1997. "On two stage least squares estimation of the average treatment effect in a random coefficient model," Economics Letters, Elsevier, vol. 56(2), pages 129-133, October.
    16. Gustavo J. Bobonis & Frederico Finan, 2009. "Neighborhood Peer Effects in Secondary School Enrollment Decisions," The Review of Economics and Statistics, MIT Press, vol. 91(4), pages 695-716, November.
    17. Manuela Angelucci & Giacomo De Giorgi, 2009. "Indirect Effects of an Aid Program: How Do Cash Transfers Affect Ineligibles' Consumption?," American Economic Review, American Economic Association, vol. 99(1), pages 486-508, March.
    18. Johannes Haushofer & Jeremy Shapiro, 2016. "The Short-term Impact of Unconditional Cash Transfers to the Poor: ExperimentalEvidence from Kenya," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1973-2042.
    19. Xavier Giné & Ghazala Mansuri, 2018. "Together We Will: Experimental Evidence on Female Voting Behavior in Pakistan," American Economic Journal: Applied Economics, American Economic Association, vol. 10(1), pages 207-235, January.
    20. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    21. Hudgens, Michael G. & Halloran, M. Elizabeth, 2008. "Toward Causal Inference With Interference," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 832-842, June.
    22. Sarah Baird & J. Aislinn Bohren & Craig McIntosh & Berk Özler, 2018. "Optimal Design of Experiments in the Presence of Interference," The Review of Economics and Statistics, MIT Press, vol. 100(5), pages 844-860, December.
    23. Robert M. Bond & Christopher J. Fariss & Jason J. Jones & Adam D. I. Kramer & Cameron Marlow & Jaime E. Settle & James H. Fowler, 2012. "A 61-million-person experiment in social influence and political mobilization," Nature, Nature, vol. 489(7415), pages 295-298, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tadao Hoshino & Takahide Yanagi, 2021. "Causal Inference with Noncompliance and Unknown Interference," Papers 2108.07455, arXiv.org, revised Oct 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. DiTraglia, Francis J. & García-Jimeno, Camilo & O’Keeffe-O’Donovan, Rossa & Sánchez-Becerra, Alejandro, 2023. "Identifying causal effects in experiments with spillovers and non-compliance," Journal of Econometrics, Elsevier, vol. 235(2), pages 1589-1624.
    2. Sarah Baird & J. Aislinn Bohren & Craig McIntosh & Berk Ozler, 2014. "Designing Experiments to Measure Spillover Effects," PIER Working Paper Archive 14-006, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    3. Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2015. "Designing Experiments to Measure Spillover Effects, Second Version," PIER Working Paper Archive 15-021, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 01 Jun 2015.
    4. Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2017. "Optimal Design of Experiments in the Presence of Interference*, Second Version," PIER Working Paper Archive 16-025, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 30 Nov 2017.
    5. Dario Tortarolo & Guillermo Cruces & Gonzalo Vazquez-Bare, 2023. "Design of partial population experiments with an application to spillovers in tax compliance," IFS Working Papers W23/17, Institute for Fiscal Studies.
    6. Guillermo Cruces & Dario Tortarolo & Gonzalo Vazquez-Bare, 2022. "Design of two-stage experiments with an application to spillovers in tax compliance," IFS Working Papers W22/32, Institute for Fiscal Studies.
    7. Gonzalo Vazquez-Bare, 2017. "Identification and Estimation of Spillover Effects in Randomized Experiments," Papers 1711.02745, arXiv.org, revised Jan 2022.
    8. John A. List & Fatemeh Momeni & Yves Zenou, 2020. "The Social Side of Early Human Capital Formation: Using a Field Experiment to Estimate the Causal Impact of Neighborhoods," Working Papers 2020-187, Becker Friedman Institute for Research In Economics.
    9. List, John A. & Momeni, Fatemeh & Zenou, Yves, 2019. "Are Estimates of Early Education Programs Too Pessimistic? Evidence from a Large-Scale Field Experiment that Causally Measures Neighbor Effects," Working Paper Series 1293, Research Institute of Industrial Economics.
    10. Zenou, Yves & List, John & Momeni, Fatemeh, 2019. "Are Estimates of Early Education Programs Too Pessimistic? Evidence from a Large-Scale Field Experiment that Causally Measures," CEPR Discussion Papers 13725, C.E.P.R. Discussion Papers.
    11. Vazquez-Bare, Gonzalo, 2023. "Identification and estimation of spillover effects in randomized experiments," Journal of Econometrics, Elsevier, vol. 237(1).
    12. Rafael P. Ribas, 2020. "Liquidity constraints, spillovers, and entrepreneurship: evidence from a cash transfer program," Small Business Economics, Springer, vol. 55(4), pages 1131-1158, December.
    13. Heitzig, Chris & O’Keeffe-O’Donovan, Rossa, 2024. "Spillover Effects and Diffusion of Savings Groups," World Development, Elsevier, vol. 173(C).
    14. Davide Viviano, 2020. "Experimental Design under Network Interference," Papers 2003.08421, arXiv.org, revised Jul 2022.
    15. Alejandro Sanchez-Becerra, 2022. "The Network Propensity Score: Spillovers, Homophily, and Selection into Treatment," Papers 2209.14391, arXiv.org.
    16. Michael P. Leung, 2020. "Treatment and Spillover Effects Under Network Interference," The Review of Economics and Statistics, MIT Press, vol. 102(2), pages 368-380, May.
    17. John A. List & Fatemeh Momeni & Yves Zenou, 2020. "The Social Side of Early Human Capital Formation: Using a Field Experiment to Estimate the Causal Impact of Neighborhoods," Working Papers 2020-187, Becker Friedman Institute for Research In Economics.
    18. Tiziano Arduini & Eleonora Patacchini & Edoardo Rainone, 2020. "Treatment Effects With Heterogeneous Externalities," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(4), pages 826-838, October.
    19. Yann Bramoullé & Habiba Djebbari & Bernard Fortin, 2020. "Peer Effects in Networks: A Survey," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 603-629, August.
    20. Baylis, Kathy & Ham, Andres, 2015. "How important is spatial correlation in randomized controlled trials?," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205586, Agricultural and Applied Economics Association.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2011.07051. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.