IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2311.02467.html
   My bibliography  Save this paper

Individualized Policy Evaluation and Learning under Clustered Network Interference

Author

Listed:
  • Yi Zhang
  • Kosuke Imai

Abstract

While there now exists a large literature on policy evaluation and learning, much of prior work assumes that the treatment assignment of one unit does not affect the outcome of another unit. Unfortunately, ignoring interference may lead to biased policy evaluation and ineffective learned policies. For example, treating influential individuals who have many friends can generate positive spillover effects, thereby improving the overall performance of an individualized treatment rule (ITR). We consider the problem of evaluating and learning an optimal ITR under clustered network interference (also known as partial interference) where clusters of units are sampled from a population and units may influence one another within each cluster. Unlike previous methods that impose strong restrictions on spillover effects, the proposed methodology only assumes a semiparametric structural model where each unit's outcome is an additive function of individual treatments within the cluster. Under this model, we propose an estimator that can be used to evaluate the empirical performance of an ITR. We show that this estimator is substantially more efficient than the standard inverse probability weighting estimator, which does not impose any assumption about spillover effects. We derive the finite-sample regret bound for a learned ITR, showing that the use of our efficient evaluation estimator leads to the improved performance of learned policies. Finally, we conduct simulation and empirical studies to illustrate the advantages of the proposed methodology.

Suggested Citation

  • Yi Zhang & Kosuke Imai, 2023. "Individualized Policy Evaluation and Learning under Clustered Network Interference," Papers 2311.02467, arXiv.org, revised Feb 2024.
  • Handle: RePEc:arx:papers:2311.02467
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2311.02467
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Toru Kitagawa & Aleksey Tetenov, 2018. "Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice," Econometrica, Econometric Society, vol. 86(2), pages 591-616, March.
    2. C Park & H Kang, 2022. "Efficient semiparametric estimation of network treatment effects under partial interference [Multivariate binary discrimination by the kernel method]," Biometrika, Biometrika Trust, vol. 109(4), pages 1015-1031.
    3. Abhijit Banerjee & Arun G Chandrasekhar & Esther Duflo & Matthew O Jackson, 2019. "Using Gossips to Spread Information: Theory and Evidence from Two Randomized Controlled Trials," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(6), pages 2453-2490.
    4. Susan Athey & Stefan Wager, 2021. "Policy Learning With Observational Data," Econometrica, Econometric Society, vol. 89(1), pages 133-161, January.
    5. Mengsi Gao & Peng Ding, 2023. "Causal inference in network experiments: regression-based analysis and design-based properties," Papers 2309.07476, arXiv.org, revised Nov 2023.
    6. Kosuke Imai & Zhichao Jiang & Anup Malani, 2021. "Causal Inference With Interference and Noncompliance in Two-Stage Randomized Experiments," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(534), pages 632-644, April.
    7. Hudgens, Michael G. & Halloran, M. Elizabeth, 2008. "Toward Causal Inference With Interference," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 832-842, June.
    8. Yuchen Hu & Shuangning Li & Stefan Wager, 2021. "Average Direct and Indirect Causal Effects under Interference," Papers 2104.03802, arXiv.org, revised Jan 2022.
    9. Mert Demirer & Vasilis Syrgkanis & Greg Lewis & Victor Chernozhukov, 2019. "Semi-Parametric Efficient Policy Learning with Continuous Actions," CeMMAP working papers CWP34/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Yingqi Zhao & Donglin Zeng & A. John Rush & Michael R. Kosorok, 2012. "Estimating Individualized Treatment Rules Using Outcome Weighted Learning," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(499), pages 1106-1118, September.
    11. Yuchen Hu & Shuangning Li & Stefan Wager, 2022. "Average direct and indirect causal effects under interference [Estimating average causal effects under general interference, with application to a social network experiment]," Biometrika, Biometrika Trust, vol. 109(4), pages 1165-1172.
    12. Kosuke Imai & Michael Lingzhi Li, 2023. "Experimental Evaluation of Individualized Treatment Rules," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(541), pages 242-256, January.
    13. L. Liu & M. G. Hudgens & S. Becker-Dreps, 2016. "On inverse probability-weighted estimators in the presence of interference," Biometrika, Biometrika Trust, vol. 103(4), pages 829-842.
    14. Kitagawa, Toru & Wang, Guanyi, 2023. "Who should get vaccinated? Individualized allocation of vaccines over SIR network," Journal of Econometrics, Elsevier, vol. 232(1), pages 109-131.
    15. Chamberlain, Gary, 1992. "Efficiency Bounds for Semiparametric Regression," Econometrica, Econometric Society, vol. 60(3), pages 567-596, May.
    16. Imai, Kosuke & Strauss, Aaron, 2011. "Estimation of Heterogeneous Treatment Effects from Randomized Experiments, with Application to the Optimal Planning of the Get-Out-the-Vote Campaign," Political Analysis, Cambridge University Press, vol. 19(1), pages 1-19, January.
    17. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    18. Sobel, Michael E., 2006. "What Do Randomized Studies of Housing Mobility Demonstrate?: Causal Inference in the Face of Interference," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1398-1407, December.
    19. Michael P. Leung, 2020. "Treatment and Spillover Effects Under Network Interference," The Review of Economics and Statistics, MIT Press, vol. 102(2), pages 368-380, May.
    20. Chunrong Ai & Xiaohong Chen, 2003. "Efficient Estimation of Models with Conditional Moment Restrictions Containing Unknown Functions," Econometrica, Econometric Society, vol. 71(6), pages 1795-1843, November.
    21. Lan Liu & Michael G. Hudgens, 2014. "Large Sample Randomization Inference of Causal Effects in the Presence of Interference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 288-301, March.
    22. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    23. Egami, Naoki, 2021. "Spillover Effects in the Presence of Unobserved Networks," Political Analysis, Cambridge University Press, vol. 29(3), pages 287-316, July.
    24. Georgia Papadogeorgou & Fabrizia Mealli & Corwin M. Zigler, 2019. "Causal inference with interfering units for cluster and population level treatment allocation programs," Biometrics, The International Biometric Society, vol. 75(3), pages 778-787, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuehao Bai & Azeem M. Shaikh & Max Tabord-Meehan, 2024. "A Primer on the Analysis of Randomized Experiments and a Survey of some Recent Advances," Papers 2405.03910, arXiv.org.
    2. Zhaonan Qu & Ruoxuan Xiong & Jizhou Liu & Guido Imbens, 2021. "Semiparametric Estimation of Treatment Effects in Observational Studies with Heterogeneous Partial Interference," Papers 2107.12420, arXiv.org, revised Jun 2024.
    3. Tadao Hoshino & Takahide Yanagi, 2021. "Causal Inference with Noncompliance and Unknown Interference," Papers 2108.07455, arXiv.org, revised Oct 2023.
    4. Tiziano Arduini & Eleonora Patacchini & Edoardo Rainone, 2020. "Treatment Effects With Heterogeneous Externalities," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(4), pages 826-838, October.
    5. Luofeng Liao & Christian Kroer, 2024. "Statistical Inference and A/B Testing in Fisher Markets and Paced Auctions," Papers 2406.15522, arXiv.org, revised Aug 2024.
    6. Brian J. Reich & Shu Yang & Yawen Guan & Andrew B. Giffin & Matthew J. Miller & Ana Rappold, 2021. "A Review of Spatial Causal Inference Methods for Environmental and Epidemiological Applications," International Statistical Review, International Statistical Institute, vol. 89(3), pages 605-634, December.
    7. A. Giffin & B. J. Reich & S. Yang & A. G. Rappold, 2023. "Generalized propensity score approach to causal inference with spatial interference," Biometrics, The International Biometric Society, vol. 79(3), pages 2220-2231, September.
    8. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    9. Alan Andre Borges da Costa & Sergio Pinheiro Firpo, 2018. "An analysis of the distributive effects of public policies and their spillovers," Working Papers, Department of Economics 2018_06, University of São Paulo (FEA-USP).
    10. Haoge Chang, 2023. "Design-based Estimation Theory for Complex Experiments," Papers 2311.06891, arXiv.org.
    11. Ganesh Karapakula, 2023. "Stable Probability Weighting: Large-Sample and Finite-Sample Estimation and Inference Methods for Heterogeneous Causal Effects of Multivalued Treatments Under Limited Overlap," Papers 2301.05703, arXiv.org, revised Jan 2023.
    12. Luofeng Liao & Christian Kroer, 2023. "Statistical Inference and A/B Testing for First-Price Pacing Equilibria," Papers 2301.02276, arXiv.org, revised Jun 2023.
    13. Davide Viviano & Jess Rudder, 2020. "Policy design in experiments with unknown interference," Papers 2011.08174, arXiv.org, revised May 2024.
    14. Sujatro Chakladar & Samuel Rosin & Michael G. Hudgens & M. Elizabeth Halloran & John D. Clemens & Mohammad Ali & Michael E. Emch, 2022. "Inverse probability weighted estimators of vaccine effects accommodating partial interference and censoring," Biometrics, The International Biometric Society, vol. 78(2), pages 777-788, June.
    15. Li, Ting & Shi, Chengchun & Lu, Zhaohua & Li, Yi & Zhu, Hongtu, 2024. "Evaluating dynamic conditional quantile treatment effects with applications in ridesharing," LSE Research Online Documents on Economics 122488, London School of Economics and Political Science, LSE Library.
    16. Chunrong Ai & Yue Fang & Haitian Xie, 2024. "Data-driven Policy Learning for Continuous Treatments," Papers 2402.02535, arXiv.org, revised Nov 2024.
    17. Lina Zhang, 2020. "Spillovers of Program Benefits with Missing Network Links," Papers 2009.09614, arXiv.org, revised Aug 2024.
    18. Mert Demirer & Vasilis Syrgkanis & Greg Lewis & Victor Chernozhukov, 2019. "Semi-Parametric Efficient Policy Learning with Continuous Actions," CeMMAP working papers CWP34/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Christopher Harshaw & Fredrik Savje & Yitan Wang, 2022. "A Design-Based Riesz Representation Framework for Randomized Experiments," Papers 2210.08698, arXiv.org, revised Oct 2022.
    20. Gonzalo Vazquez-Bare, 2017. "Identification and Estimation of Spillover Effects in Randomized Experiments," Papers 1711.02745, arXiv.org, revised Jan 2022.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2311.02467. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.