IDEAS home Printed from https://ideas.repec.org/a/spr/stmapp/v32y2023i4d10.1007_s10260-022-00679-6.html
   My bibliography  Save this article

Community informed experimental design

Author

Listed:
  • Heather Mathews

    (Duke University)

  • Alexander Volfovsky

    (Duke University)

Abstract

Network information has become a common feature of many modern experiments. From vaccine efficacy studies to marketing for product adoption, stakeholders aim to estimate global treatment effects — what happens if everyone in a network is treated versus if no one is treated. Because individual outcomes are potentially influenced by the treatments or behaviors of others in the network, experimental designs must condition on the underlying network. Social networks frequently exhibit homophilous community structure, meaning that individuals within observed or latent communities are more similar to each. This observation motivates the development of community aware experimental design. This design recognizes that information between individuals likely flows along within community edges rather than across community edges. We demonstrate that this design reduces the bias of a simple difference in means estimator, even when the community structure of the graph needs to be estimated. Further, we show that as the community detection problem gets more difficult or if the community structure does not affect the causal question, the proposed design maintains its performance.

Suggested Citation

  • Heather Mathews & Alexander Volfovsky, 2023. "Community informed experimental design," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(4), pages 1141-1166, October.
  • Handle: RePEc:spr:stmapp:v:32:y:2023:i:4:d:10.1007_s10260-022-00679-6
    DOI: 10.1007/s10260-022-00679-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10260-022-00679-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10260-022-00679-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Guillaume W Basse & Edoardo M Airoldi, 2018. "Model-assisted design of experiments in the presence of network-correlated outcomes," Biometrika, Biometrika Trust, vol. 105(4), pages 849-858.
    2. Bowei Yan & Purnamrita Sarkar, 2021. "Covariate Regularized Community Detection in Sparse Graphs," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(534), pages 734-745, April.
    3. N. Binkiewicz & J. T. Vogelstein & K. Rohe, 2017. "Covariate-assisted spectral clustering," Biometrika, Biometrika Trust, vol. 104(2), pages 361-377.
    4. Hoff, Peter & Fosdick, Bailey & Volfovsky, Alex & Stovel, Katherine, 2013. "Likelihoods for fixed rank nomination networks," Network Science, Cambridge University Press, vol. 1(3), pages 253-277, December.
    5. Hudgens, Michael G. & Halloran, M. Elizabeth, 2008. "Toward Causal Inference With Interference," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 832-842, June.
    6. Mayer, Adalbert & Puller, Steven L., 2008. "The old boy (and girl) network: Social network formation on university campuses," Journal of Public Economics, Elsevier, vol. 92(1-2), pages 329-347, February.
    7. Junxian Geng & Anirban Bhattacharya & Debdeep Pati, 2019. "Probabilistic Community Detection With Unknown Number of Communities," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 893-905, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ariel Boyarsky & Hongseok Namkoong & Jean Pouget-Abadie, 2023. "Modeling Interference Using Experiment Roll-out," Papers 2305.10728, arXiv.org, revised Aug 2023.
    2. Braun, Martin & Verdier, Valentin, 2023. "Estimation of spillover effects with matched data or longitudinal network data," Journal of Econometrics, Elsevier, vol. 233(2), pages 689-714.
    3. Vivek F. Farias & Andrew A. Li & Tianyi Peng & Andrew Zheng, 2022. "Markovian Interference in Experiments," Papers 2206.02371, arXiv.org, revised Jun 2022.
    4. Davide Viviano, 2020. "Experimental Design under Network Interference," Papers 2003.08421, arXiv.org, revised Jul 2022.
    5. Peter Arcidiacono & Esteban Aucejo & Andrew Hussey & Kenneth Spenner, 2013. "Racial Segregation Patterns in Selective Universities," Journal of Law and Economics, University of Chicago Press, vol. 56(4), pages 1039-1060.
    6. Tiziano Arduini & Eleonora Patacchini & Edoardo Rainone, 2020. "Treatment Effects With Heterogeneous Externalities," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(4), pages 826-838, October.
    7. Yi Zhang & Kosuke Imai, 2023. "Individualized Policy Evaluation and Learning under Clustered Network Interference," Papers 2311.02467, arXiv.org, revised Feb 2024.
    8. Donald R. Davis & Jonathan I. Dingel & Joan Monras & Eduardo Morales, 2019. "How Segregated Is Urban Consumption?," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1684-1738.
    9. Yann Bramoullé & Habiba Djebbari & Bernard Fortin, 2020. "Peer Effects in Networks: A Survey," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 603-629, August.
    10. Giovanni Cerulli, 2014. "ntreatreg: a Stata module for estimation of treatment effects in the presence of neighborhood interactions," United Kingdom Stata Users' Group Meetings 2014 15, Stata Users Group.
    11. Luofeng Liao & Christian Kroer, 2024. "Statistical Inference and A/B Testing in Fisher Markets and Paced Auctions," Papers 2406.15522, arXiv.org, revised Aug 2024.
    12. Gil S. Epstein & Odelia Heizler-Cohen, 2016. "The Formation of Immigrant Networks in the Short and the Long Run," Economies, MDPI, vol. 4(3), pages 1-16, July.
    13. Marcos Hideyuki Yokoyama & Tomoki Sekiguchi, 2014. "The Use of Social Network Sites in the Workplace: a Case Study in Brazilian Companies," Brazilian Business Review, Fucape Business School, vol. 11(2), pages 87-114, March.
    14. Baylis, Kathy & Ham, Andres, 2015. "How important is spatial correlation in randomized controlled trials?," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205586, Agricultural and Applied Economics Association.
    15. Rediet Abebe & Nicole Immorlica & Jon Kleinberg & Brendan Lucier & Ali Shirali, 2022. "On the Effect of Triadic Closure on Network Segregation," Papers 2205.13658, arXiv.org.
    16. repec:mod:depeco:0002 is not listed on IDEAS
    17. Murat, Marina, 2014. "Out of Sight, Not Out of Mind. Education Networks and International Trade," World Development, Elsevier, vol. 58(C), pages 53-66.
    18. Laura Forastiere & Patrizia Lattarulo & Marco Mariani & Fabrizia Mealli & Laura Razzolini, 2021. "Exploring Encouragement, Treatment, and Spillover Effects Using Principal Stratification, With Application to a Field Experiment on Teens’ Museum Attendance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 244-258, January.
    19. Seth D. Zimmerman, 2019. "Elite Colleges and Upward Mobility to Top Jobs and Top Incomes," American Economic Review, American Economic Association, vol. 109(1), pages 1-47, January.
    20. Brian J. Reich & Shu Yang & Yawen Guan & Andrew B. Giffin & Matthew J. Miller & Ana Rappold, 2021. "A Review of Spatial Causal Inference Methods for Environmental and Epidemiological Applications," International Statistical Review, International Statistical Institute, vol. 89(3), pages 605-634, December.
    21. Hao, Shiming, 2021. "True structure change, spurious treatment effect? A novel approach to disentangle treatment effects from structure changes," MPRA Paper 108679, University Library of Munich, Germany.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stmapp:v:32:y:2023:i:4:d:10.1007_s10260-022-00679-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.