IDEAS home Printed from https://ideas.repec.org/a/spr/stmapp/v32y2023i4d10.1007_s10260-022-00679-6.html
   My bibliography  Save this article

Community informed experimental design

Author

Listed:
  • Heather Mathews

    (Duke University)

  • Alexander Volfovsky

    (Duke University)

Abstract

Network information has become a common feature of many modern experiments. From vaccine efficacy studies to marketing for product adoption, stakeholders aim to estimate global treatment effects — what happens if everyone in a network is treated versus if no one is treated. Because individual outcomes are potentially influenced by the treatments or behaviors of others in the network, experimental designs must condition on the underlying network. Social networks frequently exhibit homophilous community structure, meaning that individuals within observed or latent communities are more similar to each. This observation motivates the development of community aware experimental design. This design recognizes that information between individuals likely flows along within community edges rather than across community edges. We demonstrate that this design reduces the bias of a simple difference in means estimator, even when the community structure of the graph needs to be estimated. Further, we show that as the community detection problem gets more difficult or if the community structure does not affect the causal question, the proposed design maintains its performance.

Suggested Citation

  • Heather Mathews & Alexander Volfovsky, 2023. "Community informed experimental design," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(4), pages 1141-1166, October.
  • Handle: RePEc:spr:stmapp:v:32:y:2023:i:4:d:10.1007_s10260-022-00679-6
    DOI: 10.1007/s10260-022-00679-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10260-022-00679-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10260-022-00679-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hudgens, Michael G. & Halloran, M. Elizabeth, 2008. "Toward Causal Inference With Interference," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 832-842, June.
    2. Guillaume W Basse & Edoardo M Airoldi, 2018. "Model-assisted design of experiments in the presence of network-correlated outcomes," Biometrika, Biometrika Trust, vol. 105(4), pages 849-858.
    3. Junxian Geng & Anirban Bhattacharya & Debdeep Pati, 2019. "Probabilistic Community Detection With Unknown Number of Communities," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 893-905, April.
    4. Hoff, Peter & Fosdick, Bailey & Volfovsky, Alex & Stovel, Katherine, 2013. "Likelihoods for fixed rank nomination networks," Network Science, Cambridge University Press, vol. 1(3), pages 253-277, December.
    5. Bowei Yan & Purnamrita Sarkar, 2021. "Covariate Regularized Community Detection in Sparse Graphs," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(534), pages 734-745, April.
    6. N. Binkiewicz & J. T. Vogelstein & K. Rohe, 2017. "Covariate-assisted spectral clustering," Biometrika, Biometrika Trust, vol. 104(2), pages 361-377.
    7. Mayer, Adalbert & Puller, Steven L., 2008. "The old boy (and girl) network: Social network formation on university campuses," Journal of Public Economics, Elsevier, vol. 92(1-2), pages 329-347, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ariel Boyarsky & Hongseok Namkoong & Jean Pouget-Abadie, 2023. "Modeling Interference Using Experiment Roll-out," Papers 2305.10728, arXiv.org, revised Aug 2023.
    2. Vivek F. Farias & Andrew A. Li & Tianyi Peng & Andrew Zheng, 2022. "Markovian Interference in Experiments," Papers 2206.02371, arXiv.org, revised Jun 2022.
    3. Braun, Martin & Verdier, Valentin, 2023. "Estimation of spillover effects with matched data or longitudinal network data," Journal of Econometrics, Elsevier, vol. 233(2), pages 689-714.
    4. Davide Viviano, 2020. "Experimental Design under Network Interference," Papers 2003.08421, arXiv.org, revised Jul 2022.
    5. Peter Arcidiacono & Esteban Aucejo & Andrew Hussey & Kenneth Spenner, 2013. "Racial Segregation Patterns in Selective Universities," Journal of Law and Economics, University of Chicago Press, vol. 56(4), pages 1039-1060.
    6. Tiziano Arduini & Eleonora Patacchini & Edoardo Rainone, 2020. "Treatment Effects With Heterogeneous Externalities," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(4), pages 826-838, October.
    7. Anup Malani & Cynthia Kinnan & Gabriella Conti & Kosuke Imai & Morgen Miller & Shailender Swaminathan & Alessandra Voena & Bartosz Woda, 2024. "Evaluating pricing health insurance in lower-income countries: A field experiment in India," IFS Working Papers W24/33, Institute for Fiscal Studies.
    8. Giovanni Cerulli, 2014. "ntreatreg: a Stata module for estimation of treatment effects in the presence of neighborhood interactions," United Kingdom Stata Users' Group Meetings 2014 15, Stata Users Group.
    9. Baylis, Kathy & Ham, Andres, 2015. "How important is spatial correlation in randomized controlled trials?," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205586, Agricultural and Applied Economics Association.
    10. Seth D. Zimmerman, 2019. "Elite Colleges and Upward Mobility to Top Jobs and Top Incomes," American Economic Review, American Economic Association, vol. 109(1), pages 1-47, January.
    11. Yann Bramoullé & Bernard Fortin, 2009. "The Econometrics of Social Networks," Cahiers de recherche 0913, CIRPEE.
    12. Fan Li & Ashley L. Buchanan & Stephen R. Cole, 2022. "Generalizing trial evidence to target populations in non‐nested designs: Applications to AIDS clinical trials," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(3), pages 669-697, June.
    13. Schulz, Jan & Mayerhoffer, Daniel M., 2021. "A network approach to consumption," BERG Working Paper Series 173, Bamberg University, Bamberg Economic Research Group.
    14. Han, Kevin & Basse, Guillaume & Bojinov, Iavor, 2024. "Population interference in panel experiments," Journal of Econometrics, Elsevier, vol. 238(1).
    15. A. Giffin & B. J. Reich & S. Yang & A. G. Rappold, 2023. "Generalized propensity score approach to causal inference with spatial interference," Biometrics, The International Biometric Society, vol. 79(3), pages 2220-2231, September.
    16. Horrace, William & Jung, Hyunseok & Presler, Jonathan & Schwartz, Amy Ellen, 2021. "What Makes a Classmate a Peer? Examining which peers matter in NYC elementary schools," Working Papers 21-4, Sinquefield Center for Applied Economic Research, Saint Louis University, revised 17 Jan 2022.
    17. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    18. Marina Murat, 2017. "International Students and Investments Abroad," Global Economy Journal (GEJ), World Scientific Publishing Co. Pte. Ltd., vol. 17(1), pages 1-33, March.
    19. Rafael P. Ribas, 2014. "Liquidity Constraints, Informal Financing, and Entrepreneurship: Direct and Indirect Effects of a Cash Transfer Programme," Working Papers 131, International Policy Centre for Inclusive Growth.
    20. Malani, Anup & Kinnan, Cynthia & Conti, Gabriella & Imai, Kosuke & Miller, Morgen & Swaminathan, Shailender & Voena, Alessandra & Woda, Bartek, 2024. "Evaluating and pricing health insurance in lower-income countries: A field experiment in India," CEPR Discussion Papers 19326, C.E.P.R. Discussion Papers.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stmapp:v:32:y:2023:i:4:d:10.1007_s10260-022-00679-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.