IDEAS home Printed from https://ideas.repec.org/a/bpj/causin/v12y2024i1p18n1.html
   My bibliography  Save this article

Optimal allocation of sample size for randomization-based inference from 2K factorial designs

Author

Listed:
  • Ravichandran Arun

    (Department of Statistics, Rutgers University, Piscataway, NJ, USA)

  • Pashley Nicole E.

    (Department of Statistics, Rutgers University, Piscataway, NJ, USA)

  • Libgober Brian

    (Department of Political Science and Law, Northwestern University, Chicago, IL, USA)

  • Dasgupta Tirthankar

    (Department of Statistics, Rutgers University, Piscataway, NJ, USA)

Abstract

Optimizing the allocation of units into treatment groups can help researchers improve the precision of causal estimators and decrease costs when running factorial experiments. However, existing optimal allocation results typically assume a super-population model and that the outcome data come from a known family of distributions. Instead, we focus on randomization-based causal inference for the finite-population setting, which does not require model specifications for the data or sampling assumptions. We propose exact theoretical solutions for optimal allocation in 2 K {2}^{K} factorial experiments under complete randomization with A-, D-, and E-optimality criteria. We then extend this work to factorial designs with block randomization. We also derive results for optimal allocations when using cost-based constraints. To connect our theory to practice, we provide convenient integer-constrained programming solutions using a greedy optimization approach to find integer optimal allocation solutions for both complete and block randomizations. The proposed methods are demonstrated using two real-life factorial experiments conducted by social scientists.

Suggested Citation

  • Ravichandran Arun & Pashley Nicole E. & Libgober Brian & Dasgupta Tirthankar, 2024. "Optimal allocation of sample size for randomization-based inference from 2K factorial designs," Journal of Causal Inference, De Gruyter, vol. 12(1), pages 1-18, January.
  • Handle: RePEc:bpj:causin:v:12:y:2024:i:1:p:18:n:1
    DOI: 10.1515/jci-2023-0046
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/jci-2023-0046
    Download Restriction: no

    File URL: https://libkey.io/10.1515/jci-2023-0046?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jinyong Hahn & Keisuke Hirano & Dean Karlan, 2011. "Adaptive Experimental Design Using the Propensity Score," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 96-108, January.
    2. Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey M. Wooldridge, 2020. "Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis," Econometrica, Econometric Society, vol. 88(1), pages 265-296, January.
    3. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    4. Friedrich, Ulf & Münnich, Ralf & de Vries, Sven & Wagner, Matthias, 2015. "Fast integer-valued algorithms for optimal allocations under constraints in stratified sampling," Computational Statistics & Data Analysis, Elsevier, vol. 92(C), pages 1-12.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jinglong Zhao, 2024. "Experimental Design For Causal Inference Through An Optimization Lens," Papers 2408.09607, arXiv.org, revised Aug 2024.
    2. Pugatch, Todd & Wilson, Nicholas, 2018. "Nudging study habits: A field experiment on peer tutoring in higher education," Economics of Education Review, Elsevier, vol. 62(C), pages 151-161.
    3. Jason M. Lindo & Nicholas J. Sanders & Philip Oreopoulos, 2010. "Ability, Gender, and Performance Standards: Evidence from Academic Probation," American Economic Journal: Applied Economics, American Economic Association, vol. 2(2), pages 95-117, April.
    4. Lea Cassar & Mira Fischer & Vanessa Valero, 2022. "Keep Calm and Carry On: Immediate-vs. Six-Month Effects of Mindfulness Training on Academic Performance," CESifo Working Paper Series 10099, CESifo.
    5. Victor Gay, 2023. "Culture: An Empirical Investigation of Beliefs, Work, and Fertility. A Verification and Reproduction of Fernández and Fogli (2009)," Post-Print hal-04194417, HAL.
    6. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    7. Oswald, Yvonne & Backes-Gellner, Uschi, 2014. "Learning for a bonus: How financial incentives interact with preferences," Journal of Public Economics, Elsevier, vol. 118(C), pages 52-61.
    8. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
    9. Scott Carrell & Bruce Sacerdote, 2017. "Why Do College-Going Interventions Work?," American Economic Journal: Applied Economics, American Economic Association, vol. 9(3), pages 124-151, July.
    10. De Paola, Maria & Scoppa, Vincenzo, 2015. "Procrastination, academic success and the effectiveness of a remedial program," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 217-236.
    11. Bodory, Hugo & Huber, Martin, 2018. "The causalweight package for causal inference in R," FSES Working Papers 493, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    12. Scott E. Carrell & Michal Kurlaender, 2023. "My Professor Cares: Experimental Evidence on the Role of Faculty Engagement," American Economic Journal: Economic Policy, American Economic Association, vol. 15(4), pages 113-141, November.
    13. Aufenanger, Tobias, 2017. "Machine learning to improve experimental design," FAU Discussion Papers in Economics 16/2017, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics, revised 2017.
    14. Lisa Barrow & Cecilia Elena Rouse, 2018. "Financial Incentives and Educational Investment: The Impact of Performance-based Scholarships on Student Time Use," Education Finance and Policy, MIT Press, vol. 13(4), pages 419-448, Fall.
    15. Praveen Ranjan Srivastava & Prajwal Eachempati & Ajay Kumar & Ashish Kumar Jha & Lalitha Dhamotharan, 2023. "Best strategy to win a match: an analytical approach using hybrid machine learning-clustering-association rule framework," Annals of Operations Research, Springer, vol. 325(1), pages 319-361, June.
    16. Ellis, Jimmy R. & Gershenson, Seth, 2016. "LATE for the Meeting: Gender, Peer Advising, and College Success," IZA Discussion Papers 9956, Institute of Labor Economics (IZA).
    17. Lisa Barrow & Cecilia Elena Rouse & Amanda McFarland, 2020. "Who Has the Time? Community College Students’ Time-Use Response to Financial Incentives," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 48(1), pages 35-52, March.
    18. Rockoff, Jonah E. & Lockwood, Benjamin B., 2010. "Stuck in the middle: Impacts of grade configuration in public schools," Journal of Public Economics, Elsevier, vol. 94(11-12), pages 1051-1061, December.
    19. Alberini, Anna & Bezhanishvili, Levan & Ščasný, Milan, 2022. "“Wild” tariff schemes: Evidence from the Republic of Georgia," Energy Economics, Elsevier, vol. 110(C).
    20. Márton Medgyesi & Temesváry, Z., 2013. "GINI DP 84: Conditional cash transfers in high- income OECD countries and their effects on human capital accumulation," GINI Discussion Papers 84, AIAS, Amsterdam Institute for Advanced Labour Studies.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:causin:v:12:y:2024:i:1:p:18:n:1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.