IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/43zbg.html
   My bibliography  Save this paper

Sample size calculations in economic RCTs: following clinical studies?

Author

Listed:
  • Gruener, Sven

Abstract

Clinical studies and economic experiments are often conducted utilizing randomized controlled trials. In contrast to clinical drug trials, sample size calculation has rarely been carried out by experimental economists. Using simple examples for illustration purposes, I discuss pros and cons of using sample size calculations in experimental economics.

Suggested Citation

  • Gruener, Sven, 2018. "Sample size calculations in economic RCTs: following clinical studies?," SocArXiv 43zbg, Center for Open Science.
    • Handle: RePEc:osf:socarx:43zbg
    DOI: 10.31219/osf.io/43zbg
    as

    Download full text from publisher

    File URL: https://osf.io/download/5b3d3c3b166089000f6b7600/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/43zbg?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jan Stoop, 2014. "From the lab to the field: envelopes, dictators and manners," Experimental Economics, Springer;Economic Science Association, vol. 17(2), pages 304-313, June.
    2. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    3. Anthony Ziegelmeyer & Katrin Schmelz & Matteo Ploner, 2012. "Hidden costs of control: four repetitions and an extension," Experimental Economics, Springer;Economic Science Association, vol. 15(2), pages 323-340, June.
    4. David J. Cooper, 1999. "Gaming against Managers in Incentive Systems: Experimental Results with Chinese Students and Chinese Managers," American Economic Review, American Economic Association, vol. 89(4), pages 781-804, September.
    5. Dunning,Thad, 2012. "Natural Experiments in the Social Sciences," Cambridge Books, Cambridge University Press, number 9781107017665, November.
    6. Jennifer Zelmer, 2003. "Linear Public Goods Experiments: A Meta-Analysis," Experimental Economics, Springer;Economic Science Association, vol. 6(3), pages 299-310, November.
    7. Nicolas Jacquemet & Stéphane Luchini & Jason F. Shogren & Adam Zylbersztejn, 2018. "Coordination with communication under oath," Experimental Economics, Springer;Economic Science Association, vol. 21(3), pages 627-649, September.
    8. Natalia Candelo & Rachel T. A. Croson & Catherine Eckel, 2018. "Transmission of information within transnational social networks: a field experiment," Experimental Economics, Springer;Economic Science Association, vol. 21(4), pages 905-923, December.
    9. Anna Dreber & Emma Essen & Eva Ranehill, 2011. "Outrunning the gender gap—boys and girls compete equally," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 567-582, November.
    10. John List & Sally Sadoff & Mathis Wagner, 2011. "So you want to run an experiment, now what? Some simple rules of thumb for optimal experimental design," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 439-457, November.
    11. Anna Dreber & Emma Essen & Eva Ranehill, 2014. "Gender and competition in adolescence: task matters," Experimental Economics, Springer;Economic Science Association, vol. 17(1), pages 154-172, March.
    12. Dunning,Thad, 2012. "Natural Experiments in the Social Sciences," Cambridge Books, Cambridge University Press, number 9781107698000, November.
    13. Robert Moir, 1998. "A Monte Carlo Analysis of the Fisher Randomization Technique: Reviving Randomization for Experimental Economists," Experimental Economics, Springer;Economic Science Association, vol. 1(1), pages 87-100, June.
    14. Lina Koppel & David Andersson & India Morrison & Kinga Posadzy & Daniel Västfjäll & Gustav Tinghög, 2017. "The effect of acute pain on risky and intertemporal choice," Experimental Economics, Springer;Economic Science Association, vol. 20(4), pages 878-893, December.
    15. Jillian Jordan & Katherine McAuliffe & David Rand, 2016. "The effects of endowment size and strategy method on third party punishment," Experimental Economics, Springer;Economic Science Association, vol. 19(4), pages 741-763, December.
    16. Sebastian Galiani & Paul Gertler & Mauricio Romero, 2017. "Incentives for Replication in Economics," NBER Working Papers 23576, National Bureau of Economic Research, Inc.
    17. Guala,Francesco, 2005. "The Methodology of Experimental Economics," Cambridge Books, Cambridge University Press, number 9780521618618, January.
    18. Ola Andersson & Topi Miettinen & Kaisa Hytönen & Magnus Johannesson & Ute Stephan, 2017. "Subliminal influence on generosity," Experimental Economics, Springer;Economic Science Association, vol. 20(3), pages 531-555, September.
    19. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    20. Guth, Werner & Schmittberger, Rolf & Schwarze, Bernd, 1982. "An experimental analysis of ultimatum bargaining," Journal of Economic Behavior & Organization, Elsevier, vol. 3(4), pages 367-388, December.
    21. Zacharias Maniadis & Fabio Tufano & John A. List, 2014. "One Swallow Doesn't Make a Summer: New Evidence on Anchoring Effects," American Economic Review, American Economic Association, vol. 104(1), pages 277-290, January.
    22. Nick Feltovich, 2003. "Nonparametric Tests of Differences in Medians: Comparison of the Wilcoxon–Mann–Whitney and Robust Rank-Order Tests," Experimental Economics, Springer;Economic Science Association, vol. 6(3), pages 273-297, November.
    23. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    24. Emel Filiz-Ozbay & John C. Ham & John H. Kagel & Erkut Y. Ozbay, 2018. "The role of cognitive ability and personality traits for men and women in gift exchange outcomes," Experimental Economics, Springer;Economic Science Association, vol. 21(3), pages 650-672, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Grüner Sven, 2020. "Sample Size Calculation in Economic Experiments," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 240(6), pages 791-823, December.
    2. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    3. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    4. Omar Al-Ubaydli & John List & Claire Mackevicius & Min Sok Lee & Dana Suskind, 2019. "How Can Experiments Play a Greater Role in Public Policy? 12 Proposals from an Economic Model of Scaling," Artefactual Field Experiments 00679, The Field Experiments Website.
    5. Fiore, Annamaria, 2009. "Experimental Economics: Some Methodological Notes," MPRA Paper 12498, University Library of Munich, Germany.
    6. Lehberger, Mira & Grüner, Sven, 2021. "Consumers’ willingness to pay for plants protected by beneficial insects – Evidence from two stated-choice experiments with different subject pools," Food Policy, Elsevier, vol. 102(C).
    7. Bouma, J.A. & Nguyen, Binh & van der Heijden, Eline & Dijk, J.J., 2018. "Analysing Group Contract Design Using a Lab and a Lab-in-the-Field Threshold Public Good Experiment," Other publications TiSEM 34e2dea1-dc21-4a44-b43f-2, Tilburg University, School of Economics and Management.
    8. Attallah, May & Abildtrup, Jens & Stenger, Anne, 2022. "Non-monetary incentives for sustainable biomass harvest: An experimental approach," Resource and Energy Economics, Elsevier, vol. 69(C).
    9. Youwei Wang & Yuxin Chen & Yi Qian, 2018. "The Causal Link between Relative Age Effect and Entrepreneurship: Evidence from 17 Million Users across 49 Years on Taobao," NBER Working Papers 25318, National Bureau of Economic Research, Inc.
    10. Omar Al-Ubaydli & John List, 2013. "On the Generalizability of Experimental Results in Economics: With A Response To Camerer," Artefactual Field Experiments j0001, The Field Experiments Website.
    11. Eric Floyd & John A. List, 2016. "Using Field Experiments in Accounting and Finance," Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 437-475, May.
    12. Weili Ding, 2020. "Laboratory experiments can pre-design to address power and selection issues," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(2), pages 125-138, December.
    13. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    14. Brit Grosskopf & Graeme Pearce, 2020. "Do You Mind Me Paying Less? Measuring Other-Regarding Preferences in the Market for Taxis," Management Science, INFORMS, vol. 66(11), pages 5059-5074, November.
    15. Charles A. Holt & Sean P. Sullivan, 2023. "Permutation tests for experimental data," Experimental Economics, Springer;Economic Science Association, vol. 26(4), pages 775-812, September.
    16. Hallsworth, Michael & List, John A. & Metcalfe, Robert D. & Vlaev, Ivo, 2017. "The behavioralist as tax collector: Using natural field experiments to enhance tax compliance," Journal of Public Economics, Elsevier, vol. 148(C), pages 14-31.
    17. Holger Herz & Dmitry Taubinsky, 2018. "What Makes a Price Fair? An Experimental Study of Transaction Experience and Endogenous Fairness Views," Journal of the European Economic Association, European Economic Association, vol. 16(2), pages 316-352.
    18. Soo Hong Chew & Junjian Yi & Junsen Zhang & Songfa Zhong, 2018. "Risk Aversion and Son Preference: Experimental Evidence from Chinese Twin Parents," Management Science, INFORMS, vol. 64(8), pages 3896-3910, August.
    19. Nicolas Vallois & Dorian Jullien, 2017. "Replication in experimental economics: A historical and quantitative approach focused on public good game experiments," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01651080, HAL.
    20. Gruner, Sven & Lehberger, Mira & Hirschauer, Norbert & Mußhoff, Oliver, 2022. "How (un)informative are experiments with students for other social groups? A study of agricultural students and farmers," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(03), January.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:43zbg. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.