IDEAS home Printed from https://ideas.repec.org/p/ifs/ifsewp/16-23.html
   My bibliography  Save this paper

‘Randomisation bias’ in the medical literature: a review

Author

Listed:
  • Barbara Sianesi

    (Institute for Fiscal Studies and Institute for Fiscal Studies)

Abstract

Randomised controlled or clinical trials (RCTs) are generally viewed as the most reliable method to draw causal inference as to the effects of a treatment, as they should guarantee that the individuals being compared differ only in terms of their exposure to the treatment of interest. This ‘gold standard’ result however hinges on the requirement that the randomisation device determines the random allocation of individuals to the treatment without affecting any other element of the causal model. This ‘no randomisation bias’ assumption is generally untestable but if violated would undermine the causal inference emerging from an RCT, both in terms of its internal validity and in terms of its relevance for policy purposes. This paper offers a concise review of how the medical literature identifies and deals with such issues.

Suggested Citation

  • Barbara Sianesi, 2016. "‘Randomisation bias’ in the medical literature: a review," IFS Working Papers W16/23, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:ifsewp:16/23
    as

    Download full text from publisher

    File URL: https://www.ifs.org.uk/uploads/publications/wps/WP201623.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Glasgow, R.E. & Vogt, T.M. & Boles, S.M., 1999. "Evaluating the public health impact of health promotion interventions: The RE-AIM framework," American Journal of Public Health, American Public Health Association, vol. 89(9), pages 1322-1327.
    2. Hunt Allcott, 2012. "Site Selection Bias in Program Evaluation," NBER Working Papers 18373, National Bureau of Economic Research, Inc.
    3. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    4. Bower, Peter & King, Michael & Nazareth, Irwin & Lampe, Fiona & Sibbald, Bonnie, 2005. "Patient preferences in randomised controlled trials: Conceptual framework and implications for research," Social Science & Medicine, Elsevier, vol. 61(3), pages 685-695, August.
    5. James J. Heckman & Jeffrey A. Smith, 1998. "Evaluating the Welfare State," NBER Working Papers 6542, National Bureau of Economic Research, Inc.
    6. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    7. Barbara Sianesi, 2014. "Dealing with randomisation bias in a social experiment: the case of ERA," IFS Working Papers W14/10, Institute for Fiscal Studies.
    8. Joseph Hotz, V. & Imbens, Guido W. & Mortimer, Julie H., 2005. "Predicting the efficacy of future training programs using past experiences at other locations," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 241-270.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sianesi, Barbara, 2017. "Evidence of randomisation bias in a large-scale social experiment: The case of ERA," Journal of Econometrics, Elsevier, vol. 198(1), pages 41-64.
    2. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    3. Jean-Pierre Florens & James Heckman & Costas Meghir & Edward Vytlacil, 2002. "Instrumental variables, local instrumental variables and control functions," CeMMAP working papers CWP15/02, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. James J. Heckman, 2008. "Econometric Causality," International Statistical Review, International Statistical Institute, vol. 76(1), pages 1-27, April.
    5. Paul Hunermund & Elias Bareinboim, 2019. "Causal Inference and Data Fusion in Econometrics," Papers 1912.09104, arXiv.org, revised Mar 2023.
    6. James J. Heckman, 2005. "Micro Data, Heterogeneity and the Evaluation of Public Policy Part 2," The American Economist, Sage Publications, vol. 49(1), pages 16-44, March.
    7. Bareinboim Elias & Pearl Judea, 2013. "A General Algorithm for Deciding Transportability of Experimental Results," Journal of Causal Inference, De Gruyter, vol. 1(1), pages 107-134, June.
    8. Jeffrey Smith, 2000. "A Critical Survey of Empirical Methods for Evaluating Active Labor Market Policies," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 136(III), pages 247-268, September.
    9. Manuel Arellano & Stéphane Bonhomme, 2017. "Quantile Selection Models With an Application to Understanding Changes in Wage Inequality," Econometrica, Econometric Society, vol. 85, pages 1-28, January.
    10. Troske, Kenneth R. & Voicu, Alexandru, 2010. "Joint estimation of sequential labor force participation and fertility decisions using Markov chain Monte Carlo techniques," Labour Economics, Elsevier, vol. 17(1), pages 150-169, January.
    11. Pierre-Philippe Combes & Bruno Decreuse & Morgane Laouénan & Alain Trannoy, 2016. "Customer Discrimination and Employment Outcomes: Theory and Evidence from the French Labor Market," Journal of Labor Economics, University of Chicago Press, vol. 34(1), pages 107-160.
    12. Heckman, James, 2001. "Accounting for Heterogeneity, Diversity and General Equilibrium in Evaluating Social Programmes," Economic Journal, Royal Economic Society, vol. 111(475), pages 654-699, November.
    13. Timothy B. Armstrong & Michal Kolesár, 2021. "Sensitivity analysis using approximate moment condition models," Quantitative Economics, Econometric Society, vol. 12(1), pages 77-108, January.
    14. Susan Athey & Raj Chetty & Guido Imbens, 2020. "Combining Experimental and Observational Data to Estimate Treatment Effects on Long Term Outcomes," Papers 2006.09676, arXiv.org.
    15. Guilhem Bascle, 2008. "Controlling for endogeneity with instrumental variables in strategic management research," Post-Print hal-00576795, HAL.
    16. Pierre-Philippe Combes & Bruno Decreuse & Morgane Laouénan & Alain Trannoy, 2016. "Customer Discrimination and Employment Outcomes: Theory and Evidence from the French Labor Market," Journal of Labor Economics, University of Chicago Press, vol. 34(1), pages 107-160.
    17. Sokbae Lee & Bernard Salanié, 2018. "Identifying Effects of Multivalued Treatments," Econometrica, Econometric Society, vol. 86(6), pages 1939-1963, November.
    18. Steven D. Levitt & Jack Porter, 2001. "Sample Selection In The Estimation Of Air Bag And Seat Belt Effectiveness," The Review of Economics and Statistics, MIT Press, vol. 83(4), pages 603-615, November.
    19. Zamarro, Gema, 2010. "Accounting for heterogeneous returns in sequential schooling decisions," Journal of Econometrics, Elsevier, vol. 156(2), pages 260-276, June.
    20. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.

    More about this item

    Keywords

    randomised trials; medical;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:ifsewp:16/23. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/ifsssuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.