IDEAS home Printed from https://ideas.repec.org/a/eee/socmed/v75y2012i12p2299-2306.html
   My bibliography  Save this article

Realist randomised controlled trials: A new approach to evaluating complex public health interventions

Author

Listed:
  • Bonell, Chris
  • Fletcher, Adam
  • Morton, Matthew
  • Lorenc, Theo
  • Moore, Laurence

Abstract

Randomized trials of complex public health interventions generally aim to identify what works, accrediting specific intervention ‘products’ as effective. This approach often fails to give sufficient consideration to how intervention components interact with each other and with local context. ‘Realists’ argue that trials misunderstand the scientific method, offer only a ‘successionist’ approach to causation, which brackets out the complexity of social causation, and fail to ask which interventions work, for whom and under what circumstances. We counter-argue that trials are useful in evaluating social interventions because randomized control groups actually take proper account of rather than bracket out the complexity of social causation. Nonetheless, realists are right to stress understanding of ‘what works, for whom and under what circumstances’ and to argue for the importance of theorizing and empirically examining underlying mechanisms. We propose that these aims can be (and sometimes already are) examined within randomized trials. Such ‘realist’ trials should aim to: examine the effects of intervention components separately and in combination, for example using multi-arm studies and factorial trials; explore mechanisms of change, for example analysing how pathway variables mediate intervention effects; use multiple trials across contexts to test how intervention effects vary with context; draw on complementary qualitative and quantitative data; and be oriented towards building and validating ‘mid-level’ program theories which would set out how interventions interact with context to produce outcomes. This last suggestion resonates with recent suggestions that, in delivering truly ‘complex’ interventions, fidelity is important not so much in terms of precise activities but, rather, key intervention ‘processes’ and ‘functions’. Realist trials would additionally determine the validity of program theory rather than only examining ‘what works’ to better inform policy and practice in the long-term.

Suggested Citation

  • Bonell, Chris & Fletcher, Adam & Morton, Matthew & Lorenc, Theo & Moore, Laurence, 2012. "Realist randomised controlled trials: A new approach to evaluating complex public health interventions," Social Science & Medicine, Elsevier, vol. 75(12), pages 2299-2306.
  • Handle: RePEc:eee:socmed:v:75:y:2012:i:12:p:2299-2306
    DOI: 10.1016/j.socscimed.2012.08.032
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0277953612006399
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.socscimed.2012.08.032?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Morton, Matthew H & Montgomery, Paul, 2012. "Empowerment-based non-formal education for Arab youth: A pilot randomized trial," Children and Youth Services Review, Elsevier, vol. 34(2), pages 417-425.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ligia Kiss & David Fotheringhame & Joelle Mak & Alys McAlpine & Cathy Zimmerman, 2021. "The use of Bayesian networks for realist evaluation of complex interventions: evidence for prevention of human trafficking," Journal of Computational Social Science, Springer, vol. 4(1), pages 25-48, May.
    2. Gyeongcheol Cho & Younyoung Choi & Ji-Hyun Kim, 2020. "Investigating the Unintended Consequences of the High School Equalization Policy on the Housing Market," Sustainability, MDPI, vol. 12(20), pages 1-9, October.
    3. Margaret Dalziel, 2018. "Why are there (almost) no randomised controlled trial-based evaluations of business support programmes?," Palgrave Communications, Palgrave Macmillan, vol. 4(1), pages 1-9, December.
    4. Warren Pearce & Sujatha Raman, 2014. "The new randomised controlled trials (RCT) movement in public policy: challenges of epistemic governance," Policy Sciences, Springer;Society of Policy Sciences, vol. 47(4), pages 387-402, December.
    5. Busse, Heide & Campbell, Rona & Kipping, Ruth, 2018. "Developing a typology of mentoring programmes for young people attending secondary school in the United Kingdom using qualitative methods," Children and Youth Services Review, Elsevier, vol. 88(C), pages 401-415.
    6. Hawe, Penelope & Riley, Therese & Gartrell, Alexandra & Turner, Karen & Canales, Claudia & Omstead, Darlene, 2015. "Comparison communities in a cluster randomised trial innovate in response to ‘being controlled’," Social Science & Medicine, Elsevier, vol. 133(C), pages 102-110.
    7. Dan Bristow & Lauren Carter & Steve Martin, 2015. "Using evidence to improve policy and practice: the UK What Works Centres," Contemporary Social Science, Taylor & Francis Journals, vol. 10(2), pages 126-137, June.
    8. Melendez-Torres, G.J. & Warren, Emily & Viner, Russell & Allen, Elizabeth & Bonell, Chris, 2021. "Moderated mediation analyses to assess intervention mechanisms for impacts on victimisation, psycho-social problems and mental wellbeing: Evidence from the INCLUSIVE realist randomized trial," Social Science & Medicine, Elsevier, vol. 279(C).
    9. Mulhall, Peter & Taggart, Laurence & Coates, Vivien & McAloon, Toni & Hassiotis, Angela, 2018. "A systematic review of the methodological and practical challenges of undertaking randomised-controlled trials with cognitive disability populations," Social Science & Medicine, Elsevier, vol. 200(C), pages 114-128.
    10. Legrand, Karine & Minary, Laetitia & Briançon, Serge, 2018. "Exploration of the experiences, practices and needs of health promotion professionals when evaluating their interventions and programmes," Evaluation and Program Planning, Elsevier, vol. 70(C), pages 67-72.
    11. Humphreys, David K. & Eisner, Manuel P., 2014. "Do flexible alcohol trading hours reduce violence? A theory-based natural experiment in alcohol policy," Social Science & Medicine, Elsevier, vol. 102(C), pages 1-9.
    12. Mélanie Villeval & Elsa Bidault & Jeannie Shoveller & François Alias & Jean-Charles Basson & Catherine Frasse & Jean-Paul Génolini & Elisabeth Pons & Damien Verbiguié & Pascale Grosclaude & Thierry La, 2016. "Enabling the transferability of complex interventions: exploring the combination of an intervention’s key functions and implementation," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 61(9), pages 1031-1038, December.
    13. Hatcher, Abigail M & McBride, Ruari-Santiago & Rebombo, Dumisani & Munshi, Shehnaz & Khumalo, Mzwakhe & Christofides, Nicola, 2020. "Process evaluation of a community mobilization intervention for preventing men’s partner violence use in peri-urban South Africa," Evaluation and Program Planning, Elsevier, vol. 78(C).
    14. Massazza, Alessandro & May, Carl R. & Roberts, Bayard & Tol, Wietse A. & Bogdanov, Sergiy & Nadkarni, Abhijit & Fuhr, Daniela C., 2022. "Process evaluations of mental health and psychosocial support interventions for populations affected by humanitarian crises," Social Science & Medicine, Elsevier, vol. 303(C).
    15. Busse, Heide & Campbell, Rona & Kipping, Ruth, 2018. "Examining the wider context of formal youth mentoring programme development, delivery and maintenance: A qualitative study with mentoring managers and experts in the United Kingdom," Children and Youth Services Review, Elsevier, vol. 95(C), pages 95-108.
    16. Wolfgang A. Markham & Alan Dolan & Graham F. Moore, 2021. "A Sociological Framework to Reduce Aberrant Behaviour of School Students Through Increasing School Connectedness," SAGE Open, , vol. 11(3), pages 21582440211, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Willems, Jurgen, 2015. "Individual perceptions on the participant and societal functionality of non-formal education for youth: Explaining differences across countries based on the human development index," International Journal of Educational Development, Elsevier, vol. 44(C), pages 11-20.
    2. Shephard, Daniel D. & Kaneza, Yves V. & Moclair, Paul, 2017. "What curriculum? Which methods? A cluster randomized controlled trial of social and financial education in Rwanda," Children and Youth Services Review, Elsevier, vol. 82(C), pages 310-320.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:socmed:v:75:y:2012:i:12:p:2299-2306. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/315/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.