IDEAS home Printed from https://ideas.repec.org/a/eee/socmed/v272y2021ics0277953621000290.html
   My bibliography  Save this article

Evaluation of public health interventions from a complex systems perspective: A research methods review

Author

Listed:
  • McGill, Elizabeth
  • Er, Vanessa
  • Penney, Tarra
  • Egan, Matt
  • White, Martin
  • Meier, Petra
  • Whitehead, Margaret
  • Lock, Karen
  • Anderson de Cuevas, Rachel
  • Smith, Richard
  • Savona, Natalie
  • Rutter, Harry
  • Marks, Dalya
  • de Vocht, Frank
  • Cummins, Steven
  • Popay, Jennie
  • Petticrew, Mark

Abstract

Applying a complex systems perspective to public health evaluation may increase the relevance and strength of evidence to improve health and reduce health inequalities. In this review of methods, we aimed to: (i) classify and describe different complex systems methods in evaluation applied to public health; and (ii) examine the kinds of evaluative evidence generated by these different methods.

Suggested Citation

  • McGill, Elizabeth & Er, Vanessa & Penney, Tarra & Egan, Matt & White, Martin & Meier, Petra & Whitehead, Margaret & Lock, Karen & Anderson de Cuevas, Rachel & Smith, Richard & Savona, Natalie & Rutter, 2021. "Evaluation of public health interventions from a complex systems perspective: A research methods review," Social Science & Medicine, Elsevier, vol. 272(C).
    • Handle: RePEc:eee:socmed:v:272:y:2021:i:c:s0277953621000290
    DOI: 10.1016/j.socscimed.2021.113697
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0277953621000290
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socscimed.2021.113697?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alfandari, Ravit, 2019. "Multi-professional work in child protection decision-making: An Israeli case study," Children and Youth Services Review, Elsevier, vol. 98(C), pages 51-57.
    2. Josée Lapalme & Sherri Bisset & Louise Potvin, 2014. "Role of context in evaluating neighbourhood interventions promoting positive youth development: a narrative systematic review," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 59(1), pages 31-42, February.
    3. J Swanson, 2002. "Business Dynamics—Systems Thinking and Modeling for a Complex World," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 53(4), pages 472-473, April.
    4. Blackman, Tim & Wistow, Jonathan & Byrne, David, 2011. "A Qualitative Comparative Analysis of factors associated with trends in narrowing health inequalities in England," Social Science & Medicine, Elsevier, vol. 72(12), pages 1965-1974, June.
    5. repec:aph:ajpbhl:10.2105/ajph.2017.303685_9 is not listed on IDEAS
    6. Yang, Y. & Diez-Roux, A. & Evenson, K.R. & Colabianchi, N., 2014. "Examining the impact of thewalking school buswith an agent-based model," American Journal of Public Health, American Public Health Association, vol. 104(7), pages 1196-1203.
    7. Jonathan Pearson-Stuttard & Chris Kypridemos & Brendan Collins & Dariush Mozaffarian & Yue Huang & Piotr Bandosz & Simon Capewell & Laurie Whitsel & Parke Wilde & Martin O’Flaherty & Renata Micha, 2018. "Estimating the health and economic effects of the proposed US Food and Drug Administration voluntary sodium reformulation: Microsimulation cost-effectiveness analysis," PLOS Medicine, Public Library of Science, vol. 15(4), pages 1-18, April.
    8. Law, Cherry & Cornelsen, Laura & Adams, Jean & Penney, Tarra & Rutter, Harry & White, Martin & Smith, Richard, 2020. "An analysis of the stock market reaction to the announcements of the UK Soft Drinks Industry Levy," Economics & Human Biology, Elsevier, vol. 38(C).
    9. Tobias, M.I. & Cavana, R.Y. & Bloomfield, A., 2010. "Application of a system dynamics model to inform investment in smoking cessation services in New Zealand," American Journal of Public Health, American Public Health Association, vol. 100(7), pages 1274-1281.
    10. Theodore Anthony York & Alan Colin Brent & Josephine Kaviti Musango & Imke Hanlu de Kock, 2017. "Infrastructure implications of a green economy transition in the Western Cape Province of South Africa: A system dynamics modelling approach," Development Southern Africa, Taylor & Francis Journals, vol. 34(5), pages 529-547, September.
    11. Hassmiller Lich, Kristen & Urban, Jennifer Brown & Frerichs, Leah & Dave, Gaurav, 2017. "Extending systems thinking in planning and evaluation using group concept mapping and system dynamics to tackle complex problems," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 254-264.
    12. Gates, Emily F., 2016. "Making sense of the emerging conversation in evaluation about systems thinking and complexity science," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 62-73.
    13. Walton, Mat, 2014. "Applying complexity theory: A review to inform evaluation design," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 119-126.
    14. Jalali, Mohammad S. & Rahmandad, Hazhir & Bullock, Sally Lawrence & Lee-Kwan, Seung Hee & Gittelsohn, Joel & Ammerman, Alice, 2019. "Dynamics of intervention adoption, implementation, and maintenance inside organizations: The case of an obesity prevention initiative," Social Science & Medicine, Elsevier, vol. 224(C), pages 67-76.
    15. Law, Cherry & Cornelsen, Laura & Adams, Jean & Pell, David & Rutter, Harry & White, Martin & Smith, Richard, 2020. "The impact of UK soft drinks industry levy on manufacturers’ domestic turnover," Economics & Human Biology, Elsevier, vol. 37(C).
    16. Luke, D.A. & Hammond, R.A. & Combs, T. & Sorg, A. & Kasman, M. & MacK-Crane, A. & Ribisl, K.M. & Henriksen, L., 2017. "Tobacco town: Computational modeling of policy options to reduce tobacco retailer density," American Journal of Public Health, American Public Health Association, vol. 107(5), pages 740-746.
    17. Nipaporn Urwannachotima & Piya Hanvoravongchai & John Pastor Ansah, 2019. "Sugar‐sweetened Beverage Tax and Potential Impact on Dental Caries in Thai Adults: An Evaluation Using the Group Model Building Approach," Systems Research and Behavioral Science, Wiley Blackwell, vol. 36(1), pages 87-99, February.
    18. Hirsch, G. & Homer, J. & Evans, E. & Zielinski, A., 2010. "A system dynamics model for planning cardiovascular disease interventions," American Journal of Public Health, American Public Health Association, vol. 100(4), pages 616-622.
    19. Zhang, D. & Giabbanelli, P.J. & Arah, O.A. & Zimmerman, F.J., 2014. "Impact of different policies on unhealthy dietary behaviors in an urban adult population: An agent-based simulation model," American Journal of Public Health, American Public Health Association, vol. 104(7), pages 1217-1222.
    20. Peter Scarborough & Vyas Adhikari & Richard A Harrington & Ahmed Elhussein & Adam Briggs & Mike Rayner & Jean Adams & Steven Cummins & Tarra Penney & Martin White, 2020. "Impact of the announcement and implementation of the UK Soft Drinks Industry Levy on sugar content, price, product size and number of available soft drinks in the UK, 2015-19: A controlled interrupted," PLOS Medicine, Public Library of Science, vol. 17(2), pages 1-19, February.
    21. Keumseok Koh & Rebecca Reno & Ayaz Hyder, 2019. "Examining disparities in food accessibility among households in Columbus, Ohio: an agent-based model," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 11(2), pages 317-331, April.
    22. Kowalczyk, Shelly & Randolph, Suzanne & Stokes, Shereitte & Winston, Stefanie, 2015. "Evidence from the field: Findings on issues related to planning, implementing and evaluating gender-based programs," Evaluation and Program Planning, Elsevier, vol. 51(C), pages 35-44.
    23. Ana Claudia Figueiro & Sydia Rosana Oliveira & Zulmira Hartz & Yves Couturier & Jocelyne Bernier & Maria Freire & Isabella Samico & Maria Guadalupe Medina & Ronice Franco Sa & Louise Potvin, 2017. "A tool for exploring the dynamics of innovative interventions for public health: the critical event card," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 62(2), pages 177-186, March.
    24. Roux, A.V.D., 2011. "Complex systems thinking and current impasses in health disparities research," American Journal of Public Health, American Public Health Association, vol. 101(9), pages 1627-1634.
    25. Miguel Angel Fuentes & Juan Pablo Cárdenas & Natalia Carro & Mariana Lozada, 2018. "Development and Complex Dynamics at School Environment," Complexity, Hindawi, vol. 2018, pages 1-10, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anna Brugulat-Panés & Lee Randall & Thiago Hérick de Sá & Megha Anil & Haowen Kwan & Lambed Tatah & James Woodcock & Ian R. Hambleton & Ebele R. I. Mogo & Lisa Micklesfield & Caitlin Pley & Ishtar Gov, 2023. "The Potential for Healthy, Sustainable, and Equitable Transport Systems in Africa and the Caribbean: A Mixed-Methods Systematic Review and Meta-Study," Sustainability, MDPI, vol. 15(6), pages 1-27, March.
    2. Lea Simms & Katherine E. Ottman & James L. Griffith & Michael G. Knight & Lorenzo Norris & Viktoriya Karakcheyeva & Brandon A. Kohrt, 2023. "Psychosocial Peer Support to Address Mental Health and Burnout of Health Care Workers Affected by COVID-19: A Qualitative Evaluation," IJERPH, MDPI, vol. 20(5), pages 1-18, March.
    3. Hosseinichimeh, Niyousha & MacDonald, Rod & Li, Kaigang & Fell, James C. & Haynie, Denise L. & Simons-Morton, Bruce & Banz, Barbara C. & Camenga, Deepa R. & Iannotti, Ronald J. & Curry, Leslie A. & Dz, 2022. "Mapping the complex causal mechanisms of drinking and driving behaviors among adolescents and young adults," Social Science & Medicine, Elsevier, vol. 296(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Penny R. Breeze & Hazel Squires & Kate Ennis & Petra Meier & Kate Hayes & Nik Lomax & Alan Shiell & Frank Kee & Frank de Vocht & Martin O’Flaherty & Nigel Gilbert & Robin Purshouse & Stewart Robinson , 2023. "Guidance on the use of complex systems models for economic evaluations of public health interventions," Health Economics, John Wiley & Sons, Ltd., vol. 32(7), pages 1603-1625, July.
    2. Stankov, Ivana & Useche, Andres Felipe & Meisel, Jose D. & Montes, Felipe & Morais, Lidia MO. & Friche, Amelia AL. & Langellier, Brent A. & Hovmand, Peter & Sarmiento, Olga Lucia & Hammond, Ross A. & , 2021. "From causal loop diagrams to future scenarios: Using the cross-impact balance method to augment understanding of urban health in Latin America," Social Science & Medicine, Elsevier, vol. 282(C).
    3. Negar Darabi & Niyousha Hosseinichimeh, 2020. "System dynamics modeling in health and medicine: a systematic literature review," System Dynamics Review, System Dynamics Society, vol. 36(1), pages 29-73, January.
    4. Jason M. Orr & Jonathon P. Leider & Margaret J. Gutilla, 2023. "System approaches in governmental public health: Findings from an analysis of the literature," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(1), pages 159-169, January.
    5. Judite Gonçalves & Roxanne Merenda & João Pereira dos Santos, 2024. "Not so sweet: impacts of a soda tax on producers," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 31(5), pages 1388-1412, October.
    6. John Pastor Ansah & Shawn Tan Yi Wei & Tessa Lui Shi Min, 2020. "An evaluation of the impact of aggressive diabetes and hypertension management on chronic kidney diseases at the population level: a simulation analysis," System Dynamics Review, System Dynamics Society, vol. 36(4), pages 497-522, October.
    7. Chang, Angela Y. & Ogbuoji, Osondu & Atun, Rifat & Verguet, Stéphane, 2017. "Dynamic modeling approaches to characterize the functioning of health systems: A systematic review of the literature," Social Science & Medicine, Elsevier, vol. 194(C), pages 160-167.
    8. Goncalves, Judite & Merenda, Roxanne & Pereira dos Santos, João, 2023. "Not So Sweet: Impacts of a Soda Tax on Producers," IZA Discussion Papers 15968, Institute of Labor Economics (IZA).
    9. Cunico, Giovanni & Aivazidou, Eirini & Mollona, Edoardo, 2021. "Beyond financial proxies in Cohesion Policy inputs’ monitoring: A system dynamics approach," Evaluation and Program Planning, Elsevier, vol. 89(C).
    10. Fanzo, Jessica & McLaren, Rebecca & Bellows, Alexandra & Carducci, Bianca, 2023. "Challenges and opportunities for increasing the effectiveness of food reformulation and fortification to improve dietary and nutrition outcomes," Food Policy, Elsevier, vol. 119(C).
    11. Yu Chen & Chen Zhen, 2022. "The potential impact of reducing sodium in packaged food: The case of the Chinese instant noodles market," Agribusiness, John Wiley & Sons, Ltd., vol. 38(1), pages 3-20, January.
    12. Newton-Levinson, Anna & Higdon, Megan & Sales, Jessica & Gaydos, Laurie & Rochat, Roger, 2020. "Context matters: Using mixed methods timelines to provide an accessible and integrated visual for complex program evaluation data," Evaluation and Program Planning, Elsevier, vol. 80(C).
    13. Bolte, Gabriele, 2018. "Epidemiologische Methoden und Erkenntnisse als eine Grundlage für Stadtplanung und gesundheitsfördernde Stadtentwicklung," Forschungsberichte der ARL: Aufsätze, in: Baumgart, Sabine & Köckler, Heike & Ritzinger, Anne & Rüdiger, Andrea (ed.), Planung für gesundheitsfördernde Städte, volume 8, pages 118-134, ARL – Akademie für Raumentwicklung in der Leibniz-Gemeinschaft.
    14. Michael Essman & Lindsey Smith Taillie & Tamryn Frank & Shu Wen Ng & Barry M Popkin & Elizabeth C Swart, 2021. "Taxed and untaxed beverage intake by South African young adults after a national sugar-sweetened beverage tax: A before-and-after study," PLOS Medicine, Public Library of Science, vol. 18(5), pages 1-17, May.
    15. Staudigel, Matthias & Anders, Sven, 2020. "Effects of the FDA's sodium reduction strategy in the U.S. market for chip products," Journal of Economic Behavior & Organization, Elsevier, vol. 173(C), pages 216-238.
    16. Le Bodo, Yann & Etilé, Fabrice & Julia, Chantal & Friant-Perrot, Marine & Breton, Eric & Lecocq, Sébastien & Boizot-Szantai, Christine & Bergeran, Céline & Jabot, Françoise, 2022. "Public health lessons from the French 2012 soda tax and insights on the modifications enacted in 2018," Health Policy, Elsevier, vol. 126(7), pages 585-591.
    17. Sarah Chapman & Adiilah Boodhoo & Carren Duffy & Suki Goodman & Maria Michalopoulou, 2023. "Theory of Change in Complex Research for Development Programmes: Challenges and Solutions from the Global Challenges Research Fund," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 35(2), pages 298-322, April.
    18. Wang, Ning & Tang, Linhao & Zhang, Wenjian & Guo, Jiahui, 2019. "How to face the challenges caused by the abolishment of subsidies for electric vehicles in China?," Energy, Elsevier, vol. 166(C), pages 359-372.
    19. Liu, Huan & Tatano, Hirokazu & Pflug, Georg & Hochrainer-Stigler, Stefan, 2021. "Post-disaster recovery in industrial sectors: A Markov process analysis of multiple lifeline disruptions," Reliability Engineering and System Safety, Elsevier, vol. 206(C).
    20. Rochelle Tobin & Gemma Crawford & Jonathan Hallett & Bruce Richard Maycock & Roanna Lobo, 2022. "Critical factors that affect the functioning of a research and evaluation capacity building partnership: A causal loop diagram," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-22, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:socmed:v:272:y:2021:i:c:s0277953621000290. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/315/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.