IDEAS home Printed from https://ideas.repec.org/a/sae/medema/v43y2023i1p125-138.html
   My bibliography  Save this article

Analytical Frameworks and Outcome Measures in Economic Evaluations of Digital Health Interventions: A Methodological Systematic Review

Author

Listed:
  • Valerio Benedetto

    (Synthesis, Economic Evaluation and Decision Science (SEEDS) Group, Health Technology Assessment (HTA) Unit, Applied Health Research hub, University of Central Lancashire, Preston, Lancashire, UK
    Methodological Innovation, Development, Adaptation and Support (MIDAS) Theme, National Institute for Health and Care Research Applied Research Collaboration North West Coast (NIHR ARC NWC), Liverpool, Merseyside, UK)

  • Luís Filipe

    (Methodological Innovation, Development, Adaptation and Support (MIDAS) Theme, National Institute for Health and Care Research Applied Research Collaboration North West Coast (NIHR ARC NWC), Liverpool, Merseyside, UK
    Department of Health Research, Faculty of Health & Medicine, Lancaster University, Lancaster, Lancashire, UK)

  • Catherine Harris

    (Synthesis, Economic Evaluation and Decision Science (SEEDS) Group, Health Technology Assessment (HTA) Unit, Applied Health Research hub, University of Central Lancashire, Preston, Lancashire, UK
    Methodological Innovation, Development, Adaptation and Support (MIDAS) Theme, National Institute for Health and Care Research Applied Research Collaboration North West Coast (NIHR ARC NWC), Liverpool, Merseyside, UK)

  • Joseph Spencer

    (Methodological Innovation, Development, Adaptation and Support (MIDAS) Theme, National Institute for Health and Care Research Applied Research Collaboration North West Coast (NIHR ARC NWC), Liverpool, Merseyside, UK
    Research Facilitation and Delivery Unit (RFDU), Applied Health Research hub, University of Central Lancashire, Preston, Lancashire, UK)

  • Carmel Hickson

    (Public Advisers’ Forum, National Institute for Health and Care Research Applied Research Collaboration North West Coast (NIHR ARC NWC), Liverpool, Merseyside, UK)

  • Andrew Clegg

    (Synthesis, Economic Evaluation and Decision Science (SEEDS) Group, Health Technology Assessment (HTA) Unit, Applied Health Research hub, University of Central Lancashire, Preston, Lancashire, UK
    Methodological Innovation, Development, Adaptation and Support (MIDAS) Theme, National Institute for Health and Care Research Applied Research Collaboration North West Coast (NIHR ARC NWC), Liverpool, Merseyside, UK)

Abstract

Background Digital health interventions (DHIs) can improve the provision of health care services. To fully account for their effects in economic evaluations, traditional methods based on measuring health-related quality of life may not be appropriate, as nonhealth and process outcomes are likely to be relevant too. Purpose This systematic review identifies, assesses, and synthesizes the arguments on the analytical frameworks and outcome measures used in the economic evaluations of DHIs. The results informed recommendations for future economic evaluations. Data Sources We ran searches on multiple databases, complemented by gray literature and backward and forward citation searches. Study Selection We included records containing theoretical and empirical arguments associated with the use of analytical frameworks and outcome measures for economic evaluations of DHIs. Following title/abstract and full-text screening, our final analysis included 15 studies. Data Extraction The arguments we extracted related to analytical frameworks (14 studies), generic outcome measures (5 studies), techniques used to elicit utility values (3 studies), and disease-specific outcome measures and instruments to collect health states data (both from 2 studies). Data Synthesis Rather than assessing the quality of the studies, we critically assessed and synthesized the extracted arguments. Building on this synthesis, we developed a 3-stage set of recommendations in which we encourage the use of impact matrices and analyses of equity impacts to integrate traditional economic evaluation methods. Limitations Our review and recommendations explored but not fully covered other potentially important aspects of economic evaluations that were outside our scope. Conclusions This is the first systematic review that summarizes the arguments on how the effects of DHIs could be measured in economic evaluations. Our recommendations will help design future economic evaluations. Highlights Using traditional outcome measures based on health-related quality of life (such as the quality-adjusted life-year) may not be appropriate in economic evaluations of digital health interventions, which are likely to trigger nonhealth and process outcomes. This is the first systematic review to investigate how the effects of digital health interventions could be measured in economic evaluations. We extracted and synthesized different arguments from the literature, outlining advantages and disadvantages associated with different methods used to measure the effects of digital health interventions. We propose a methodological set of recommendations in which 1) we suggest that researchers consider the use of impact matrices and cost-consequence analysis, 2) we discuss the suitability of analytical frameworks and outcome measures available in economic evaluations, and 3) we highlight the need for analyses of equity impacts.

Suggested Citation

  • Valerio Benedetto & Luís Filipe & Catherine Harris & Joseph Spencer & Carmel Hickson & Andrew Clegg, 2023. "Analytical Frameworks and Outcome Measures in Economic Evaluations of Digital Health Interventions: A Methodological Systematic Review," Medical Decision Making, , vol. 43(1), pages 125-138, January.
  • Handle: RePEc:sae:medema:v:43:y:2023:i:1:p:125-138
    DOI: 10.1177/0272989X221132741
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0272989X221132741
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0272989X221132741?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    2. Floyd J. Fowler JR. & Paul D. Cleary & Michael P. Massagli & Joel Weissman & Arnold Epstein, 1995. "The Role of Reluctance to Give Up life in the Measurement of the Values of Health states," Medical Decision Making, , vol. 15(3), pages 195-200, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. İlkay Unay-Gailhard & Mark A. Brennen, 2022. "How digital communications contribute to shaping the career paths of youth: a review study focused on farming as a career option," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 39(4), pages 1491-1508, December.
    2. Mahin Ghafari & Vali Baigi & Zahra Cheraghi & Amin Doosti-Irani, 2016. "The Prevalence of Asymptomatic Bacteriuria in Iranian Pregnant Women: A Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-10, June.
    3. Santos Urbina & Sofía Villatoro & Jesús Salinas, 2021. "Self-Regulated Learning and Technology-Enhanced Learning Environments in Higher Education: A Scoping Review," Sustainability, MDPI, vol. 13(13), pages 1-12, June.
    4. Nadine Desrochers & Adèle Paul‐Hus & Jen Pecoskie, 2017. "Five decades of gratitude: A meta‐synthesis of acknowledgments research," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(12), pages 2821-2833, December.
    5. Maryono, Maryono & Killoes, Aditya Marendra & Adhikari, Rajendra & Abdul Aziz, Ammar, 2024. "Agriculture development through multi-stakeholder partnerships in developing countries: A systematic literature review," Agricultural Systems, Elsevier, vol. 213(C).
    6. Alene Sze Jing Yong & Yi Heng Lim & Mark Wing Loong Cheong & Ednin Hamzah & Siew Li Teoh, 2022. "Willingness-to-pay for cancer treatment and outcome: a systematic review," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(6), pages 1037-1057, August.
    7. Agnieszka A. Tubis & Katarzyna Grzybowska, 2022. "In Search of Industry 4.0 and Logistics 4.0 in Small-Medium Enterprises—A State of the Art Review," Energies, MDPI, vol. 15(22), pages 1-26, November.
    8. García-Poole, Chloe & Byrne, Sonia & Rodrigo, María José, 2019. "How do communities intervene with adolescents at psychosocial risk? A systematic review of positive development programs," Children and Youth Services Review, Elsevier, vol. 99(C), pages 194-209.
    9. Qing Ye & Bao-Xin Qian & Wei-Li Yin & Feng-Mei Wang & Tao Han, 2016. "Association between the HFE C282Y, H63D Polymorphisms and the Risks of Non-Alcoholic Fatty Liver Disease, Liver Cirrhosis and Hepatocellular Carcinoma: An Updated Systematic Review and Meta-Analysis o," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-17, September.
    10. Bishal Mohindru & David Turner & Tracey Sach & Diana Bilton & Siobhan Carr & Olga Archangelidi & Arjun Bhadhuri & Jennifer A. Whitty, 2020. "Health State Utility Data in Cystic Fibrosis: A Systematic Review," PharmacoEconomics - Open, Springer, vol. 4(1), pages 13-25, March.
    11. Neal R. Haddaway & Matthew J. Page & Chris C. Pritchard & Luke A. McGuinness, 2022. "PRISMA2020: An R package and Shiny app for producing PRISMA 2020‐compliant flow diagrams, with interactivity for optimised digital transparency and Open Synthesis," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(2), June.
    12. Ding Zhu & Mindan Wu & Yuan Cao & Shihua Lin & Nanxia Xuan & Chen Zhu & Wen Li & Huahao Shen, 2018. "Heated humidification did not improve compliance of positive airway pressure and subjective daytime sleepiness in obstructive sleep apnea syndrome: A meta-analysis," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-16, December.
    13. Pelai, Ricardo & Hagerman, Shannon M. & Kozak, Robert, 2020. "Biotechnologies in agriculture and forestry: Governance insights from a comparative systematic review of barriers and recommendations," Forest Policy and Economics, Elsevier, vol. 117(C).
    14. Wesam Salah Alaloul & Muhammad Altaf & Muhammad Ali Musarat & Muhammad Faisal Javed & Amir Mosavi, 2021. "Systematic Review of Life Cycle Assessment and Life Cycle Cost Analysis for Pavement and a Case Study," Sustainability, MDPI, vol. 13(8), pages 1-38, April.
    15. Claudia Peters & Agnessa Kozak & Albert Nienhaus & Anja Schablon, 2020. "Risk of Occupational Latent Tuberculosis Infection among Health Personnel Measured by Interferon-Gamma Release Assays in Low Incidence Countries—A Systematic Review and Meta-Analysis," IJERPH, MDPI, vol. 17(2), pages 1-16, January.
    16. Sehee Kim & Mihyeon Park & Sukhee Ahn, 2022. "The Impact of Antepartum Depression and Postpartum Depression on Exclusive Breastfeeding: A Systematic Review and Meta-Analysis," Clinical Nursing Research, , vol. 31(5), pages 866-880, June.
    17. Habarurema Jean Baptiste & Yan Guang Cai & A. Y. M. Atiquil Islam & Nzabalirwa Wenceslas, 2022. "A Systematic Review of University Social Responsibility in Post-Conflict Societies: The Case of the Great Lakes Region of East Africa," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 164(1), pages 439-475, November.
    18. Yafei Shen & Weide Shao, 2022. "Influence of Hybrid Pedagogical Models on Learning Outcomes in Physical Education: A Systematic Literature Review," IJERPH, MDPI, vol. 19(15), pages 1-16, August.
    19. Nicola Andreij Rieg & Birgitta Gatersleben & Ian Christie, 2021. "Organizational Change Management for Sustainability in Higher Education Institutions: A Systematic Quantitative Literature Review," Sustainability, MDPI, vol. 13(13), pages 1-18, June.
    20. Alessandro Concari & Gerjo Kok & Pim Martens, 2020. "A Systematic Literature Review of Concepts and Factors Related to Pro-Environmental Consumer Behaviour in Relation to Waste Management Through an Interdisciplinary Approach," Sustainability, MDPI, vol. 12(11), pages 1-50, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:medema:v:43:y:2023:i:1:p:125-138. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.