IDEAS home Printed from https://ideas.repec.org/a/spr/pharme/v38y2020i3d10.1007_s40273-019-00878-2.html
   My bibliography  Save this article

Challenges of Systematic Reviews of Economic Evaluations: A Review of Recent Reviews and an Obesity Case Study

Author

Listed:
  • Elisabet Jacobsen

    (University of Aberdeen)

  • Dwayne Boyers

    (University of Aberdeen)

  • Alison Avenell

    (University of Aberdeen)

Abstract

Decision makers increasingly require cost-effectiveness evidence to inform resource allocation and the need for systematic reviews of economic evaluations (SREEs) has grown accordingly. The objective of this article is to describe current practice and identify unique challenges in conducting and reporting SREEs. Current guideline documents for SREEs were consulted and summarised. A rapid review of English-language SREEs, using MEDLINE and EMBASE, published in 2017/2018, containing at least 20 studies was undertaken to describe current practice. Information on data extraction methods, quality assessment (QA) tools and reporting methods were narratively summarised. Lessons learned from a recently conducted SREE of weight loss interventions for severely obese adults were discussed. Sixty-three publications were included in the rapid review. Substantial heterogeneity in review methods, reporting standards and QA approaches was evident. Our recently conducted SREE on weight loss interventions identified scope to improve process efficiency, opportunity for more transparent and succinct reporting, and potential to improve consistency of QA. Practical solutions may include (1) using pre-piloted data extraction forms linked explicitly to results tables; (2) consistently reporting on key assumptions and sensitivity analyses that drive results; and (3) using checklists that include topic-specific items where relevant and allow reviewers to distinguish between reporting, justification and QA. The lack of a mutually agreed, standardised set of best practice guidelines has led to substantial heterogeneity in the conduct and reporting of SREEs. Future work is required to standardise the approach to conducting SREEs so that they can generate efficient, timely and relevant evidence to support decision-making. We suggest only data extracting information that will be reported, focusing discussion around the key drivers of cost-effectiveness, and improving consistency in QA by distinguishing between what is reported, justified by authors and deemed appropriate by the reviewer.

Suggested Citation

  • Elisabet Jacobsen & Dwayne Boyers & Alison Avenell, 2020. "Challenges of Systematic Reviews of Economic Evaluations: A Review of Recent Reviews and an Obesity Case Study," PharmacoEconomics, Springer, vol. 38(3), pages 259-267, March.
    • Handle: RePEc:spr:pharme:v:38:y:2020:i:3:d:10.1007_s40273-019-00878-2
    DOI: 10.1007/s40273-019-00878-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40273-019-00878-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40273-019-00878-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Don Husereau & Michael Drummond & Stavros Petrou & Chris Carswell & David Moher & Dan Greenberg & Federico Augustovski & Andrew Briggs & Josephine Mauskopf & Elizabeth Loder, 2013. "Consolidated Health Economic Evaluation Reporting Standards (CHEERS) Statement," PharmacoEconomics, Springer, vol. 31(5), pages 361-367, May.
    2. Stephanie Boulenger & John Nixon & Michael Drummond & Philippe Ulmann & Stephen Rice & Gerard Pouvourville, 2005. "Can economic evaluations be made more transferable?," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 6(4), pages 334-346, December.
    3. Rob Anderson, 2010. "Systematic reviews of economic evaluations: utility or futility?," Health Economics, John Wiley & Sons, Ltd., vol. 19(3), pages 350-364, March.
    4. John Nixon & Stephen Rice & Michael Drummond & Stephanie Boulenger & Philippe Ulmann & Gerard Pouvourville, 2009. "Guidelines for completing the EURONHEED transferability information checklists," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 10(2), pages 157-165, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fernando Antoñanzas & Roberto Rodríguez-Ibeas & Carmelo Juárez-Castelló, 2012. "Coping with uncertainty on health decisions: assessing new solutions," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 13(4), pages 375-378, August.
    2. Tim Mathes & Maren Walgenbach & Sunya-Lee Antoine & Dawid Pieper & Michaela Eikermann, 2014. "Methods for Systematic Reviews of Health Economic Evaluations," Medical Decision Making, , vol. 34(7), pages 826-840, October.
    3. Edward Burn & Alexander D. Liddle & Thomas W. Hamilton & Sunil Pai & Hemant G. Pandit & David W. Murray & Rafael Pinedo-Villanueva, 2017. "Choosing Between Unicompartmental and Total Knee Replacement: What Can Economic Evaluations Tell Us? A Systematic Review," PharmacoEconomics - Open, Springer, vol. 1(4), pages 241-253, December.
    4. Pepijn Vemer & Maureen Rutten-van Mölken, 2011. "Largely ignored: the impact of the threshold value for a QALY on the importance of a transferability factor," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 12(5), pages 397-404, October.
    5. Federico Augustovski & Cynthia Iglesias & Andrea Manca & Michael Drummond & Adolfo Rubinstein & Sebastián Martií, 2009. "Barriers to Generalizability of Health Economic Evaluations in Latin America and the Caribbean Region," PharmacoEconomics, Springer, vol. 27(11), pages 919-929, November.
    6. Valentin Brodszky & Zsuzsanna Beretzky & Petra Baji & Fanni Rencz & Márta Péntek & Alexandru Rotar & Konstantin Tachkov & Susanne Mayer & Judit Simon & Maciej Niewada & Rok Hren & László Gulácsi, 2019. "Cost-of-illness studies in nine Central and Eastern European countries," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(1), pages 155-172, June.
    7. Saha, Sanjib & Gerdtham, Ulf-G. & Toresson, Håkan & Minthon, Lennart & Jarl, Johan, 2018. "Economic Evaluation of Interventions for Screening of Dementia," Working Papers 2018:20, Lund University, Department of Economics.
    8. Najmiatul Fitria & Antoinette D. I. Asselt & Maarten J. Postma, 2019. "Cost-effectiveness of controlling gestational diabetes mellitus: a systematic review," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(3), pages 407-417, April.
    9. Qi Cao & Erik Buskens & Hans L. Hillege & Tiny Jaarsma & Maarten Postma & Douwe Postmus, 2019. "Stratified treatment recommendation or one-size-fits-all? A health economic insight based on graphical exploration," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(3), pages 475-482, April.
    10. Thomas Grochtdreis & Hans-Helmut König & Alexander Dobruschkin & Gunhild von Amsberg & Judith Dams, 2018. "Cost-effectiveness analyses and cost analyses in castration-resistant prostate cancer: A systematic review," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-25, December.
    11. Sanjib Saha & Ulf-G Gerdtham & Pia Johansson, 2010. "Economic Evaluation of Lifestyle Interventions for Preventing Diabetes and Cardiovascular Diseases," IJERPH, MDPI, vol. 7(8), pages 1-46, August.
    12. László Gulácsi & Fanni Rencz & Márta Péntek & Valentin Brodszky & Ruth Lopert & Noémi Hevér & Petra Baji, 2014. "Transferability of results of cost utility analyses for biologicals in inflammatory conditions for Central and Eastern European countries," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 15(1), pages 27-34, May.
    13. László Gulácsi, 2007. "The time for cost-effectiveness in the new European Union member states: the development and role of health economics and technology assessment in the mirror of the Hungarian experience," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 8(2), pages 83-88, June.
    14. Saha, Sanjib & Gerdtham, Ulf-G. & Toresson, Håkan & Minthon, Lennart & Jarl, Johan, 2018. "Economic Evaluation of Nonpharmacological Interventions for Dementia Patients and their Caregivers - A Systematic Literature Review," Working Papers 2018:10, Lund University, Department of Economics.
    15. Jesse Elliott & Sasha Katwyk & Bláthnaid McCoy & Tammy Clifford & Beth K. Potter & Becky Skidmore & George A. Wells & Doug Coyle, 2019. "Decision Models for Assessing the Cost Effectiveness of Treatments for Pediatric Drug-Resistant Epilepsy: A Systematic Review of Economic Evaluations," PharmacoEconomics, Springer, vol. 37(10), pages 1261-1276, October.
    16. Don Husereau & Michael Drummond & Stavros Petrou & Dan Greenberg & Josephine Mauskopf & Federico Augustovski & Andrew Briggs & David Moher & Elizabeth Loder & Chris Carswell, 2015. "Reply to Roberts et al.: CHEERS is Sufficient for Reporting Cost-Benefit Analysis, but May Require Further Elaboration," PharmacoEconomics, Springer, vol. 33(5), pages 535-536, May.
    17. Neily Zakiyah & Antoinette D I van Asselt & Frank Roijmans & Maarten J Postma, 2016. "Economic Evaluation of Family Planning Interventions in Low and Middle Income Countries; A Systematic Review," PLOS ONE, Public Library of Science, vol. 11(12), pages 1-19, December.
    18. Kathryn Schnippel & Naomi Lince-Deroche & Theo van den Handel & Seithati Molefi & Suann Bruce & Cynthia Firnhaber, 2015. "Cost Evaluation of Reproductive and Primary Health Care Mobile Service Delivery for Women in Two Rural Districts in South Africa," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-13, March.
    19. Rachel Elliott & Koen Putman & James Davies & Lieven Annemans, 2014. "A Review of the Methodological Challenges in Assessing the Cost Effectiveness of Pharmacist Interventions," PharmacoEconomics, Springer, vol. 32(12), pages 1185-1199, December.
    20. Abualbishr Alshreef & Michelle Jenks & William Green & Simon Dixon, 2016. "Review of Economic Submissions to NICE Medical Technologies Evaluation Programme," Applied Health Economics and Health Policy, Springer, vol. 14(6), pages 623-634, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:pharme:v:38:y:2020:i:3:d:10.1007_s40273-019-00878-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.