IDEAS home Printed from https://ideas.repec.org/a/spr/pharme/v34y2016i9d10.1007_s40273-016-0410-3.html
   My bibliography  Save this article

Unremarked or Unperformed? Systematic Review on Reporting of Validation Efforts of Health Economic Decision Models in Seasonal Influenza and Early Breast Cancer

Author

Listed:
  • Pieter T. Boer

    (University of Groningen)

  • Geert W. J. Frederix

    (University of Utrecht)

  • Talitha L. Feenstra

    (University of Groningen
    National Institute for Public Health and the Environment (RIVM))

  • Pepijn Vemer

    (University of Groningen
    University of Groningen)

Abstract

Background Transparent reporting of validation efforts of health economic models give stakeholders better insight into the credibility of model outcomes. In this study we reviewed recently published studies on seasonal influenza and early breast cancer in order to gain insight into the reporting of model validation efforts in the overall health economic literature. Methods A literature search was performed in Pubmed and Embase to retrieve health economic modelling studies published between 2008 and 2014. Reporting on model validation was evaluated by checking for the word validation, and by using AdViSHE (Assessment of the Validation Status of Health Economic decision models), a tool containing a structured list of relevant items for validation. Additionally, we contacted corresponding authors to ask whether more validation efforts were performed other than those reported in the manuscripts. Results A total of 53 studies on seasonal influenza and 41 studies on early breast cancer were included in our review. The word validation was used in 16 studies (30 %) on seasonal influenza and 23 studies (56 %) on early breast cancer; however, in a minority of studies, this referred to a model validation technique. Fifty-seven percent of seasonal influenza studies and 71 % of early breast cancer studies reported one or more validation techniques. Cross-validation of study outcomes was found most often. A limited number of studies reported on model validation efforts, although good examples were identified. Author comments indicated that more validation techniques were performed than those reported in the manuscripts. Conclusions Although validation is deemed important by many researchers, this is not reflected in the reporting habits of health economic modelling studies. Systematic reporting of validation efforts would be desirable to further enhance decision makers’ confidence in health economic models and their outcomes.

Suggested Citation

  • Pieter T. Boer & Geert W. J. Frederix & Talitha L. Feenstra & Pepijn Vemer, 2016. "Unremarked or Unperformed? Systematic Review on Reporting of Validation Efforts of Health Economic Decision Models in Seasonal Influenza and Early Breast Cancer," PharmacoEconomics, Springer, vol. 34(9), pages 833-845, September.
  • Handle: RePEc:spr:pharme:v:34:y:2016:i:9:d:10.1007_s40273-016-0410-3
    DOI: 10.1007/s40273-016-0410-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40273-016-0410-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s40273-016-0410-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Don Husereau & Michael Drummond & Stavros Petrou & Chris Carswell & David Moher & Dan Greenberg & Federico Augustovski & Andrew Briggs & Josephine Mauskopf & Elizabeth Loder, 2013. "Consolidated Health Economic Evaluation Reporting Standards (CHEERS) Statement," PharmacoEconomics, Springer, vol. 31(5), pages 361-367, May.
    2. Neyt, Mattias & Huybrechts, Michel & Hulstaert, Frank & Vrijens, France & Ramaekers, Dirk, 2008. "Trastuzumab in early stage breast cancer: A cost-effectiveness analysis for Belgium," Health Policy, Elsevier, vol. 87(2), pages 146-159, August.
    3. Cash, David & Clark, William & Alcock, Frank & Dickson, Nancy & Eckley, Noelle & Jager, Jill, 2002. "Salience, Credibility, Legitimacy and Boundaries: Linking Research, Assessment and Decision Making," Working Paper Series rwp02-046, Harvard University, John F. Kennedy School of Government.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jonathan Karnon, 2016. "Model Validation: Has it’s Time Come?," PharmacoEconomics, Springer, vol. 34(9), pages 829-831, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giovanna Elisa Calabrò & Sara Boccalini & Donatella Panatto & Caterina Rizzo & Maria Luisa Di Pietro & Fasika Molla Abreha & Marco Ajelli & Daniela Amicizia & Angela Bechini & Irene Giacchetta & Piero, 2022. "The New Quadrivalent Adjuvanted Influenza Vaccine for the Italian Elderly: A Health Technology Assessment," IJERPH, MDPI, vol. 19(7), pages 1-14, March.
    2. Saha, Sanjib & Gerdtham, Ulf-G. & Toresson, Håkan & Minthon, Lennart & Jarl, Johan, 2018. "Economic Evaluation of Interventions for Screening of Dementia," Working Papers 2018:20, Lund University, Department of Economics.
    3. Keith B. Matthews & Ansel Renner & Kirsty L. Blackstock & Kerry A. Waylen & Dave G. Miller & Doug H. Wardell-Johnson & Alba Juarez-Bourke & Juan Cadillo-Benalcazar & Joep F. Schyns & Mario Giampietro, 2021. "Old Wine in New Bottles: Exploiting Data from the EU’s Farm Accountancy Data Network for Pan-EU Sustainability Assessments of Agricultural Production Systems," Sustainability, MDPI, vol. 13(18), pages 1-26, September.
    4. Kristjanson, Patti & Reid, Robin & Dickson, Nancy & Clark, William C. & Vishnubhotla, Prasad & Romney, Dannie & Bezkorowajnyj, Peter & Said, Mohammed & Kaelo, Dickson & Makui, Ogeli & Nkedianye, David, 2008. "Linking International Agricultural Research Knowledge with Action for Sustainable Poverty Alleviation: What Works?," Working Paper Series rwp08-045, Harvard University, John F. Kennedy School of Government.
    5. Clarke, Lorcan, 2020. "An introduction to economic studies, health emergencies, and COVID-19," LSE Research Online Documents on Economics 105051, London School of Economics and Political Science, LSE Library.
    6. Najmiatul Fitria & Antoinette D. I. Asselt & Maarten J. Postma, 2019. "Cost-effectiveness of controlling gestational diabetes mellitus: a systematic review," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(3), pages 407-417, April.
    7. Qi Cao & Erik Buskens & Hans L. Hillege & Tiny Jaarsma & Maarten Postma & Douwe Postmus, 2019. "Stratified treatment recommendation or one-size-fits-all? A health economic insight based on graphical exploration," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(3), pages 475-482, April.
    8. Thomas Grochtdreis & Hans-Helmut König & Alexander Dobruschkin & Gunhild von Amsberg & Judith Dams, 2018. "Cost-effectiveness analyses and cost analyses in castration-resistant prostate cancer: A systematic review," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-25, December.
    9. Wendy Hens & Dirk Vissers & Nick Verhaeghe & Jan Gielen & Luc Van Gaal & Jan Taeymans, 2021. "Unsupervised Exercise Training Was Not Found to Improve the Metabolic Health or Phenotype over a 6-Month Dietary Intervention: A Randomised Controlled Trial with an Embedded Economic Analysis," IJERPH, MDPI, vol. 18(15), pages 1-13, July.
    10. Kim Edmunds & Penny Reeves & Paul Scuffham & Daniel A. Galvão & Robert U. Newton & Mark Jones & Nigel Spry & Dennis R. Taaffe & David Joseph & Suzanne K. Chambers & Haitham Tuffaha, 2020. "Cost-Effectiveness Analysis of Supervised Exercise Training in Men with Prostate Cancer Previously Treated with Radiation Therapy and Androgen-Deprivation Therapy," Applied Health Economics and Health Policy, Springer, vol. 18(5), pages 727-737, October.
    11. Andrew Gawron & Dustin French & John Pandolfino & Colin Howden, 2014. "Economic Evaluations of Gastroesophageal Reflux Disease Medical Management," PharmacoEconomics, Springer, vol. 32(8), pages 745-758, August.
    12. Saha, Sanjib & Gerdtham, Ulf-G. & Toresson, Håkan & Minthon, Lennart & Jarl, Johan, 2018. "Economic Evaluation of Nonpharmacological Interventions for Dementia Patients and their Caregivers - A Systematic Literature Review," Working Papers 2018:10, Lund University, Department of Economics.
    13. Frank G. Sandmann & Julie V. Robotham & Sarah R. Deeny & W. John Edmunds & Mark Jit, 2018. "Estimating the opportunity costs of bed‐days," Health Economics, John Wiley & Sons, Ltd., vol. 27(3), pages 592-605, March.
    14. Jesse Elliott & Sasha Katwyk & Bláthnaid McCoy & Tammy Clifford & Beth K. Potter & Becky Skidmore & George A. Wells & Doug Coyle, 2019. "Decision Models for Assessing the Cost Effectiveness of Treatments for Pediatric Drug-Resistant Epilepsy: A Systematic Review of Economic Evaluations," PharmacoEconomics, Springer, vol. 37(10), pages 1261-1276, October.
    15. Wei Zhang & Aslam Anis, 2014. "Health-Related Productivity Loss: NICE to Recognize Soon, Good to Discuss Now," PharmacoEconomics, Springer, vol. 32(5), pages 425-427, May.
    16. Katherine Edwards & Natasha Jones & Julia Newton & Charlie Foster & Andrew Judge & Kate Jackson & Nigel K. Arden & Rafael Pinedo-Villanueva, 2017. "The cost-effectiveness of exercise-based cardiac rehabilitation: a systematic review of the characteristics and methodological quality of published literature," Health Economics Review, Springer, vol. 7(1), pages 1-23, December.
    17. Don Husereau & Michael Drummond & Stavros Petrou & Dan Greenberg & Josephine Mauskopf & Federico Augustovski & Andrew Briggs & David Moher & Elizabeth Loder & Chris Carswell, 2015. "Reply to Roberts et al.: CHEERS is Sufficient for Reporting Cost-Benefit Analysis, but May Require Further Elaboration," PharmacoEconomics, Springer, vol. 33(5), pages 535-536, May.
    18. Nina van der Vliet & Anita W.M. Suijkerbuijk & Adriana T. de Blaeij & G. Ardine de Wit & Paul F. van Gils & Brigit A.M. Staatsen & Rob Maas & Johan J. Polder, 2020. "Ranking Preventive Interventions from Different Policy Domains: What Are the Most Cost-Effective Ways to Improve Public Health?," IJERPH, MDPI, vol. 17(6), pages 1-24, March.
    19. Simon van der Schans & Lucas M. A. Goossens & Melinde R. S. Boland & Janwillem W. H. Kocks & Maarten J. Postma & Job F. M. van Boven & Maureen P. M. H. Rutten-van Mölken, 2017. "Systematic Review and Quality Appraisal of Cost-Effectiveness Analyses of Pharmacologic Maintenance Treatment for Chronic Obstructive Pulmonary Disease: Methodological Considerations and Recommendatio," PharmacoEconomics, Springer, vol. 35(1), pages 43-63, January.
    20. Andrew Briggs & Rachel Nugent, 2016. "Editorial," Health Economics, John Wiley & Sons, Ltd., vol. 25(S1), pages 6-8, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:pharme:v:34:y:2016:i:9:d:10.1007_s40273-016-0410-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.