IDEAS home Printed from https://ideas.repec.org/a/spr/pharme/v37y2019i11d10.1007_s40273-019-00837-x.html
   My bibliography  Save this article

A Need for Change! A Coding Framework for Improving Transparency in Decision Modeling

Author

Listed:
  • Fernando Alarid-Escudero

    (Center for Research and Teaching in Economics (CIDE)-CONACyT)

  • Eline M. Krijkamp

    (Erasmus MC)

  • Petros Pechlivanoglou

    (The Hospital for Sick Children and University of Toronto)

  • Hawre Jalal

    (University of Pittsburgh)

  • Szu-Yu Zoe Kao

    (University of Minnesota School of Public Health)

  • Alan Yang

    (The Hospital for Sick Children)

  • Eva A. Enns

    (University of Minnesota School of Public Health)

Abstract

The use of open-source programming languages, such as R, in health decision sciences is growing and has the potential to facilitate model transparency, reproducibility, and shareability. However, realizing this potential can be challenging. Models are complex and primarily built to answer a research question, with model sharing and transparency relegated to being secondary goals. Consequently, code is often neither well documented nor systematically organized in a comprehensible and shareable approach. Moreover, many decision modelers are not formally trained in computer programming and may lack good coding practices, further compounding the problem of model transparency. To address these challenges, we propose a high-level framework for model-based decision and cost-effectiveness analyses (CEA) in R. The proposed framework consists of a conceptual, modular structure and coding recommendations for the implementation of model-based decision analyses in R. This framework defines a set of common decision model elements divided into five components: (1) model inputs, (2) decision model implementation, (3) model calibration, (4) model validation, and (5) analysis. The first four components form the model development phase. The analysis component is the application of the fully developed decision model to answer the policy or the research question of interest, assess decision uncertainty, and/or to determine the value of future research through value of information (VOI) analysis. In this framework, we also make recommendations for good coding practices specific to decision modeling, such as file organization and variable naming conventions. We showcase the framework through a fully functional, testbed decision model, which is hosted on GitHub for free download and easy adaptation to other applications. The use of this framework in decision modeling will improve code readability and model sharing, paving the way to an ideal, open-source world.

Suggested Citation

  • Fernando Alarid-Escudero & Eline M. Krijkamp & Petros Pechlivanoglou & Hawre Jalal & Szu-Yu Zoe Kao & Alan Yang & Eva A. Enns, 2019. "A Need for Change! A Coding Framework for Improving Transparency in Decision Modeling," PharmacoEconomics, Springer, vol. 37(11), pages 1329-1339, November.
    • Handle: RePEc:spr:pharme:v:37:y:2019:i:11:d:10.1007_s40273-019-00837-x
    DOI: 10.1007/s40273-019-00837-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40273-019-00837-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40273-019-00837-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kleijnen, Jack P. C., 1995. "Verification and validation of simulation models," European Journal of Operational Research, Elsevier, vol. 82(1), pages 145-162, April.
    2. Karl Claxton & John Posnett, "undated". "An Economic Approach to Clinical Trial Design and Research Priority Setting," Discussion Papers 96/19, Department of Economics, University of York.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Carmen María Yago & Francisco Javier Díez, 2023. "DESnets: A Graphical Representation for Discrete Event Simulation and Cost-Effectiveness Analysis," Mathematics, MDPI, vol. 11(7), pages 1-24, March.
    2. Paul Tappenden & J. Jaime Caro, 2019. "Improving Transparency in Decision Models: Current Issues and Potential Solutions," PharmacoEconomics, Springer, vol. 37(11), pages 1303-1304, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter Bacchetti & Charles E. McCulloch & Mark R. Segal, 2008. "Simple, Defensible Sample Sizes Based on Cost Efficiency," Biometrics, The International Biometric Society, vol. 64(2), pages 577-585, June.
    2. A. E. Ades & Karl Claxton & Mark Sculpher, 2006. "Evidence synthesis, parameter correlation and probabilistic sensitivity analysis," Health Economics, John Wiley & Sons, Ltd., vol. 15(4), pages 373-381, April.
    3. Rachael DiSantostefano & Andrea Biddle & John Lavelle, 2006. "The Long-Term Cost Effectiveness of Treatments for Benign Prostatic Hyperplasia," PharmacoEconomics, Springer, vol. 24(2), pages 171-191, February.
    4. Juan Manuel Larrosa, 2016. "Agentes computacionales y análisis económico," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 18(34), pages 87-113, January-J.
    5. Qi Cao & Erik Buskens & Hans L. Hillege & Tiny Jaarsma & Maarten Postma & Douwe Postmus, 2019. "Stratified treatment recommendation or one-size-fits-all? A health economic insight based on graphical exploration," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(3), pages 475-482, April.
    6. Pau Fonseca i Casas, 2023. "A Continuous Process for Validation, Verification, and Accreditation of Simulation Models," Mathematics, MDPI, vol. 11(4), pages 1-25, February.
    7. Karl Claxton & Elisabeth Fenwick & Mark J. Sculpher, 2012. "Decision-making with Uncertainty: The Value of Information," Chapters, in: Andrew M. Jones (ed.), The Elgar Companion to Health Economics, Second Edition, chapter 51, Edward Elgar Publishing.
    8. Simon Eckermann & Tim Coelli, 2008. "Including quality attributes in a model of health care efficiency: A net benefit approach," CEPA Working Papers Series WP032008, School of Economics, University of Queensland, Australia.
    9. Neil Hawkins & Mark Sculpher & David Epstein, 2005. "Cost-Effectiveness Analysis of Treatments for Chronic Disease: Using R to Incorporate Time Dependency of Treatment Response," Medical Decision Making, , vol. 25(5), pages 511-519, September.
    10. H. Christopher Frey & Sumeet R. Patil, 2002. "Identification and Review of Sensitivity Analysis Methods," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 553-578, June.
    11. Edris Yousefi Rad & Mohammad Reza Mahpeykar, 2017. "A Novel Hybrid Approach for Numerical Modeling of the Nucleating Flow in Laval Nozzle and Transonic Steam Turbine Blades," Energies, MDPI, vol. 10(9), pages 1-37, August.
    12. Tunali, S. & Batmaz, I., 2003. "A metamodeling methodology involving both qualitative and quantitative input factors," European Journal of Operational Research, Elsevier, vol. 150(2), pages 437-450, October.
    13. Patrick Afflerbach & Christopher Dun & Henner Gimpel & Dominik Parak & Johannes Seyfried, 2021. "A Simulation-Based Approach to Understanding the Wisdom of Crowds Phenomenon in Aggregating Expert Judgment," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 63(4), pages 329-348, August.
    14. Diaz, Rafael & Behr, Joshua G. & Acero, Beatriz, 2022. "Coastal housing recovery in a postdisaster environment: A supply chain perspective," International Journal of Production Economics, Elsevier, vol. 247(C).
    15. Kleijnen, J.P.C., 1995. "Sensitivity analysis and optimization of system dynamics models : Regression analysis and statistical design of experiments," Other publications TiSEM 87ee6ee0-592c-4204-ac50-6, Tilburg University, School of Economics and Management.
    16. J. Brown & N. J. Welton & C. Bankhead & S. H. Richards & L. Roberts & C. Tydeman & T. J. Peters, 2006. "A Bayesian approach to analysing the cost‐effectiveness of two primary care interventions aimed at improving attendance for breast screening," Health Economics, John Wiley & Sons, Ltd., vol. 15(5), pages 435-445, May.
    17. Janová, Jitka & Hampel, David & Nerudová, Danuše, 2019. "Design and validation of a tax sustainability index," European Journal of Operational Research, Elsevier, vol. 278(3), pages 916-926.
    18. John Hutton, 2012. "‘Health Economics’ and the evolution of economic evaluation of health technologies," Health Economics, John Wiley & Sons, Ltd., vol. 21(1), pages 13-18, January.
    19. Sander van der Hoog, 2017. "Deep Learning in (and of) Agent-Based Models: A Prospectus," Papers 1706.06302, arXiv.org.
    20. Thea Asselt & Bram Ramaekers & Isaac Corro Ramos & Manuela Joore & Maiwenn Al & Ivonne Lesman-Leegte & Maarten Postma & Pepijn Vemer & Talitha Feenstra, 2018. "Research Costs Investigated: A Study Into the Budgets of Dutch Publicly Funded Drug-Related Research," PharmacoEconomics, Springer, vol. 36(1), pages 105-113, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:pharme:v:37:y:2019:i:11:d:10.1007_s40273-019-00837-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.