IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0065459.html
   My bibliography  Save this article

Predictive Validation of an Influenza Spread Model

Author

Listed:
  • Ayaz Hyder
  • David L Buckeridge
  • Brian Leung

Abstract

Background: Modeling plays a critical role in mitigating impacts of seasonal influenza epidemics. Complex simulation models are currently at the forefront of evaluating optimal mitigation strategies at multiple scales and levels of organization. Given their evaluative role, these models remain limited in their ability to predict and forecast future epidemics leading some researchers and public-health practitioners to question their usefulness. The objective of this study is to evaluate the predictive ability of an existing complex simulation model of influenza spread. Methods and Findings: We used extensive data on past epidemics to demonstrate the process of predictive validation. This involved generalizing an individual-based model for influenza spread and fitting it to laboratory-confirmed influenza infection data from a single observed epidemic (1998–1999). Next, we used the fitted model and modified two of its parameters based on data on real-world perturbations (vaccination coverage by age group and strain type). Simulating epidemics under these changes allowed us to estimate the deviation/error between the expected epidemic curve under perturbation and observed epidemics taking place from 1999 to 2006. Our model was able to forecast absolute intensity and epidemic peak week several weeks earlier with reasonable reliability and depended on the method of forecasting-static or dynamic. Conclusions: Good predictive ability of influenza epidemics is critical for implementing mitigation strategies in an effective and timely manner. Through the process of predictive validation applied to a current complex simulation model of influenza spread, we provided users of the model (e.g. public-health officials and policy-makers) with quantitative metrics and practical recommendations on mitigating impacts of seasonal influenza epidemics. This methodology may be applied to other models of communicable infectious diseases to test and potentially improve their predictive ability.

Suggested Citation

  • Ayaz Hyder & David L Buckeridge & Brian Leung, 2013. "Predictive Validation of an Influenza Spread Model," PLOS ONE, Public Library of Science, vol. 8(6), pages 1-20, June.
    • Handle: RePEc:plo:pone00:0065459
    DOI: 10.1371/journal.pone.0065459
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0065459
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0065459&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0065459?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. T Déirdre Hollingsworth & Don Klinkenberg & Hans Heesterbeek & Roy M Anderson, 2011. "Mitigation Strategies for Pandemic Influenza A: Balancing Conflicting Policy Objectives," PLOS Computational Biology, Public Library of Science, vol. 7(2), pages 1-11, February.
    2. Phillip Stroud & Sara Del Valle & Stephen Sydoriak & Jane Riese & Susan Mniszewski, 2007. "Spatial Dynamics of Pandemic Influenza in a Massive Artificial Society," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(4), pages 1-9.
    3. Edward Goldstein & Sarah Cobey & Saki Takahashi & Joel C Miller & Marc Lipsitch, 2011. "Predicting the Epidemic Sizes of Influenza A/H1N1, A/H3N2, and B: A Statistical Method," PLOS Medicine, Public Library of Science, vol. 8(7), pages 1-12, July.
    4. Jeremy Ginsberg & Matthew H. Mohebbi & Rajan S. Patel & Lynnette Brammer & Mark S. Smolinski & Larry Brilliant, 2009. "Detecting influenza epidemics using search engine query data," Nature, Nature, vol. 457(7232), pages 1012-1014, February.
    5. Robert Marks, 2007. "Validating Simulation Models: A General Framework and Four Applied Examples," Computational Economics, Springer;Society for Computational Economics, vol. 30(3), pages 265-290, October.
    6. Jimmy Boon Som Ong & Mark I-Cheng Chen & Alex R Cook & Huey Chyi Lee & Vernon J Lee & Raymond Tzer Pin Lin & Paul Ananth Tambyah & Lee Gan Goh, 2010. "Real-Time Epidemic Monitoring and Forecasting of H1N1-2009 Using Influenza-Like Illness from General Practice and Family Doctor Clinics in Singapore," PLOS ONE, Public Library of Science, vol. 5(4), pages 1-11, April.
    7. Neil M. Ferguson & Derek A. T. Cummings & Christophe Fraser & James C. Cajka & Philip C. Cooley & Donald S. Burke, 2006. "Strategies for mitigating an influenza pandemic," Nature, Nature, vol. 442(7101), pages 448-452, July.
    8. Julia B Wenger & Elena N Naumova, 2010. "Seasonal Synchronization of Influenza in the United States Older Adult Population," PLOS ONE, Public Library of Science, vol. 5(4), pages 1-11, April.
    9. Neil M. Ferguson & Derek A.T. Cummings & Simon Cauchemez & Christophe Fraser & Steven Riley & Aronrag Meeyai & Sopon Iamsirithaworn & Donald S. Burke, 2005. "Strategies for containing an emerging influenza pandemic in Southeast Asia," Nature, Nature, vol. 437(7056), pages 209-214, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Petropoulos, Fotios & Makridakis, Spyros & Stylianou, Neophytos, 2022. "COVID-19: Forecasting confirmed cases and deaths with a simple time series model," International Journal of Forecasting, Elsevier, vol. 38(2), pages 439-452.
    2. Jean-Paul Chretien & Dylan George & Jeffrey Shaman & Rohit A Chitale & F Ellis McKenzie, 2014. "Influenza Forecasting in Human Populations: A Scoping Review," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-8, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dionne M. Aleman & Theodorus G. Wibisono & Brian Schwartz, 2011. "A Nonhomogeneous Agent-Based Simulation Approach to Modeling the Spread of Disease in a Pandemic Outbreak," Interfaces, INFORMS, vol. 41(3), pages 301-315, June.
    2. Taesik Lee & Hayong Shin, 2016. "Combining syndromic surveillance and ILI data using particle filter for epidemic state estimation," Flexible Services and Manufacturing Journal, Springer, vol. 28(1), pages 233-253, June.
    3. Logan C Brooks & David C Farrow & Sangwon Hyun & Ryan J Tibshirani & Roni Rosenfeld, 2015. "Flexible Modeling of Epidemics with an Empirical Bayes Framework," PLOS Computational Biology, Public Library of Science, vol. 11(8), pages 1-18, August.
    4. S. M. Mniszewski & S. Y. Del Valle & P. D. Stroud & J. M. Riese & S. J. Sydoriak, 2008. "Pandemic simulation of antivirals + school closures: buying time until strain-specific vaccine is available," Computational and Mathematical Organization Theory, Springer, vol. 14(3), pages 209-221, September.
    5. Jeremy Hadidjojo & Siew Ann Cheong, 2011. "Equal Graph Partitioning on Estimated Infection Network as an Effective Epidemic Mitigation Measure," PLOS ONE, Public Library of Science, vol. 6(7), pages 1-10, July.
    6. Xiaoli Wang & Shuangsheng Wu & C Raina MacIntyre & Hongbin Zhang & Weixian Shi & Xiaomin Peng & Wei Duan & Peng Yang & Yi Zhang & Quanyi Wang, 2015. "Using an Adjusted Serfling Regression Model to Improve the Early Warning at the Arrival of Peak Timing of Influenza in Beijing," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-14, March.
    7. Moshe B Hoshen & Anthony H Burton & Themis J V Bowcock, 2007. "Simulating disease transmission dynamics at a multi-scale level," International Journal of Microsimulation, International Microsimulation Association, vol. 1(1), pages 26-34.
    8. Andrew G. Atkeson & Karen A. Kopecky & Tao Zha, 2024. "Four Stylized Facts About Covid‐19," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 65(1), pages 3-42, February.
    9. James Truscott & Neil M Ferguson, 2012. "Evaluating the Adequacy of Gravity Models as a Description of Human Mobility for Epidemic Modelling," PLOS Computational Biology, Public Library of Science, vol. 8(10), pages 1-12, October.
    10. Eva K. Lee & Chien-Hung Chen & Ferdinand Pietz & Bernard Benecke, 2009. "Modeling and Optimizing the Public-Health Infrastructure for Emergency Response," Interfaces, INFORMS, vol. 39(5), pages 476-490, October.
    11. Eva K. Lee & Ferdinand Pietz & Bernard Benecke & Jacquelyn Mason & Greg Burel, 2013. "Advancing Public Health and Medical Preparedness with Operations Research," Interfaces, INFORMS, vol. 43(1), pages 79-98, February.
    12. Bekiros, Stelios & Kouloumpou, Dimitra, 2020. "SBDiEM: A new mathematical model of infectious disease dynamics," Chaos, Solitons & Fractals, Elsevier, vol. 136(C).
    13. Akira Watanabe & Hiroyuki Matsuda, 2023. "Effectiveness of feedback control and the trade-off between death by COVID-19 and costs of countermeasures," Health Care Management Science, Springer, vol. 26(1), pages 46-61, March.
    14. Andy Hong & Sandip Chakrabarti, 2023. "Compact living or policy inaction? Effects of urban density and lockdown on the COVID-19 outbreak in the US," Urban Studies, Urban Studies Journal Limited, vol. 60(9), pages 1588-1609, July.
    15. Rakowski, Franciszek & Gruziel, Magdalena & Bieniasz-Krzywiec, Łukasz & Radomski, Jan P., 2010. "Influenza epidemic spread simulation for Poland — a large scale, individual based model study," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(16), pages 3149-3165.
    16. van der Weijden, Charlie P. & Stein, Mart L. & Jacobi, André J. & Kretzschmar, Mirjam E.E. & Reintjes, Ralf & van Steenbergen, Jim E. & Timen, Aura, 2013. "Choosing pandemic parameters for pandemic preparedness planning: A comparison of pandemic scenarios prior to and following the influenza A(H1N1) 2009 pandemic," Health Policy, Elsevier, vol. 109(1), pages 52-62.
    17. Lawrence M. Wein & Michael P. Atkinson, 2009. "Assessing Infection Control Measures for Pandemic Influenza," Risk Analysis, John Wiley & Sons, vol. 29(7), pages 949-962, July.
    18. Savachkin, Alex & Uribe, Andrés, 2012. "Dynamic redistribution of mitigation resources during influenza pandemics," Socio-Economic Planning Sciences, Elsevier, vol. 46(1), pages 33-45.
    19. T Déirdre Hollingsworth & Don Klinkenberg & Hans Heesterbeek & Roy M Anderson, 2011. "Mitigation Strategies for Pandemic Influenza A: Balancing Conflicting Policy Objectives," PLOS Computational Biology, Public Library of Science, vol. 7(2), pages 1-11, February.
    20. Jurić, Tado, 2021. "Google Trends as a Method to Predict New COVID-19 Cases and Socio-Psychological Consequences of the Pandemic," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 7(forthcomi).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0065459. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.