IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1006204.html
   My bibliography  Save this article

Anticipating epidemic transitions with imperfect data

Author

Listed:
  • Tobias S Brett
  • Eamon B O’Dea
  • Éric Marty
  • Paige B Miller
  • Andrew W Park
  • John M Drake
  • Pejman Rohani

Abstract

Epidemic transitions are an important feature of infectious disease systems. As the transmissibility of a pathogen increases, the dynamics of disease spread shifts from limited stuttering chains of transmission to potentially large scale outbreaks. One proposed method to anticipate this transition are early-warning signals (EWS), summary statistics which undergo characteristic changes as the transition is approached. Although theoretically predicted, their mathematical basis does not take into account the nature of epidemiological data, which are typically aggregated into periodic case reports and subject to reporting error. The viability of EWS for epidemic transitions therefore remains uncertain. Here we demonstrate that most EWS can predict emergence even when calculated from imperfect data. We quantify performance using the area under the curve (AUC) statistic, a measure of how well an EWS distinguishes between numerical simulations of an emerging disease and one which is stationary. Values of the AUC statistic are compared across a range of different reporting scenarios. We find that different EWS respond to imperfect data differently. The mean, variance and first differenced variance all perform well unless reporting error is highly overdispersed. The autocorrelation, autocovariance and decay time perform well provided that the aggregation period of the data is larger than the serial interval and reporting error is not highly overdispersed. The coefficient of variation, skewness and kurtosis are found to be unreliable indicators of emergence. Overall, we find that seven of ten EWS considered perform well for most realistic reporting scenarios. We conclude that imperfect epidemiological data is not a barrier to using EWS for many potentially emerging diseases.Author summary: Anticipating disease emergence is a challenging problem, however the public health ramifications are clear. A proposed tool to help meet this challenge are early-warning signals (EWS), summary statistics which undergo characteristic changes before dynamical transitions. While previous theoretical studies are promising, and find that epidemic transitions are preceded by detectable trends in EWS, they do not consider the effects of imperfect data. To address this, we developed a simulation study which assesses how case aggregation and reporting error impact on 10 different EWS’s performance. Case report data were simulated by combining a stochastic SIR transmission model with a model of reporting error. Temporal trends in an EWS were used as a method of distinguishing between an emerging disease (R0 approaching 1) and a stationary disease (constant R0). We investigated the robustness of EWS to reporting process parameters, namely the aggregation period, reporting probability and overdispersion of reporting error. Seven of ten EWS perform well for realistic reporting scenarios, and are strong candidates for incorporation in disease emergence monitoring systems.

Suggested Citation

  • Tobias S Brett & Eamon B O’Dea & Éric Marty & Paige B Miller & Andrew W Park & John M Drake & Pejman Rohani, 2018. "Anticipating epidemic transitions with imperfect data," PLOS Computational Biology, Public Library of Science, vol. 14(6), pages 1-18, June.
  • Handle: RePEc:plo:pcbi00:1006204
    DOI: 10.1371/journal.pcbi.1006204
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1006204
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1006204&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1006204?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Rustom Antia & Roland R. Regoes & Jacob C. Koella & Carl T. Bergstrom, 2003. "The role of evolution in the emergence of infectious diseases," Nature, Nature, vol. 426(6967), pages 658-661, December.
    2. Davis, S.F. & Strebel, P.M. & Atkinson, W.L. & Markowitz, L.E. & Sutter, R.W. & Scanlon, K.S. & Friedman, S. & Hadler, S.C., 1993. "Reporting efficiency during a measles outbreak in New York City, 1991," American Journal of Public Health, American Public Health Association, vol. 83(7), pages 1011-1015.
    3. Sonia Kéfi & Vishwesha Guttal & William A Brock & Stephen R Carpenter & Aaron M Ellison & Valerie N Livina & David A Seekell & Marten Scheffer & Egbert H van Nes & Vasilis Dakos, 2014. "Early Warning Signals of Ecological Transitions: Methods for Spatial Patterns," PLOS ONE, Public Library of Science, vol. 9(3), pages 1-13, March.
    4. Seth Blumberg & James O Lloyd-Smith, 2013. "Inference of R0 and Transmission Heterogeneity from the Size Distribution of Stuttering Chains," PLOS Computational Biology, Public Library of Science, vol. 9(5), pages 1-17, May.
    5. N. G. Becker & T. Britton, 1999. "Statistical studies of infectious disease incidence," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(2), pages 287-307, April.
    6. David M. Morens & Gregory K. Folkers & Anthony S. Fauci, 2004. "The challenge of emerging and re-emerging infectious diseases," Nature, Nature, vol. 430(6996), pages 242-249, July.
    7. Ewert, D.P. & Frederick, P.D. & Run, G.H. & Mascola, L., 1994. "The reporting efficiency of measles by hospitals in Los Angeles County, 1986 and 1989," American Journal of Public Health, American Public Health Association, vol. 84(5), pages 868-869.
    8. John M. Drake & Blaine D. Griffen, 2010. "Early warning signals of extinction in deteriorating environments," Nature, Nature, vol. 467(7314), pages 456-459, September.
    9. Aaron A. King & Edward L. Ionides & Mercedes Pascual & Menno J. Bouma, 2008. "Inapparent infections and cholera dynamics," Nature, Nature, vol. 454(7206), pages 877-880, August.
    10. Carol Y. Lin, 2008. "Modeling Infectious Diseases in Humans and Animals by KEELING, M. J. and ROHANI, P," Biometrics, The International Biometric Society, vol. 64(3), pages 993-993, September.
    11. King, Aaron A. & Nguyen, Dao & Ionides, Edward L., 2016. "Statistical Inference for Partially Observed Markov Processes via the R Package pomp," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 69(i12).
    12. Heidi J. Larson & Isaac Ghinai, 2011. "Lessons from polio eradication," Nature, Nature, vol. 473(7348), pages 446-447, May.
    13. Marten Scheffer & Jordi Bascompte & William A. Brock & Victor Brovkin & Stephen R. Carpenter & Vasilis Dakos & Hermann Held & Egbert H. van Nes & Max Rietkerk & George Sugihara, 2009. "Early-warning signals for critical transitions," Nature, Nature, vol. 461(7260), pages 53-59, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. John M Drake & Tobias S Brett & Shiyang Chen & Bogdan I Epureanu & Matthew J Ferrari & Éric Marty & Paige B Miller & Eamon B O’Dea & Suzanne M O’Regan & Andrew W Park & Pejman Rohani, 2019. "The statistics of epidemic transitions," PLOS Computational Biology, Public Library of Science, vol. 15(5), pages 1-14, May.
    2. Emma Southall & Michael J Tildesley & Louise Dyson, 2020. "Prospects for detecting early warning signals in discrete event sequence data: Application to epidemiological incidence data," PLOS Computational Biology, Public Library of Science, vol. 16(9), pages 1-22, September.
    3. Tobias Brett & Marco Ajelli & Quan-Hui Liu & Mary G Krauland & John J Grefenstette & Willem G van Panhuis & Alessandro Vespignani & John M Drake & Pejman Rohani, 2020. "Detecting critical slowing down in high-dimensional epidemiological systems," PLOS Computational Biology, Public Library of Science, vol. 16(3), pages 1-19, March.
    4. Tobias S Brett & Pejman Rohani, 2020. "Dynamical footprints enable detection of disease emergence," PLOS Biology, Public Library of Science, vol. 18(5), pages 1-20, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tobias Brett & Marco Ajelli & Quan-Hui Liu & Mary G Krauland & John J Grefenstette & Willem G van Panhuis & Alessandro Vespignani & John M Drake & Pejman Rohani, 2020. "Detecting critical slowing down in high-dimensional epidemiological systems," PLOS Computational Biology, Public Library of Science, vol. 16(3), pages 1-19, March.
    2. John M Drake & Tobias S Brett & Shiyang Chen & Bogdan I Epureanu & Matthew J Ferrari & Éric Marty & Paige B Miller & Eamon B O’Dea & Suzanne M O’Regan & Andrew W Park & Pejman Rohani, 2019. "The statistics of epidemic transitions," PLOS Computational Biology, Public Library of Science, vol. 15(5), pages 1-14, May.
    3. Tobias S Brett & Pejman Rohani, 2020. "Dynamical footprints enable detection of disease emergence," PLOS Biology, Public Library of Science, vol. 18(5), pages 1-20, May.
    4. Orozco-Fuentes, S. & Griffiths, G. & Holmes, M.J. & Ettelaie, R. & Smith, J. & Baggaley, A.W. & Parker, N.G., 2019. "Early warning signals in plant disease outbreaks," Ecological Modelling, Elsevier, vol. 393(C), pages 12-19.
    5. David A Rasmussen & Oliver Ratmann & Katia Koelle, 2011. "Inference for Nonlinear Epidemiological Models Using Genealogies and Time Series," PLOS Computational Biology, Public Library of Science, vol. 7(8), pages 1-11, August.
    6. Ryan D Batt & Tarsha Eason & Ahjond Garmestani, 2019. "Time scale of resilience loss: Implications for managing critical transitions in water quality," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-19, October.
    7. Mohammed, M.M.A. & Landi, P. & Minoarivelo, H.O. & Hui, C., 2018. "Frugivory and seed dispersal: Extended bi-stable persistence and reduced clustering of plants," Ecological Modelling, Elsevier, vol. 380(C), pages 31-39.
    8. Richter, Andries & Dakos, Vasilis, 2015. "Profit fluctuations signal eroding resilience of natural resources," Ecological Economics, Elsevier, vol. 117(C), pages 12-21.
    9. Martin Lindegren & Vasilis Dakos & Joachim P Gröger & Anna Gårdmark & Georgs Kornilovs & Saskia A Otto & Christian Möllmann, 2012. "Early Detection of Ecosystem Regime Shifts: A Multiple Method Evaluation for Management Application," PLOS ONE, Public Library of Science, vol. 7(7), pages 1-9, July.
    10. Vasilis Dakos & Stephen R Carpenter & William A Brock & Aaron M Ellison & Vishwesha Guttal & Anthony R Ives & Sonia Kéfi & Valerie Livina & David A Seekell & Egbert H van Nes & Marten Scheffer, 2012. "Methods for Detecting Early Warnings of Critical Transitions in Time Series Illustrated Using Simulated Ecological Data," PLOS ONE, Public Library of Science, vol. 7(7), pages 1-20, July.
    11. Christian Meisel & Andreas Klaus & Christian Kuehn & Dietmar Plenz, 2015. "Critical Slowing Down Governs the Transition to Neuron Spiking," PLOS Computational Biology, Public Library of Science, vol. 11(2), pages 1-20, February.
    12. Maarten C Boerlijst & Thomas Oudman & André M de Roos, 2013. "Catastrophic Collapse Can Occur without Early Warning: Examples of Silent Catastrophes in Structured Ecological Models," PLOS ONE, Public Library of Science, vol. 8(4), pages 1-6, April.
    13. Manfred Füllsack & Daniel Reisinger & Marie Kapeller & Georg Jäger, 2022. "Early warning signals from the periphery," Journal of Computational Social Science, Springer, vol. 5(1), pages 665-685, May.
    14. King, Aaron A. & Nguyen, Dao & Ionides, Edward L., 2016. "Statistical Inference for Partially Observed Markov Processes via the R Package pomp," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 69(i12).
    15. William A Brock & Stephen R Carpenter, 2012. "Early Warnings of Regime Shift When the Ecosystem Structure Is Unknown," PLOS ONE, Public Library of Science, vol. 7(9), pages 1-10, September.
    16. Tatiana Baumuratova & Simona Dobre & Thierry Bastogne & Thomas Sauter, 2013. "Switch of Sensitivity Dynamics Revealed with DyGloSA Toolbox for Dynamical Global Sensitivity Analysis as an Early Warning for System's Critical Transition," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-12, December.
    17. William A. Brock & Steven N. Durlauf, 2015. "On Sturdy Policy Evaluation," The Journal of Legal Studies, University of Chicago Press, vol. 44(S2), pages 447-473.
    18. Kiran D’Souza & Bogdan I Epureanu & Mercedes Pascual, 2015. "Forecasting Bifurcations from Large Perturbation Recoveries in Feedback Ecosystems," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-19, September.
    19. Yang, Anji & Wang, Hao & Yuan, Sanling, 2023. "Tipping time in a stochastic Leslie predator–prey model," Chaos, Solitons & Fractals, Elsevier, vol. 171(C).
    20. Bian, Junhao & Ma, Zhiqin & Wang, Chunping & Huang, Tao & Zeng, Chunhua, 2024. "Early warning for spatial ecological system: Fractal dimension and deep learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 633(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1006204. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.