IDEAS home Printed from https://ideas.repec.org/a/plo/pntd00/0010071.html
   My bibliography  Save this article

Predicting dengue incidence leveraging internet-based data sources. A case study in 20 cities in Brazil

Author

Listed:
  • Gal Koplewitz
  • Fred Lu
  • Leonardo Clemente
  • Caroline Buckee
  • Mauricio Santillana

Abstract

The dengue virus affects millions of people every year worldwide, causing large epidemic outbreaks that disrupt people’s lives and severely strain healthcare systems. In the absence of a reliable vaccine against dengue or an effective treatment to manage the illness in humans, most efforts to combat dengue infections have focused on preventing its vectors, mainly the Aedes aegypti mosquito, from flourishing across the world. These mosquito-control strategies need reliable disease activity surveillance systems to be deployed. Despite significant efforts to estimate dengue incidence using a variety of data sources and methods, little work has been done to understand the relative contribution of the different data sources to improved prediction. Additionally, scholarship on the topic had initially focused on prediction systems at the national- and state-levels, and much remains to be done at the finer spatial resolutions at which health policy interventions often occur. We develop a methodological framework to assess and compare dengue incidence estimates at the city level, and evaluate the performance of a collection of models on 20 different cities in Brazil. The data sources we use towards this end are weekly incidence counts from prior years (seasonal autoregressive terms), weekly-aggregated weather variables, and real-time internet search data. We find that both random forest-based models and LASSO regression-based models effectively leverage these multiple data sources to produce accurate predictions, and that while the performance between them is comparable on average, the former method produces fewer extreme outliers, and can thus be considered more robust. For real-time predictions that assume long delays (6–8 weeks) in the availability of epidemiological data, we find that real-time internet search data are the strongest predictors of dengue incidence, whereas for predictions that assume short delays (1–3 weeks), in which the error rate is halved (as measured by relative RMSE), short-term and seasonal autocorrelation are the dominant predictors. Despite the difficulties inherent to city-level prediction, our framework achieves meaningful and actionable estimates across cities with different demographic, geographic and epidemic characteristics.Author summary: As the incidence of infectious diseases like dengue continues to increase throughout the world, tracking their spread in real time poses a significant challenge to local and national health authorities. Accurate incidence data are often difficult to obtain as outbreaks emerge and unfold, both due the partial reach of serological surveillance (especially in rural areas), and due to delays in reporting, which result in post-hoc adjustments to what should have been real-time data. Thus, a range of ‘nowcasting’ tools have been developed to estimate disease trends, using different mathematical and statistical methodologies to fill the temporal data gap. Over the past several years, researchers have investigated how to best incorporate internet search data into predictive models, since these can be obtained in real-time. Still, most such models have been regression-based, and have tended to underperform in cases when epidemiological data are only available after long reporting delays. Moreover, in tropical countries, attention has increasingly turned from testing and applying models at the national level to models at higher spatial resolutions, such as states and cities. Here, we develop machine learning models based on both LASSO regression and on random forest ensembles, and proceed to apply and compare them across 20 cities in Brazil. We find that our methodology produces meaningful and actionable disease estimates at the city level with both underlying model classes, and that the two perform comparably across most metrics, although the ensemble method produces fewer outliers. We also compare model performance and the relative contribution of different data sources across diverse geographic, demographic and epidemic conditions.

Suggested Citation

  • Gal Koplewitz & Fred Lu & Leonardo Clemente & Caroline Buckee & Mauricio Santillana, 2022. "Predicting dengue incidence leveraging internet-based data sources. A case study in 20 cities in Brazil," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 16(1), pages 1-21, January.
  • Handle: RePEc:plo:pntd00:0010071
    DOI: 10.1371/journal.pntd.0010071
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosntds/article?id=10.1371/journal.pntd.0010071
    Download Restriction: no

    File URL: https://journals.plos.org/plosntds/article/file?id=10.1371/journal.pntd.0010071&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pntd.0010071?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Felipe J Colón-González & Leonardo Soares Bastos & Barbara Hofmann & Alison Hopkin & Quillon Harpham & Tom Crocker & Rosanna Amato & Iacopo Ferrario & Francesca Moschini & Samuel James & Sajni Malde &, 2021. "Probabilistic seasonal dengue forecasting in Vietnam: A modelling study using superensembles," PLOS Medicine, Public Library of Science, vol. 18(3), pages 1-30, March.
    2. Yien Ling Hii & Huaiping Zhu & Nawi Ng & Lee Ching Ng & Joacim Rocklöv, 2012. "Forecast of Dengue Incidence Using Temperature and Rainfall," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 6(11), pages 1-9, November.
    3. Cecilia de Almeida Marques-Toledo & Carolin Marlen Degener & Livia Vinhal & Giovanini Coelho & Wagner Meira & Claudia Torres Codeço & Mauro Martins Teixeira, 2017. "Dengue prediction by the web: Tweets are a useful tool for estimating and forecasting Dengue at country and city level," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 11(7), pages 1-20, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aditya Lia Ramadona & Yesim Tozan & Lutfan Lazuardi & Joacim Rocklöv, 2019. "A combination of incidence data and mobility proxies from social media predicts the intra-urban spread of dengue in Yogyakarta, Indonesia," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 13(4), pages 1-12, April.
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Villi Dane M. Go, 2023. "Communicable disease surveillance through predictive analysis: A comparative analysis of prediction models," HO CHI MINH CITY OPEN UNIVERSITY JOURNAL OF SCIENCE - ENGINEERING AND TECHNOLOGY, HO CHI MINH CITY OPEN UNIVERSITY JOURNAL OF SCIENCE, HO CHI MINH CITY OPEN UNIVERSITY, vol. 13(2), pages 45-54.
    4. Fantazzini, Dean, 2020. "Short-term forecasting of the COVID-19 pandemic using Google Trends data: Evidence from 158 countries," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 59, pages 33-54.
    5. Teerawad Sriklin & Siriwan Kajornkasirat & Supattra Puttinaovarat, 2021. "Dengue Transmission Mapping with Weather-Based Predictive Model in Three Southernmost Provinces of Thailand," Sustainability, MDPI, vol. 13(12), pages 1-15, June.
    6. Baharuddin Baharuddin & Suhariningsih Suhariningsih & Brodjol Ulama, 2014. "Geographically Weighted Regression Modeling for Analyzing Spatial Heterogeneity on Relationship between Dengue Hemorrhagic Fever Incidence and Rainfall in Surabaya, Indonesia," Modern Applied Science, Canadian Center of Science and Education, vol. 8(3), pages 1-85, June.
    7. Tiago Peixoto & Tom Steinberg, 2019. "Citizen Engagement," World Bank Publications - Reports 32495, The World Bank Group.
    8. Alexandre Gori Maia & Jose Daniel Morales Martinez & Leticia Junqueira Marteleto & Cristina Guimaraes Rodrigues & Luiz Gustavo Sereno, 2023. "Can the Content of Social Networks Explain Epidemic Outbreaks?," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 42(1), pages 1-34, February.
    9. Ray, Evan L. & Brooks, Logan C. & Bien, Jacob & Biggerstaff, Matthew & Bosse, Nikos I. & Bracher, Johannes & Cramer, Estee Y. & Funk, Sebastian & Gerding, Aaron & Johansson, Michael A. & Rumack, Aaron, 2023. "Comparing trained and untrained probabilistic ensemble forecasts of COVID-19 cases and deaths in the United States," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1366-1383.
    10. Sarbhan Singh & Lai Chee Herng & Lokman Hakim Sulaiman & Shew Fung Wong & Jenarun Jelip & Norhayati Mokhtar & Quillon Harpham & Gina Tsarouchi & Balvinder Singh Gill, 2022. "The Effects of Meteorological Factors on Dengue Cases in Malaysia," IJERPH, MDPI, vol. 19(11), pages 1-24, May.
    11. Jue Tao Lim & Borame Sue Dickens & Sun Haoyang & Ng Lee Ching & Alex R Cook, 2020. "Inference on dengue epidemics with Bayesian regime switching models," PLOS Computational Biology, Public Library of Science, vol. 16(5), pages 1-15, May.
    12. Vicente Navarro Valencia & Yamilka Díaz & Juan Miguel Pascale & Maciej F. Boni & Javier E. Sanchez-Galan, 2021. "Assessing the Effect of Climate Variables on the Incidence of Dengue Cases in the Metropolitan Region of Panama City," IJERPH, MDPI, vol. 18(22), pages 1-18, November.
    13. Raphaël M Zellweger & Jorge Cano & Morgan Mangeas & François Taglioni & Alizé Mercier & Marc Despinoy & Christophe E Menkès & Myrielle Dupont-Rouzeyrol & Birgit Nikolay & Magali Teurlai, 2017. "Socioeconomic and environmental determinants of dengue transmission in an urban setting: An ecological study in Nouméa, New Caledonia," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 11(4), pages 1-18, April.
    14. Chen, Cathy W.S. & Liu, Feng-Chi & Pingal, Aljo Clair, 2023. "Integer-valued transfer function models for counts that show zero inflation," Statistics & Probability Letters, Elsevier, vol. 193(C).
    15. Panja, Madhurima & Chakraborty, Tanujit & Nadim, Sk Shahid & Ghosh, Indrajit & Kumar, Uttam & Liu, Nan, 2023. "An ensemble neural network approach to forecast Dengue outbreak based on climatic condition," Chaos, Solitons & Fractals, Elsevier, vol. 167(C).
    16. Shaowei Sang & Shaohua Gu & Peng Bi & Weizhong Yang & Zhicong Yang & Lei Xu & Jun Yang & Xiaobo Liu & Tong Jiang & Haixia Wu & Cordia Chu & Qiyong Liu, 2015. "Predicting Unprecedented Dengue Outbreak Using Imported Cases and Climatic Factors in Guangzhou, 2014," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 9(5), pages 1-12, May.
    17. Prashant Rangarajan & Sandeep K Mody & Madhav Marathe, 2019. "Forecasting dengue and influenza incidences using a sparse representation of Google trends, electronic health records, and time series data," PLOS Computational Biology, Public Library of Science, vol. 15(11), pages 1-24, November.
    18. Ting-Wu Chuang & Luis Fernando Chaves & Po-Jiang Chen, 2017. "Effects of local and regional climatic fluctuations on dengue outbreaks in southern Taiwan," PLOS ONE, Public Library of Science, vol. 12(6), pages 1-20, June.
    19. Shaowei Sang & Wenwu Yin & Peng Bi & Honglong Zhang & Chenggang Wang & Xiaobo Liu & Bin Chen & Weizhong Yang & Qiyong Liu, 2014. "Predicting Local Dengue Transmission in Guangzhou, China, through the Influence of Imported Cases, Mosquito Density and Climate Variability," PLOS ONE, Public Library of Science, vol. 9(7), pages 1-10, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pntd00:0010071. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosntds (email available below). General contact details of provider: https://journals.plos.org/plosntds/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.