IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v161y2022ics0960077922005161.html
   My bibliography  Save this article

Forecasting new diseases in low-data settings using transfer learning

Author

Listed:
  • Roster, Kirstin
  • Connaughton, Colm
  • Rodrigues, Francisco A.

Abstract

Recent infectious disease outbreaks, such as the COVID-19 pandemic and the Zika epidemic in Brazil, have demonstrated both the importance and difficulty of accurately forecasting novel infectious diseases. When new diseases first emerge, we have little knowledge of the transmission process, the level and duration of immunity to reinfection, or other parameters required to build realistic epidemiological models. Time series forecasts and machine learning, while less reliant on assumptions about the disease, require large amounts of data that are also not available in early stages of an outbreak. In this study, we examine how knowledge of related diseases can help make predictions of new diseases in data-scarce environments using transfer learning. We implement both an empirical and a synthetic approach. Using data from Brazil, we compare how well different machine learning models transfer knowledge between two different dataset pairs: case counts of (i) dengue and Zika, and (ii) influenza and COVID-19. In the synthetic analysis, we generate data with an SIR model using different transmission and recovery rates, and then compare the effectiveness of different transfer learning methods. We find that transfer learning offers the potential to improve predictions, even beyond a model based on data from the target disease, though the appropriate source disease must be chosen carefully. While imperfect, these models offer an additional input for decision makers for pandemic response.

Suggested Citation

  • Roster, Kirstin & Connaughton, Colm & Rodrigues, Francisco A., 2022. "Forecasting new diseases in low-data settings using transfer learning," Chaos, Solitons & Fractals, Elsevier, vol. 161(C).
  • Handle: RePEc:eee:chsofr:v:161:y:2022:i:c:s0960077922005161
    DOI: 10.1016/j.chaos.2022.112306
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077922005161
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.chaos.2022.112306?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cleo Anastassopoulou & Lucia Russo & Athanasios Tsakris & Constantinos Siettos, 2020. "Data-based analysis, modelling and forecasting of the COVID-19 outbreak," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-21, March.
    2. Andrea Saltelli & Gabriele Bammer & Isabelle Bruno & Erica Charters & Monica Di Fiore & Emmanuel Didier & Wendy Nelson Espeland & John Kay & Samuele Lo Piano & Deborah Mayo & Roger Pielke Jr & Tommaso, 2020. "Five ways to ensure that models serve society: a manifesto," Nature, Nature, vol. 582(7813), pages 482-484, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. František Božek & Irena Tušer, 2021. "Measures for Ensuring Sustainability during the Current Spreading of Coronaviruses in the Czech Republic," Sustainability, MDPI, vol. 13(12), pages 1-22, June.
    2. Ping He & Yu Gao & Longfei Guo & Tongtong Huo & Yuxin Li & Xingren Zhang & Yunfeng Li & Cheng Peng & Fanyun Meng, 2021. "Evaluating the Disaster Risk of the COVID-19 Pandemic Using an Ecological Niche Model," Sustainability, MDPI, vol. 13(21), pages 1-23, October.
    3. Lovell, Katherine & Watson, Jim & Hiteva, Ralitsa, 2022. "Infrastructure decision-making: Opening up governance futures within techno-economic modelling," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    4. Susanne Jørgensen & Knut H Sørensen, 2023. "Numeric work: The efforts of calculation actors to make numbers count in climate and energy policy," Science and Public Policy, Oxford University Press, vol. 50(2), pages 243-252.
    5. Lu, Xuefei & Borgonovo, Emanuele, 2023. "Global sensitivity analysis in epidemiological modeling," European Journal of Operational Research, Elsevier, vol. 304(1), pages 9-24.
    6. Céline Diebold, 2022. "How Meaningful is the Elite Quality Index Ranking?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 163(1), pages 137-170, August.
    7. Hebinck, Aniek & Zurek, Monika & Achterbosch, Thom & Forkman, Björn & Kuijsten, Anneleen & Kuiper, Marijke & Nørrung, Birgit & van ’t Veer, Pieter & Leip, Adrian, 2020. "A sustainability compass for policy navigation to sustainable food systems," SocArXiv ab8ts, Center for Open Science.
    8. Li, Shaoran & Linton, Oliver, 2021. "When will the Covid-19 pandemic peak?," Journal of Econometrics, Elsevier, vol. 220(1), pages 130-157.
    9. Cooper, Ian & Mondal, Argha & Antonopoulos, Chris G., 2020. "Dynamic tracking with model-based forecasting for the spread of the COVID-19 pandemic," Chaos, Solitons & Fractals, Elsevier, vol. 139(C).
    10. Cooper, Ian & Mondal, Argha & Antonopoulos, Chris G., 2020. "A SIR model assumption for the spread of COVID-19 in different communities," Chaos, Solitons & Fractals, Elsevier, vol. 139(C).
    11. Fantazzini, Dean, 2020. "Short-term forecasting of the COVID-19 pandemic using Google Trends data: Evidence from 158 countries," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 59, pages 33-54.
    12. Arnald Puy & Razi Sheikholeslami & Hoshin V. Gupta & Jim W. Hall & Bruce Lankford & Samuele Lo Piano & Jonas Meier & Florian Pappenberger & Amilcare Porporato & Giulia Vico & Andrea Saltelli, 2022. "The delusive accuracy of global irrigation water withdrawal estimates," Nature Communications, Nature, vol. 13(1), pages 1-4, December.
    13. Pau Fonseca i Casas & Joan Garcia i Subirana & Víctor García i Carrasco & Xavier Pi i Palomés, 2021. "SARS-CoV-2 Spread Forecast Dynamic Model Validation through Digital Twin Approach, Catalonia Case Study," Mathematics, MDPI, vol. 9(14), pages 1-17, July.
    14. Jahel, Camille & Bourgeois, Robin & Bourgoin, Jérémy & Daré, William's & De Lattre-Gasquet, Marie & Delay, Etienne & Dumas, Patrice & Le Page, Christophe & Piraux, Marc & Prudhomme, Rémi, 2023. "The future of social-ecological systems at the crossroads of quantitative and qualitative methods," Technological Forecasting and Social Change, Elsevier, vol. 193(C).
    15. Song, Jialu & Xie, Hujin & Gao, Bingbing & Zhong, Yongmin & Gu, Chengfan & Choi, Kup-Sze, 2021. "Maximum likelihood-based extended Kalman filter for COVID-19 prediction," Chaos, Solitons & Fractals, Elsevier, vol. 146(C).
    16. Nicholas R. Magliocca, 2020. "Agent-Based Modeling for Integrating Human Behavior into the Food–Energy–Water Nexus," Land, MDPI, vol. 9(12), pages 1-25, December.
    17. Păcurar, Cristina-Maria & Necula, Bogdan-Radu, 2020. "An analysis of COVID-19 spread based on fractal interpolation and fractal dimension," Chaos, Solitons & Fractals, Elsevier, vol. 139(C).
    18. Roland Pongou & Guy Tchuente & Jean-Baptiste Tondji, 2021. "Optimally Targeting Interventions in Networks during a Pandemic: Theory and Evidence from the Networks of Nursing Homes in the United States," Papers 2110.10230, arXiv.org.
    19. Francesco Dottori & Lorenzo Mentaschi & Alessandra Bianchi & Lorenzo Alfieri & Luc Feyen, 2023. "Cost-effective adaptation strategies to rising river flood risk in Europe," Nature Climate Change, Nature, vol. 13(2), pages 196-202, February.
    20. Cem Cakmaklı & Yasin Simsek, 2020. "Bridging the COVID-19 Data and the Epidemiological Model using Time Varying Parameter SIRD Model," Working Paper series 20-23, Rimini Centre for Economic Analysis, revised Feb 2021.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:161:y:2022:i:c:s0960077922005161. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.