IDEAS home Printed from https://ideas.repec.org/a/pal/gpprii/v49y2024i2d10.1057_s41288-024-00320-5.html
   My bibliography  Save this article

Machine learning in long-term mortality forecasting

Author

Listed:
  • Yang Qiao

    (National Sun Yat-Sen University)

  • Chou-Wen Wang

    (National Sun Yat-Sen University)

  • Wenjun Zhu

    (Nanyang Technological University)

Abstract

We propose a new machine learning-based framework for long-term mortality forecasting. Based on ideas of neighboring prediction, model ensembling, and tree boosting, this framework can significantly improve the prediction accuracy of long-term mortality. In addition, the proposed framework addresses the challenge of a shrinking pattern in long-term forecasting with information from neighboring ages and cohorts. An extensive empirical analysis is conducted using various countries and regions in the Human Mortality Database. Results show that this framework reduces the mean absolute percentage error (MAPE) of the 20-year forecasting by almost 50% compared to classic stochastic mortality models, and it also outperforms deep learning-based benchmarks. Moreover, including mortality data from multiple populations can further enhance the long-term prediction performance of this framework.

Suggested Citation

  • Yang Qiao & Chou-Wen Wang & Wenjun Zhu, 2024. "Machine learning in long-term mortality forecasting," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 49(2), pages 340-362, April.
  • Handle: RePEc:pal:gpprii:v:49:y:2024:i:2:d:10.1057_s41288-024-00320-5
    DOI: 10.1057/s41288-024-00320-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41288-024-00320-5
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1057/s41288-024-00320-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Makariou, Despoina & Barrieu, Pauline & Chen, Yining, 2021. "A random forest based approach for predicting spreads in the primary catastrophe bond market," Insurance: Mathematics and Economics, Elsevier, vol. 101(PB), pages 140-162.
    2. Richman, Ronald, 2021. "AI in actuarial science – a review of recent advances – part 2," Annals of Actuarial Science, Cambridge University Press, vol. 15(2), pages 230-258, July.
    3. Carbonneau, Alexandre, 2021. "Deep hedging of long-term financial derivatives," Insurance: Mathematics and Economics, Elsevier, vol. 99(C), pages 327-340.
    4. Farkas, Sébastien & Lopez, Olivier & Thomas, Maud, 2021. "Cyber claim analysis using Generalized Pareto regression trees with applications to insurance," Insurance: Mathematics and Economics, Elsevier, vol. 98(C), pages 92-105.
    5. Andrea Gabrielli & Mario V. Wüthrich, 2018. "An Individual Claims History Simulation Machine," Risks, MDPI, vol. 6(2), pages 1-32, March.
    6. Jarner, Søren Fiig & Kryger, Esben Masotti, 2011. "Modelling Adult Mortality in Small Populations: The Saint Model," ASTIN Bulletin, Cambridge University Press, vol. 41(2), pages 377-418, November.
    7. Li, Johnny Siu-Hang & Liu, Yanxin, 2020. "The heat wave model for constructing two-dimensional mortality improvement scales with measures of uncertainty," Insurance: Mathematics and Economics, Elsevier, vol. 93(C), pages 1-26.
    8. Zhou, Kenneth Q. & Li, Johnny Siu-Hang, 2020. "Asymmetry in mortality volatility and its implications on index-based longevity hedging," Annals of Actuarial Science, Cambridge University Press, vol. 14(2), pages 278-301, September.
    9. Kevin Dowd & Andrew Cairns & David Blake & Guy Coughlan & Marwa Khalaf-Allah, 2011. "A Gravity Model of Mortality Rates for Two Related Populations," North American Actuarial Journal, Taylor & Francis Journals, vol. 15(2), pages 334-356.
    10. Andrea Nigri & Susanna Levantesi & Mario Marino & Salvatore Scognamiglio & Francesca Perla, 2019. "A Deep Learning Integrated Lee–Carter Model," Risks, MDPI, vol. 7(1), pages 1-16, March.
    11. Mario Marino & Susanna Levantesi & Andrea Nigri, 2023. "A Neural Approach to Improve the Lee-Carter Mortality Density Forecasts," North American Actuarial Journal, Taylor & Francis Journals, vol. 27(1), pages 148-165, January.
    12. Johnny Siu-Hang Li & Jackie Li & Uditha Balasooriya & Kenneth Q. Zhou, 2021. "Constructing Out-of-the-Money Longevity Hedges Using Parametric Mortality Indexes," North American Actuarial Journal, Taylor & Francis Journals, vol. 25(S1), pages 341-372, February.
    13. Fissler, Tobias & Merz, Michael & Wüthrich, Mario V., 2023. "Deep quantile and deep composite triplet regression," Insurance: Mathematics and Economics, Elsevier, vol. 109(C), pages 94-112.
    14. Susanna Levantesi & Virginia Pizzorusso, 2019. "Application of Machine Learning to Mortality Modeling and Forecasting," Risks, MDPI, vol. 7(1), pages 1-19, February.
    15. Devriendt, Sander & Antonio, Katrien & Reynkens, Tom & Verbelen, Roel, 2021. "Sparse regression with Multi-type Regularized Feature modeling," Insurance: Mathematics and Economics, Elsevier, vol. 96(C), pages 248-261.
    16. Andrew Cairns & David Blake & Kevin Dowd & Guy Coughlan & David Epstein & Alen Ong & Igor Balevich, 2009. "A Quantitative Comparison of Stochastic Mortality Models Using Data From England and Wales and the United States," North American Actuarial Journal, Taylor & Francis Journals, vol. 13(1), pages 1-35.
    17. Rui Zhou & Johnny Siu-Hang Li & Ken Seng Tan, 2013. "Pricing Standardized Mortality Securitizations: A Two-Population Model With Transitory Jump Effects," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 80(3), pages 733-774, September.
    18. Johnny Siu-Hang Li & Wai-Sum Chan & Rui Zhou, 2017. "Semicoherent Multipopulation Mortality Modeling: The Impact on Longevity Risk Securitization," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 84(3), pages 1025-1065, September.
    19. Azar Ghahari & Nathaniel K. Newlands & Vyacheslav Lyubchich & Yulia R. Gel, 2019. "Deep Learning at the Interface of Agricultural Insurance Risk and Spatio-Temporal Uncertainty in Weather Extremes," North American Actuarial Journal, Taylor & Francis Journals, vol. 23(4), pages 535-550, October.
    20. Basak, Suryoday & Kar, Saibal & Saha, Snehanshu & Khaidem, Luckyson & Dey, Sudeepa Roy, 2019. "Predicting the direction of stock market prices using tree-based classifiers," The North American Journal of Economics and Finance, Elsevier, vol. 47(C), pages 552-567.
    21. Wang, Chou-Wen & Yang, Sharon S. & Huang, Hong-Chih, 2015. "Modeling multi-country mortality dependence and its application in pricing survivor index swaps—A dynamic copula approach," Insurance: Mathematics and Economics, Elsevier, vol. 63(C), pages 30-39.
    22. Iain D. Currie, 2016. "On fitting generalized linear and non-linear models of mortality," Scandinavian Actuarial Journal, Taylor & Francis Journals, vol. 2016(4), pages 356-383, April.
    23. C. Brock Porth & Lysa Porth & Wenjun Zhu & Milton Boyd & Ken Seng Tan & Kai Liu, 2020. "Remote Sensing Applications for Insurance: A Predictive Model for Pasture Yield in the Presence of Systemic Weather," North American Actuarial Journal, Taylor & Francis Journals, vol. 24(2), pages 333-354, April.
    24. Blake, David & Cairns, Andrew J.G., 2021. "Longevity risk and capital markets: The 2019-20 update," Insurance: Mathematics and Economics, Elsevier, vol. 99(C), pages 395-439.
    25. Andrew J. G. Cairns & David Blake & Kevin Dowd, 2006. "A Two‐Factor Model for Stochastic Mortality with Parameter Uncertainty: Theory and Calibration," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 73(4), pages 687-718, December.
    26. Chamal Gomes & Zhuo Jin & Hailiang Yang, 2021. "Insurance fraud detection with unsupervised deep learning," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 88(3), pages 591-624, September.
    27. Simon C. K. Lee & Sheldon Lin, 2018. "Delta Boosting Machine with Application to General Insurance," North American Actuarial Journal, Taylor & Francis Journals, vol. 22(3), pages 405-425, July.
    28. Hu, Changyue & Quan, Zhiyu & Chong, Wing Fung, 2022. "Imbalanced learning for insurance using modified loss functions in tree-based models," Insurance: Mathematics and Economics, Elsevier, vol. 106(C), pages 13-32.
    29. Wang, Chou-Wen & Zhang, Jinggong & Zhu, Wenjun, 2021. "Neighbouring Prediction For Mortality," ASTIN Bulletin, Cambridge University Press, vol. 51(3), pages 689-718, September.
    30. Miyata, Akihiro & Matsuyama, Naoki, 2022. "Extending The Lee–Carter Model With Variational Autoencoder: A Fusion Of Neural Network And Bayesian Approach," ASTIN Bulletin, Cambridge University Press, vol. 52(3), pages 789-812, September.
    31. Bjerre, Dorethe Skovgaard, 2022. "Tree-Based Machine Learning Methods For Modeling And Forecasting Mortality," ASTIN Bulletin, Cambridge University Press, vol. 52(3), pages 765-787, September.
    32. David Blake & Richard MacMinn, 2020. "Longevity Risk and Capital Markets: The 2016–2017 Update," North American Actuarial Journal, Taylor & Francis Journals, vol. 25(S1), pages 1-6, December.
    33. Zhou, Rui & Ji, Min, 2021. "Modelling mortality dependence: An application of dynamic vine copula," Insurance: Mathematics and Economics, Elsevier, vol. 99(C), pages 241-255.
    34. Jin, Zhuo & Yang, Hailiang & Yin, G., 2021. "A hybrid deep learning method for optimal insurance strategies: Algorithms and convergence analysis," Insurance: Mathematics and Economics, Elsevier, vol. 96(C), pages 262-275.
    35. Kevin Kuo, 2018. "DeepTriangle: A Deep Learning Approach to Loss Reserving," Papers 1804.09253, arXiv.org, revised Sep 2019.
    36. Li, Hong & Tan, Ken Seng & Tuljapurkar, Shripad & Zhu, Wenjun, 2021. "Gompertz law revisited: Forecasting mortality with a multi-factor exponential model," Insurance: Mathematics and Economics, Elsevier, vol. 99(C), pages 268-281.
    37. Hainaut, Donatien, 2018. "A Neural-Network Analyzer For Mortality Forecast," ASTIN Bulletin, Cambridge University Press, vol. 48(2), pages 481-508, May.
    38. Andrea Gabrielli & Ronald Richman & Mario V. Wüthrich, 2020. "Neural network embedding of the over-dispersed Poisson reserving model," Scandinavian Actuarial Journal, Taylor & Francis Journals, vol. 2020(1), pages 1-29, January.
    39. Guangyuan Gao & Shengwang Meng & Mario V. Wüthrich, 2019. "Claims frequency modeling using telematics car driving data," Scandinavian Actuarial Journal, Taylor & Francis Journals, vol. 2019(2), pages 143-162, February.
    40. Al-Mudafer, Muhammed Taher & Avanzi, Benjamin & Taylor, Greg & Wong, Bernard, 2022. "Stochastic loss reserving with mixture density neural networks," Insurance: Mathematics and Economics, Elsevier, vol. 105(C), pages 144-174.
    41. Lally, Nathan & Hartman, Brian, 2018. "Estimating loss reserves using hierarchical Bayesian Gaussian process regression with input warping," Insurance: Mathematics and Economics, Elsevier, vol. 82(C), pages 124-140.
    42. Richman, Ronald, 2021. "AI in actuarial science – a review of recent advances – part 1," Annals of Actuarial Science, Cambridge University Press, vol. 15(2), pages 207-229, July.
    43. Hainaut, Donatien, 2018. "A Neural-Network Analyzer for Mortality Forecast," LIDAM Reprints ISBA 2018027, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    44. Yumo Dong & Fei Huang & Honglin Yu & Steven Haberman, 2020. "Multi-population mortality forecasting using tensor decomposition," Scandinavian Actuarial Journal, Taylor & Francis Journals, vol. 2020(8), pages 754-775, September.
    45. Roel Henckaerts & Marie-Pier Côté & Katrien Antonio & Roel Verbelen, 2021. "Boosting Insights in Insurance Tariff Plans with Tree-Based Machine Learning Methods," North American Actuarial Journal, Taylor & Francis Journals, vol. 25(2), pages 255-285, April.
    46. Kenneth Q. Zhou & Johnny Siu-Hang Li, 2021. "Longevity Greeks: What Do Insurers and Capital Market Investors Need to Know?," North American Actuarial Journal, Taylor & Francis Journals, vol. 25(S1), pages 66-96, February.
    47. Liqun Diao & Chengguo Weng, 2019. "Regression Tree Credibility Model," North American Actuarial Journal, Taylor & Francis Journals, vol. 23(2), pages 169-196, April.
    48. Andrea Nigri & Susanna Levantesi & Mario Marino, 2021. "Life expectancy and lifespan disparity forecasting: a long short-term memory approach," Scandinavian Actuarial Journal, Taylor & Francis Journals, vol. 2021(2), pages 110-133, February.
    49. repec:cup:bracjl:v:27:y:2022:i::p:-_21 is not listed on IDEAS
    50. Li, Yuying & Forsyth, Peter A., 2019. "A data-driven neural network approach to optimal asset allocation for target based defined contribution pension plans," Insurance: Mathematics and Economics, Elsevier, vol. 86(C), pages 189-204.
    51. Lopez, Olivier & Milhaud, Xavier & Thérond, Pierre-E., 2019. "A Tree-Based Algorithm Adapted To Microlevel Reserving And Long Development Claims," ASTIN Bulletin, Cambridge University Press, vol. 49(3), pages 741-762, September.
    52. David Blake & Richard MacMinn & Jason Chenghsien Tsai & Jennifer Wang, 2020. "Longevity Risk and Capital Markets: The 2017–2018 Update," North American Actuarial Journal, Taylor & Francis Journals, vol. 25(S1), pages 280-308, December.
    53. Renshaw, A.E. & Haberman, S., 2006. "A cohort-based extension to the Lee-Carter model for mortality reduction factors," Insurance: Mathematics and Economics, Elsevier, vol. 38(3), pages 556-570, June.
    54. Renshaw, A. E. & Haberman, S., 2003. "Lee-Carter mortality forecasting with age-specific enhancement," Insurance: Mathematics and Economics, Elsevier, vol. 33(2), pages 255-272, October.
    55. Loisel, Stéphane & Piette, Pierrick & Tsai, Cheng-Hsien Jason, 2021. "Applying Economic Measures To Lapse Risk Management With Machine Learning Approaches," ASTIN Bulletin, Cambridge University Press, vol. 51(3), pages 839-871, September.
    56. G'abor Petneh'azi & J'ozsef G'all, 2019. "Mortality rate forecasting: can recurrent neural networks beat the Lee-Carter model?," Papers 1909.05501, arXiv.org, revised Oct 2019.
    57. Philippe Deprez & Pavel V. Shevchenko & Mario V. Wuthrich, 2017. "Machine Learning Techniques for Mortality Modeling," Papers 1705.03396, arXiv.org.
    58. Shuo-Li Chuang & Patrick Brockett, 2014. "Modeling and Pricing Longevity Derivatives Using Stochastic Mortality Rates and the Esscher Transform," North American Actuarial Journal, Taylor & Francis Journals, vol. 18(1), pages 22-37.
    59. Yijia Lin & Samuel H. Cox, 2005. "Securitization of Mortality Risks in Life Annuities," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 72(2), pages 227-252, June.
    60. Meng, Shengwang & Gao, Yaqian & Huang, Yifan, 2022. "Actuarial intelligence in auto insurance: Claim frequency modeling with driving behavior features and improved boosted trees," Insurance: Mathematics and Economics, Elsevier, vol. 106(C), pages 115-127.
    61. Francesca Perla & Ronald Richman & Salvatore Scognamiglio & Mario V. Wüthrich, 2021. "Time-series forecasting of mortality rates using deep learning," Scandinavian Actuarial Journal, Taylor & Francis Journals, vol. 2021(7), pages 572-598, August.
    62. Cairns, Andrew J.G. & Blake, David & Dowd, Kevin & Coughlan, Guy D. & Khalaf-Allah, Marwa, 2011. "Bayesian Stochastic Mortality Modelling for Two Populations," ASTIN Bulletin, Cambridge University Press, vol. 41(1), pages 29-59, May.
    63. Johnny Li & Mary Hardy, 2011. "Measuring Basis Risk in Longevity Hedges," North American Actuarial Journal, Taylor & Francis Journals, vol. 15(2), pages 177-200.
    64. Samuel H. Cox & Yijia Lin & Shaun Wang, 2006. "Multivariate Exponential Tilting and Pricing Implications for Mortality Securitization," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 73(4), pages 719-736, December.
    65. Schnürch, Simon & Korn, Ralf, 2022. "Point And Interval Forecasts Of Death Rates Using Neural Networks," ASTIN Bulletin, Cambridge University Press, vol. 52(1), pages 333-360, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Blake, David & Cairns, Andrew J.G., 2021. "Longevity risk and capital markets: The 2019-20 update," Insurance: Mathematics and Economics, Elsevier, vol. 99(C), pages 395-439.
    2. Hung-Tsung Hsiao & Chou-Wen Wang & I.-Chien Liu & Ko-Lun Kung, 2024. "Mortality improvement neural-network models with autoregressive effects," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 49(2), pages 363-383, April.
    3. Blake, David & El Karoui, Nicole & Loisel, Stéphane & MacMinn, Richard, 2018. "Longevity risk and capital markets: The 2015–16 update," Insurance: Mathematics and Economics, Elsevier, vol. 78(C), pages 157-173.
    4. Francesca Perla & Salvatore Scognamiglio, 2023. "Locally-coherent multi-population mortality modelling via neural networks," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 46(1), pages 157-176, June.
    5. Corsaro, Stefania & Marino, Zelda & Scognamiglio, Salvatore, 2024. "Quantile mortality modelling of multiple populations via neural networks," Insurance: Mathematics and Economics, Elsevier, vol. 116(C), pages 114-133.
    6. Ahmadi, Seyed Saeed & Li, Johnny Siu-Hang, 2014. "Coherent mortality forecasting with generalized linear models: A modified time-transformation approach," Insurance: Mathematics and Economics, Elsevier, vol. 59(C), pages 194-221.
    7. Katrien Antonio & Anastasios Bardoutsos & Wilbert Ouburg, 2015. "Bayesian Poisson log-bilinear models for mortality projections with multiple populations," Working Papers Department of Accountancy, Finance and Insurance (AFI), Leuven 485564, KU Leuven, Faculty of Economics and Business (FEB), Department of Accountancy, Finance and Insurance (AFI), Leuven.
    8. Basellini, Ugofilippo & Camarda, Carlo Giovanni & Booth, Heather, 2023. "Thirty years on: A review of the Lee–Carter method for forecasting mortality," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1033-1049.
    9. Yang, Sharon S. & Wang, Chou-Wen, 2013. "Pricing and securitization of multi-country longevity risk with mortality dependence," Insurance: Mathematics and Economics, Elsevier, vol. 52(2), pages 157-169.
    10. David Blake & Marco Morales & Enrico Biffis & Yijia Lin & Andreas Milidonis, 2017. "Special Edition: Longevity 10 – The Tenth International Longevity Risk and Capital Markets Solutions Conference," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 84(S1), pages 515-532, April.
    11. Chen, Hua & MacMinn, Richard & Sun, Tao, 2015. "Multi-population mortality models: A factor copula approach," Insurance: Mathematics and Economics, Elsevier, vol. 63(C), pages 135-146.
    12. Hunt, Andrew & Blake, David, 2015. "Modelling longevity bonds: Analysing the Swiss Re Kortis bond," Insurance: Mathematics and Economics, Elsevier, vol. 63(C), pages 12-29.
    13. David Atance & Ana Debón & Eliseo Navarro, 2020. "A Comparison of Forecasting Mortality Models Using Resampling Methods," Mathematics, MDPI, vol. 8(9), pages 1-21, September.
    14. Li, Johnny Siu-Hang & Zhou, Rui & Hardy, Mary, 2015. "A step-by-step guide to building two-population stochastic mortality models," Insurance: Mathematics and Economics, Elsevier, vol. 63(C), pages 121-134.
    15. Bravo, Jorge M. & Ayuso, Mercedes & Holzmann, Robert & Palmer, Edward, 2023. "Intergenerational actuarial fairness when longevity increases: Amending the retirement age," Insurance: Mathematics and Economics, Elsevier, vol. 113(C), pages 161-184.
    16. Basellini, Ugofilippo & Camarda, Carlo Giovanni & Booth, Heather, 2022. "Thirty years on: A review of the Lee-Carter method for forecasting mortality," SocArXiv 8u34d, Center for Open Science.
    17. Boumezoued, Alexandre & Elfassihi, Amal, 2021. "Mortality data correction in the absence of monthly fertility records," Insurance: Mathematics and Economics, Elsevier, vol. 99(C), pages 486-508.
    18. Alexandre Boumezoued & Amal Elfassihi, 2020. "Mortality data correction in the absence of monthly fertility records," Working Papers hal-02634631, HAL.
    19. de Jong, Piet & Tickle, Leonie & Xu, Jianhui, 2016. "Coherent modeling of male and female mortality using Lee–Carter in a complex number framework," Insurance: Mathematics and Economics, Elsevier, vol. 71(C), pages 130-137.
    20. Liu, Yanxin & Li, Johnny Siu-Hang, 2016. "It’s all in the hidden states: A longevity hedging strategy with an explicit measure of population basis risk," Insurance: Mathematics and Economics, Elsevier, vol. 70(C), pages 301-319.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:gpprii:v:49:y:2024:i:2:d:10.1057_s41288-024-00320-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.