IDEAS home Printed from https://ideas.repec.org/a/eee/insuma/v107y2022icp57-67.html
   My bibliography  Save this article

BERT-based NLP techniques for classification and severity modeling in basic warranty data study

Author

Listed:
  • Xu, Shuzhe
  • Zhang, Chuanlong
  • Hong, Don

Abstract

This paper is to explore data-driven models based on a newly developed natural language processing (NLP) tool called Bidirectional Encoder Representations from Transformer (BERT) to incorporate textural data information for group classification and loss amount prediction on truck's basic warranty claims. In group classification modeling, multiple-class logistic regression is compared with BERT-based back-propagation neural networks (NN). In group loss severity modeling, direct NN regression is compared with BERT-based NN regression prediction. Furthermore, based on the results from a so-called optimal bin-width algorithm, the severity distribution is fitted in Gamma and its parameters are then estimated using maximum likelihood estimation (MLE). The data experiments show that the BERT framework for NLP improves the classification of the warranty claims as well as the loss severity prediction both in accuracy and stability.

Suggested Citation

  • Xu, Shuzhe & Zhang, Chuanlong & Hong, Don, 2022. "BERT-based NLP techniques for classification and severity modeling in basic warranty data study," Insurance: Mathematics and Economics, Elsevier, vol. 107(C), pages 57-67.
    • Handle: RePEc:eee:insuma:v:107:y:2022:i:c:p:57-67
    DOI: 10.1016/j.insmatheco.2022.07.013
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167668722000865
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.insmatheco.2022.07.013?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Michael Ludkovski & James Risk, 2017. "Sequential Design and Spatial Modeling for Portfolio Tail Risk Measurement," Papers 1710.05204, arXiv.org, revised May 2018.
    2. Michael Ho & Zheng Sun & Jack Xin, 2015. "Weighted Elastic Net Penalized Mean-Variance Portfolio Design and Computation," Papers 1502.01658, arXiv.org, revised Oct 2015.
    3. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    4. Kevin Kuo, 2018. "DeepTriangle: A Deep Learning Approach to Loss Reserving," Papers 1804.09253, arXiv.org, revised Sep 2019.
    5. Shi, Peng & Feng, Xiaoping & Ivantsova, Anastasia, 2015. "Dependent frequency–severity modeling of insurance claims," Insurance: Mathematics and Economics, Elsevier, vol. 64(C), pages 417-428.
    6. Kevin Kuo, 2019. "DeepTriangle: A Deep Learning Approach to Loss Reserving," Risks, MDPI, vol. 7(3), pages 1-12, September.
    7. Lee, Gee Y & Manski, Scott & Maiti, Tapabrata, 2020. "Actuarial Applications Of Word Embedding Models," ASTIN Bulletin, Cambridge University Press, vol. 50(1), pages 1-24, January.
    8. Garrido, J. & Genest, C. & Schulz, J., 2016. "Generalized linear models for dependent frequency and severity of insurance claims," Insurance: Mathematics and Economics, Elsevier, vol. 70(C), pages 205-215.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Avanzi, Benjamin & Taylor, Greg & Wang, Melantha & Wong, Bernard, 2021. "SynthETIC: An individual insurance claim simulator with feature control," Insurance: Mathematics and Economics, Elsevier, vol. 100(C), pages 296-308.
    2. Ramon Alemany & Catalina Bolancé & Roberto Rodrigo & Raluca Vernic, 2020. "Bivariate Mixed Poisson and Normal Generalised Linear Models with Sarmanov Dependence—An Application to Model Claim Frequency and Optimal Transformed Average Severity," Mathematics, MDPI, vol. 9(1), pages 1-18, December.
    3. Greg Taylor, 2019. "Risks Special Issue on “Granular Models and Machine Learning Models”," Risks, MDPI, vol. 8(1), pages 1-2, December.
    4. Kevin Kuo & Daniel Lupton, 2020. "Towards Explainability of Machine Learning Models in Insurance Pricing," Papers 2003.10674, arXiv.org.
    5. Benjamin Avanzi & Yanfeng Li & Bernard Wong & Alan Xian, 2022. "Ensemble distributional forecasting for insurance loss reserving," Papers 2206.08541, arXiv.org, revised Jun 2024.
    6. Park, Sojung C. & Kim, Joseph H.T. & Ahn, Jae Youn, 2018. "Does hunger for bonuses drive the dependence between claim frequency and severity?," Insurance: Mathematics and Economics, Elsevier, vol. 83(C), pages 32-46.
    7. Jeong, Himchan & Valdez, Emiliano A., 2020. "Predictive compound risk models with dependence," Insurance: Mathematics and Economics, Elsevier, vol. 94(C), pages 182-195.
    8. Peter Nystrup & Henrik Madsen & Erik Lindström, 2018. "Dynamic portfolio optimization across hidden market regimes," Quantitative Finance, Taylor & Francis Journals, vol. 18(1), pages 83-95, January.
    9. Mengyu Yu & Mazie Krehbiel & Samantha Thompson & Tatjana Miljkovic, 2020. "An exploration of gender gap using advanced data science tools: actuarial research community," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 767-789, May.
    10. Gao, Guangyuan & Li, Jiahong, 2023. "Dependence modeling of frequency-severity of insurance claims using waiting time," Insurance: Mathematics and Economics, Elsevier, vol. 109(C), pages 29-51.
    11. Stephan M. Bischofberger, 2020. "In-Sample Hazard Forecasting Based on Survival Models with Operational Time," Risks, MDPI, vol. 8(1), pages 1-17, January.
    12. Dong-Young Lim, 2021. "A Neural Frequency-Severity Model and Its Application to Insurance Claims," Papers 2106.10770, arXiv.org, revised Feb 2024.
    13. Peng Shi & Glenn M. Fung & Daniel Dickinson, 2022. "Assessing hail risk for property insurers with a dependent marked point process," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(1), pages 302-328, January.
    14. Oh, Rosy & Jeong, Himchan & Ahn, Jae Youn & Valdez, Emiliano A., 2021. "A multi-year microlevel collective risk model," Insurance: Mathematics and Economics, Elsevier, vol. 100(C), pages 309-328.
    15. Muhammed Taher Al-Mudafer & Benjamin Avanzi & Greg Taylor & Bernard Wong, 2021. "Stochastic loss reserving with mixture density neural networks," Papers 2108.07924, arXiv.org.
    16. Goffard, Pierre-Olivier & Laub, Patrick J., 2021. "Approximate Bayesian Computations to fit and compare insurance loss models," Insurance: Mathematics and Economics, Elsevier, vol. 100(C), pages 350-371.
    17. Cheung, Eric C.K. & Ni, Weihong & Oh, Rosy & Woo, Jae-Kyung, 2021. "Bayesian credibility under a bivariate prior on the frequency and the severity of claims," Insurance: Mathematics and Economics, Elsevier, vol. 100(C), pages 274-295.
    18. Łukasz Delong & Mario V. Wüthrich, 2020. "Neural Networks for the Joint Development of Individual Payments and Claim Incurred," Risks, MDPI, vol. 8(2), pages 1-34, April.
    19. Denuit, Michel & Lu, Yang, 2020. "Wishart-Gamma mixtures for multiperil experience ratemaking, frequency-severity experience rating and micro-loss reserving," LIDAM Discussion Papers ISBA 2020016, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    20. Laudagé, Christian & Desmettre, Sascha & Wenzel, Jörg, 2019. "Severity modeling of extreme insurance claims for tariffication," Insurance: Mathematics and Economics, Elsevier, vol. 88(C), pages 77-92.

    More about this item

    Keywords

    BERT; Classification; Data-driven; Loss severity; NLP; NN-regression; Warranty policy pricing;
    All these keywords.

    JEL classification:

    • G22 - Financial Economics - - Financial Institutions and Services - - - Insurance; Insurance Companies; Actuarial Studies
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:insuma:v:107:y:2022:i:c:p:57-67. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505554 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.