Neural networks for insurance pricing with frequency and severity data: a benchmark study from data preprocessing to technical tariff
Not on the map. Why?
Abstract (arXiv)
Insurers usually turn to generalized linear models for modeling claim frequency and severity data. Due to their success in other fields, machine learning techniques are gaining popularity within the actuarial toolbox. Our paper contributes to the literature on frequency-severity insurance pricing with machine learning via deep learning structures. We present a benchmark study on four insurance data sets with frequency and severity targets in the presence of multiple types of input features. We compare in detail the performance of: a generalized linear model on binned input data, a gradient-boosted tree model, a feed-forward neural network (FFNN), and the combined actuarial neural network (CANN). The CANNs combine a baseline prediction established with a GLM and GBM, respectively, with a neural network correction. We explain the data preprocessing steps with specific focus on the multiple types of input features typically present in tabular insurance data sets, such as postal codes, numeric and categorical covariates. Autoencoders are used to embed the categorical variables into the neural network, and we explore their potential advantages in a frequency-severity setting. Model performance is evaluated not only on out-of-sample deviance but also using statistical and calibration performance criteria and managerial tools to get more nuanced insights. Finally, we construct global surrogate models for the neural nets' frequency and severity models. These surrogates enable the translation of the essential insights captured by the FFNNs or CANNs to GLMs. As such, a technical tariff table results that can easily be deployed in practice.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 11 of its 62 references that are in the map. First posted on arXiv 19 Oct 2023.
Builds on
11 of 62 references.
References · 11
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,337
- 2021Tabular Data: Deep Learning is Not All You Needcited by 530
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
- 2016Entity Embeddings of Categorical Variablescited by 85
- 2021Regression Diagnostics meets Forecast Evaluation: Conditional Calibration, Reliability Diagrams, and Coefficient of Determinationcited by 31
- 2015Of Quantiles and Expectiles: Consistent Scoring Functions, Choquet Representations, and Forecast Rankingscited by 28
- 2021Autocalibration and Tweedie-dominance for Insurance Pricing with Machine Learningcited by 18
- 2019Boosting insights in insurance tariff plans with tree-based machine learning methodscited by 17
- 2015Insurance Premium Prediction via Gradient Tree-Boosted Tweedie Compound Poisson Modelscited by 11
- 2022Model Comparison and Calibration Assessment: User Guide for Consistent Scoring Functions in Machine Learning and Actuarial Practicecited by 11
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 3; 2026: 2.
7 papers.
- 2023Enhancing Actuarial Non-Life Pricing Models via Transformerscited by 6
- 2024From Point to probabilistic gradient boosting for claim frequency and severity predictioncited by 1
- 2025Explainable Boosting Machine for Predicting Claim Severity and Frequency in Car Insurancecited by 0
- 2025Model Monitoring: A General Framework with an Application to Non-life Insurance Pricingcited by 0
- 2025A multi-view contrastive learning framework for spatial embeddings in risk modellingcited by 0
- 2026Revealing Geography-Driven Signals in Zone-Level Claim Frequency Models: An Empirical Study using Environmental and Visual Predictorscited by 0
- 2026Is TabPFN the Silver Bullet for Insurance Pricing?cited by 0
- 2026Is TabPFN the Silver Bullet for Insurance Pricing?21 May 2026
- 2026Revealing Geography-Driven Signals in Zone-Level Claim Frequency Models: An Empirical Study using Environmental and Visual Predictors23 Apr 2026
- 2025A multi-view contrastive learning framework for spatial embeddings in risk modelling22 Nov 2025
- 2025Model Monitoring: A General Framework with an Application to Non-life Insurance Pricing6 Oct 2025
- 2025Explainable Boosting Machine for Predicting Claim Severity and Frequency in Car Insurance27 Mar 2025
- 2024From Point to probabilistic gradient boosting for claim frequency and severity prediction19 Dec 2024
- 2023Enhancing Actuarial Non-Life Pricing Models via Transformers10 Nov 2023