# Smoothing parameter and model selection for general smooth models

arXiv: https://arxiv.org/abs/1511.03864 · HTML: https://mlsanity.com/paper/1511.03864/

## Key facts

- Cited by 23 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Nov 2015.

## Built on by (most cited first, 23 of 23)

- [Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting](https://mlsanity.com/paper/2309.07034/) (2023)
- [Human Interpretation of Saliency-based Explanation Over Text](https://mlsanity.com/paper/2201.11569/) (2022)
- [Word-specific tonal realizations in Mandarin](https://mlsanity.com/paper/2405.07006/) (2024)
- [Reliability Analysis of Artificial Intelligence Systems Using Recurrent Events Data from Autonomous Vehicles](https://mlsanity.com/paper/2102.01740/) (2021)
- [A Large-Scale Neutral Comparison Study of Survival Models on Low-Dimensional Data](https://mlsanity.com/paper/2406.04098/) (2024)
- [Daily peak electrical load forecasting with a multi-resolution approach](https://mlsanity.com/paper/2112.04492/) (2021)
- [Non-Parametric Learning of Stochastic Differential Equations with Non-asymptotic Fast Rates of Convergence](https://mlsanity.com/paper/2305.15557/) (2023)
- [Functional additive models on manifolds of planar shapes and forms](https://mlsanity.com/paper/2109.02624/) (2021)
- [Robust Brain MRI Image Classification with SIBOW-SVM](https://mlsanity.com/paper/2311.08908/) (2023)
- [Computational Sentence-level Metrics Predicting Human Sentence Comprehension](https://mlsanity.com/paper/2403.15822/) (2024)
- [Leveraging Graph Neural Networks to Forecast Electricity Consumption](https://mlsanity.com/paper/2408.17366/) (2024)
- [Generalized Kernel Regularized Least Squares](https://mlsanity.com/paper/2209.14355/) (2022)
- [Additive Covariance Matrix Models: Modelling Regional Electricity Net-Demand in Great Britain](https://mlsanity.com/paper/2211.07451/) (2022)
- [Autocart -- spatially-aware regression trees for ecological and spatial modeling](https://mlsanity.com/paper/2101.08258/) (2021)
- [Privacy-Preserving and Lossless Distributed Estimation of High-Dimensional Generalized Additive Mixed Models](https://mlsanity.com/paper/2210.07723/) (2022)
- [Personalised dynamic super learning: an application in predicting hemodiafiltration convection volumes](https://mlsanity.com/paper/2310.08479/) (2023)
- [Constrained C-Test Generation via Mixed-Integer Programming](https://mlsanity.com/paper/2404.08821/) (2024)
- [The Roles of Contextual Semantic Relevance Metrics in Human Visual Processing](https://mlsanity.com/paper/2410.09921/) (2024)
- [Assessing Surrogate Heterogeneity in Real World Data Using Meta-Learners](https://mlsanity.com/paper/2504.15386/) (2025)
- [Modelling non-stationary extremal dependence through a geometric approach](https://mlsanity.com/paper/2509.22501/) (2025)
- [Mapping Drivers of Greenness: Spatial Variable Selection for MODIS Vegetation Indices](https://mlsanity.com/paper/2602.07681/) (2026)
- [Spatially Aware Deep Learning for Microclimate Prediction from High-Resolution Geospatial Imagery](https://mlsanity.com/paper/2603.13273/) (2026)
- [KAPLAN: Kolmogorov-Arnold Prognostic Learnable Activation Networks for Survival Analysis](https://mlsanity.com/paper/2605.23082/) (2026)

## Abstract (arXiv)

This paper discusses a general framework for smoothing parameter estimation for models with regular likelihoods constructed in terms of unknown smooth functions of covariates. Gaussian random effects and parametric terms may also be present. By construction the method is numerically stable and convergent, and enables smoothing parameter uncertainty to be quantified. The latter enables us to fix a well known problem with AIC for such models. The smooth functions are represented by reduced rank spline like smoothers, with associated quadratic penalties measuring function smoothness. Model estimation is by penalized likelihood maximization, where the smoothing parameters controlling the extent of penalization are estimated by Laplace approximate marginal likelihood. The methods cover, for example, generalized additive models for non-exponential family responses (for example beta, ordered categorical, scaled t distribution, negative binomial and Tweedie distributions), generalized additive models for location scale and shape (for example two stage zero inflation models, and Gaussian location-scale models), Cox proportional hazards models and multivariate additive models. The framework reduces the implementation of new model classes to the coding of some standard derivatives of the log likelihood.