# pared: Model selection using multi-objective optimization

arXiv: https://arxiv.org/abs/2505.21730 · HTML: https://mlsanity.com/paper/2505.21730/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 4 of its 21 references that are in the map.
- First posted on arXiv 27 May 2025.

## Builds on (most cited first, 4 of 4)

- [Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overview](https://mlsanity.com/paper/2206.07438/) (2022)
- [Fast marginal likelihood estimation of penalties for group-adaptive elastic net](https://mlsanity.com/paper/2101.03875/) (2021)
- [NExUS: Bayesian simultaneous network estimation across unequal sample sizes](https://mlsanity.com/paper/1811.05405/) (2018)
- [A Survey of Tuning Parameter Selection for High-dimensional Regression](https://mlsanity.com/paper/1908.03669/) (2019)

## Abstract (arXiv)

Motivation: Model selection is a ubiquitous challenge in statistics. For penalized models, model selection typically entails tuning hyperparameters to maximize a measure of fit or minimize out-of-sample prediction error. However, these criteria fail to reflect other desirable characteristics, such as model sparsity, interpretability, or smoothness. Results: We present the R package pared to enable the use of multi-objective optimization for model selection. Our approach entails the use of Gaussian process-based optimization to efficiently identify solutions that represent desirable trade-offs. Our implementation includes popular models with multiple objectives including the elastic net, fused lasso, fused graphical lasso, and group graphical lasso. Our R package generates interactive graphics that allow the user to identify hyperparameter values that result in fitted models which lie on the Pareto frontier. Availability: We provide the R package pared and vignettes illustrating its application to both simulated and real data at https://github.com/priyamdas2/pared.
