# Penalized Weighted Least Squares for Outlier Detection and Robust Regression

arXiv: https://arxiv.org/abs/1603.07427 · HTML: https://mlsanity.com/paper/1603.07427/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Mar 2016.

## Built on by (most cited first, 2 of 2)

- [Robust Neural Network Classification via Double Regularization](https://mlsanity.com/paper/2112.08102/) (2021)
- [Robust PCA Based on Adaptive Weighted Least Squares and Low-Rank Matrix Factorization](https://mlsanity.com/paper/2412.14629/) (2024)

## Abstract (arXiv)

To conduct regression analysis for data contaminated with outliers, many approaches have been proposed for simultaneous outlier detection and robust regression, so is the approach proposed in this manuscript. This new approach is called "penalized weighted least squares" (PWLS). By assigning each observation an individual weight and incorporating a lasso-type penalty on the log-transformation of the weight vector, the PWLS is able to perform outlier detection and robust regression simultaneously. A Bayesian point-of-view of the PWLS is provided, and it is showed that the PWLS can be seen as an example of M-estimation. Two methods are developed for selecting the tuning parameter in the PWLS. The performance of the PWLS is demonstrated via simulations and real applications.