# Robust and sparse support vector machine via hybrid truncated loss for supervised classification

arXiv: https://arxiv.org/abs/2606.05814 · HTML: https://mlsanity.com/paper/2606.05814/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 3 of its 38 references that are in the map.
- First posted on arXiv 4 Jun 2026.

## Builds on (most cited first, 3 of 3)

- [Katyusha: The First Direct Acceleration of Stochastic Gradient Methods](https://mlsanity.com/paper/1603.05953/) (2016)
- [Enhancing Multiview Synergy: Robust Learning by Exploiting the Wave Loss Function with Consensus and Complementarity Principles](https://mlsanity.com/paper/2408.06819/) (2024)
- [A Semismooth Newton Method for Support Vector Classification and Regression](https://mlsanity.com/paper/1903.00249/) (2019)

## Abstract (arXiv)

The support vector machine (SVM) is a widely used classifier, but choosing an appropriate loss function remains difficult. Convex losses such as the hinge loss and least-squares loss are sensitive to outliers, while bounded non-convex losses often lead to high computational cost. To address this, we propose a hybrid truncated loss function (Lht) that is both sparse and bounded, and build the Lht-SVM model for single-view classification. We introduce the P-stationary point and use it to establish the first-order necessary and sufficient optimality conditions. Based on these conditions, we design an alternating direction method of multipliers with a working-set strategy that reduces computational cost and achieves global convergence. We further extend Lht-SVM to multi-view learning by adding structural information and view weights, resulting in MvLht-SVM, which follows both the consensus and complementarity principles. Experiments on synthetic, real-world, and image datasets show that Lht-SVM achieves higher accuracy with fewer support vectors and better noise robustness than five single-view methods, while MvLht-SVM outperforms six multi-view methods in accuracy, precision, recall, and F1-score.