# An Algorithm to perform Covariance-Adjusted Support Vector Classification in Non-Euclidean Spaces

arXiv: https://arxiv.org/abs/2504.04371 · HTML: https://mlsanity.com/paper/2504.04371/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 1 of its 20 references that are in the map.
- First posted on arXiv 6 Apr 2025.

## Builds on (most cited first, 1 of 1)

- [Variance-Adjusted Cosine Distance as Similarity Metric](https://mlsanity.com/paper/2502.02233/) (2025)

## Abstract (arXiv)

Traditional Support Vector Machine (SVM) classification is carried out by finding the max-margin classifier for the training data that divides the margin space into two equal sub-spaces. This study demonstrates limitations of performing Support Vector Classification in non-Euclidean spaces by establishing that the underlying principle of max-margin classification and Karush Kuhn Tucker (KKT) boundary conditions are optimal only in the Euclidean vector spaces. The study establishes a methodology to perform Support Vector Classification in Non-Euclidean Spaces by incorporating data covariance into the optimization problem using Cholesky Decomposition of respective class covariance structure. It also demonstrates that in non-Euclidean spaces KKT modelling is sub-optimal as the principle of maximum margin is a function of intra-class data covariances and the classifier obtained separates the margin space in ratio of the respective class population covariance matrix. The study proposes an algorithm to iteratively estimate the population covariance-adjusted SVM classifier in non-Euclidean space from sample covariance matrices of the training data. The effectiveness of this SVM classification approach is demonstrated by applying the classifier on multiple datasets and comparing the performance with traditional SVM kernels and whitening algorithms. The Cholesky-SVM model shows marked improvement in the accuracy, precision, F1 scores and ROC performance compared to linear and other kernel SVMs.