# Representer Theorems for Metric and Preference Learning: Geometric Insights and Algorithms

arXiv: https://arxiv.org/abs/2304.03720 · HTML: https://mlsanity.com/paper/2304.03720/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 11 of its 46 references that are in the map.
- First posted on arXiv 7 Apr 2023.

## Builds on (most cited first, 11 of 11)

- [Training language models to follow instructions with human feedback](https://mlsanity.com/paper/2203.02155/) (2022)
- [A Survey on Metric Learning for Feature Vectors and Structured Data](https://mlsanity.com/paper/1306.6709/) (2013)
- [Finite Sample Prediction and Recovery Bounds for Ordinal Embedding](https://mlsanity.com/paper/1606.07081/) (2016)
- [Simultaneous Preference and Metric Learning from Paired Comparisons](https://mlsanity.com/paper/2009.02302/) (2020)
- [Spectral, Probabilistic, and Deep Metric Learning: Tutorial and Survey](https://mlsanity.com/paper/2201.09267/) (2022)
- [Spectral Ranking using Seriation](https://mlsanity.com/paper/1406.5370/) (2014)
- [Learning Low-Dimensional Metrics](https://mlsanity.com/paper/1709.06171/) (2017)
- [Spectral Ranking with Covariates](https://mlsanity.com/paper/2005.04035/) (2020)
- [As you like it: Localization via paired comparisons](https://mlsanity.com/paper/1802.10489/) (2018)
- [One for All: Simultaneous Metric and Preference Learning over Multiple Users](https://mlsanity.com/paper/2207.03609/) (2022)
- [Spectral Methods for Ranking with Scarce Data](https://mlsanity.com/paper/2007.01346/) (2020)

## Abstract (arXiv)

We develop a mathematical framework to address a broad class of metric and preference learning problems within a Hilbert space. We obtain a novel representer theorem for the simultaneous task of metric and preference learning. Our key observation is that the representer theorem for this task can be derived by regularizing the problem with respect to the norm inherent in the task structure. For the general task of metric learning, our framework leads to a simple and self-contained representer theorem and offers new geometric insights into the derivation of representer theorems for this task. In the case of Reproducing Kernel Hilbert Spaces (RKHSs), we illustrate how our representer theorem can be used to express the solution of the learning problems in terms of finite kernel terms similar to classical representer theorems. Lastly, our representer theorem leads to a novel nonlinear algorithm for metric and preference learning. We compare our algorithm against challenging baseline methods on real-world rank inference benchmarks, where it achieves competitive performance. Notably, our approach significantly outperforms vanilla ideal point methods and surpasses strong baselines across multiple datasets. Code available at: https://github.com/PeymanMorteza/Metric-Preference-Learning-RKHS