# MLPlatt: Simple Calibration Framework for Ranking Models

arXiv: https://arxiv.org/abs/2601.08345 · HTML: https://mlsanity.com/paper/2601.08345/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 11 of its 23 references that are in the map.
- First posted on arXiv 13 Jan 2026.

## Builds on (most cited first, 11 of 11)

- [On Calibration of Modern Neural Networks](https://mlsanity.com/paper/1706.04599/) (2017)
- [Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift](https://mlsanity.com/paper/1906.02530/) (2019)
- [Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Rate](https://mlsanity.com/paper/1804.07931/) (2018)
- [How to Incorporate Monotonicity in Deep Networks While Preserving Flexibility?](https://mlsanity.com/paper/1909.10662/) (2019)
- [Field-aware Calibration: A Simple and Empirically Strong Method for Reliable Probabilistic Predictions](https://mlsanity.com/paper/1905.10713/) (2019)
- [DeText: A Deep Text Ranking Framework with BERT](https://mlsanity.com/paper/2008.02460/) (2020)
- [Regression Compatible Listwise Objectives for Calibrated Ranking with Binary Relevance](https://mlsanity.com/paper/2211.01494/) (2022)
- [Unbiased Learning to Rank Meets Reality: Lessons from Baidu's Large-Scale Search Dataset](https://mlsanity.com/paper/2404.02543/) (2024)
- [Monotonicity Regularization: Improved Penalties and Novel Applications to Disentangled Representation Learning and Robust Classification](https://mlsanity.com/paper/2205.08247/) (2022)
- [Deep Ensemble Shape Calibration: Multi-Field Post-hoc Calibration in Online Advertising](https://mlsanity.com/paper/2401.09507/) (2024)
- [Confidence-Aware Multi-Field Model Calibration](https://mlsanity.com/paper/2402.17655/) (2024)

## Abstract (arXiv)

Ranking models are extensively used in e-commerce for relevance estimation. These models often suffer from poor interpretability and no scale calibration, particularly when trained with typical ranking loss functions. This paper addresses the problem of post-hoc calibration of ranking models. We introduce MLPlatt: a simple yet effective ranking model calibration method that preserves the item ordering and converts ranker outputs to interpretable click-through rate (CTR) probabilities usable in downstream tasks. The method is context-aware by design and achieves good calibration metrics globally, and within strata corresponding to different values of a selected categorical field (such as user country or device), which is often important from a business perspective of an E-commerce platform. We demonstrate the superiority of MLPlatt over existing approaches on two datasets, achieving an improvement of over 10% in F-ECE (Field Expected Calibration Error) compared to other methods. Most importantly, we show that high-quality calibration can be achieved without compromising the ranking quality.
