mlsanityData to 14 Oct 2026

Odds-Shift Slippage in One-vs-Rest Rankers: Diagnosing and Repairing Reweighting-Induced Top-K Errors

arXiv 2609.13810 ↗First posted 12 Sep 2026cs.IR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

One-vs-rest rankers that show each user the top-K of many rare labels usually counter imbalance with a per-label positive-class weight, scaleposweight = n_-/n_+. Elkan's identity says such a weight shifts label j's log-odds by ln wj, so the model ranks by weighted odds rather than by the marginal that is Bayes-optimal for precision@K, and suggests inverting the shift afterwards; what a finite learner does with a weight in the thousands, and which repair then works, has not been measured. We call the gap between the promised and the realized shift odds-shift slippage and measure it on matched pairs of LightGBM and MLP models that differ only in the weights. On Santander the weight takes MAP@7 from 0.808 to 0.117; for the boosted pairs the ideal odds shift accounts for 23% of that loss (32% on Instacart; 98% for an MLP pair on the same rows) and slippage for the rest. We prove that a booster whose leaf steps are capped at c realizes at most Tη c nat of shift in T rounds at rate η, which a cap sweep confirms, and show that without a cap saturated cells tie at exactly 1.0, beyond the reach of any separable map. The analytic inversion therefore pays only where the shift was realized and nothing saturated, whereas per-label isotonic regression returns the Santander model to 0.784 (0.780 with the calibrator fitted on the validation period), but only if labels without calibration positives are mapped to their prior rather than passed through. On 11 public MULAN benchmarks and 5 learners the weighted model loses more than half of its MAP@K in 8 of 55 cells, and on delicious and Corel5k the same repair returns it to the unweighted level; per-label calibration hurts where positives are scarce, a harm that a cross-validated rule removes. The recipe is released as oddslip.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 43 references that are in the map. First posted on arXiv 12 Sep 2026.

Builds on

13 of 43 references.

References · 13

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  2. 2017On Calibration of Modern Neural Networkscited by 4,960
  3. 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
  4. 2020Long-tail learning via logit adjustmentcited by 618
  5. 2018Detecting and Correcting for Label Shift with Black Box Predictorscited by 366
  6. 2018What is the Effect of Importance Weighting in Deep Learning?cited by 251
  7. 2018A no-regret generalization of hierarchical softmax to extreme multi-label classificationcited by 52
  8. 2020Modeling Personalized Item Frequency Information for Next-basket Recommendationcited by 24
  9. 2021A Next Basket Recommendation Reality Checkcited by 15
  10. 2022Calibrating for Class Weights by Modeling Machine Learningcited by 4
  11. 2024Wasserstein Gradient Boosting: A Framework for Distribution-Valued Supervised Learningcited by 4
  12. 2024Calibrating the Predictions for Top-N Recommendationscited by 2
1 more
  1. 2026Post-Calibration Reliability Reranking of Relevance Decisions via Label-wise Monotone Projectioncited by 2

Built on by

Not cited yet.