mlsanityData to 14 Oct 2026

Representation Curriculum: Stagewise Training for Robust Ranking and Allocation

arXiv 2606.09891 ↗First posted 3 Jun 2026cs.LG cs.AI cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Ranking in digital marketplaces is a dynamic exposure-allocation mechanism: displayed items shape discovery trajectories and success events logged by the platform to update future allocation policies. Modern ranking systems rely heavily on exposure-confounded signals (e.g. popularity estimates, CTR/CVR aggregates, and ID-based representation), because they are highly predictive under stationary demand. Yet this predictive power can become a learning shortcut: early access to exposure-dependent belief signals steers optimization toward over-reliance on them and away from exposure-independent merit signals (e.g., content-based competitiveness and semantic affinity). Consequently, the learned policy tends to entrench incumbents and degrade cold-start generalization and robustness under distribution shift. We propose Representation Curriculum (RC), a training-time intervention that temporally stages feature utilization. RC foregrounds content-based merit signals initially, then introduces exposure-dependent belief signals while anchoring the content pathway near the learned merit representation, curbing shortcut reliance on historical signals and mitigating gradient starvation on content signals. We formalize RC independently of task and hypothesis class and provide ranking-specific instantiations. In a Gaussian linear ridge setting, we derive closed-form solutions and sufficient conditions under which RC strictly reduces population risk on a cold-start target distribution, with a quantified Pareto tradeoff against source performance. Experiments on public learning-to-rank and recommendation benchmarks, and randomized online experiments in a large-scale e-commerce search system, show that RC measurably shifts reliance from historical belief signals toward content-based merit signals and yields consistent gains on cold populations with a controlled trade-off in head performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 33 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

21 of 33 references.

References · 21

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2019Invariant Risk Minimizationcited by 1,854
  4. 2015Causal inference using invariant prediction: identification and confidence intervalscited by 536
  5. 2020Gradient Starvation: A Learning Proclivity in Neural Networkscited by 267
  6. 2016Recommendations as Treatments: Debiasing Learning and Evaluationcited by 248
  7. 2020Bias and Debias in Recommender System: A Survey and Future Directionscited by 240
  8. 2018Fairness of Exposure in Rankingscited by 190
  9. 2016Unbiased Learning-to-Rank with Biased Feedbackcited by 157
  10. 2013Introducing LETOR 4.0 Datasetscited by 121
  11. 2017How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utilitycited by 120
  12. 2018Anchor regression: heterogeneous data meets causalitycited by 118
9 more
  1. 2021Causal Intervention for Leveraging Popularity Bias in Recommendationcited by 116
  2. 2020Model-Agnostic Counterfactual Reasoning for Eliminating Popularity Bias in Recommender Systemcited by 94
  3. 2019Managing Popularity Bias in Recommender Systems with Personalized Re-rankingcited by 82
  4. 2019Policy Learning for Fairness in Rankingcited by 74
  5. 2022Curriculum Learning for Dense Retrieval Distillationcited by 38
  6. 2021Fairness in Ranking under Uncertaintycited by 27
  7. 2024Multi-objective Learning to Rank by Model Distillationcited by 7
  8. 2023Mitigating Exploitation Bias in Learning to Rank with an Uncertainty-aware Empirical Bayes Approachcited by 2
  9. 2024BayesCNS: A Unified Bayesian Approach to Address Cold Start and Non-Stationarity in Search Systems at Scalecited by 2

Built on by

Not cited yet.