# Bias Robustness of Genetic Multi-Criteria Sorting versus Learned Rankers under Proxy Skew and Label Contamination

arXiv: https://arxiv.org/abs/2610.14015 · HTML: https://mlsanity.com/paper/2610.14015/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 18 of its 37 references that are in the map.
- First posted on arXiv 29 Sep 2026.

## Builds on (most cited first, 18 of 18)

- [XGBoost: A Scalable Tree Boosting System](https://mlsanity.com/paper/1603.02754/) (2016)
- [Language (Technology) is Power: A Critical Survey of "Bias" in NLP](https://mlsanity.com/paper/2005.14050/) (2020)
- [Bias and Debias in Recommender System: A Survey and Future Directions](https://mlsanity.com/paper/2010.03240/) (2020)
- [Fairness of Exposure in Rankings](https://mlsanity.com/paper/1802.07281/) (2018)
- [Unbiased Learning-to-Rank with Biased Feedback](https://mlsanity.com/paper/1608.04468/) (2016)
- [Fairness-Aware Ranking in Search & Recommendation Systems with Application to LinkedIn Talent Search](https://mlsanity.com/paper/1905.01989/) (2019)
- [Introducing LETOR 4.0 Datasets](https://mlsanity.com/paper/1306.2597/) (2013)
- [The Unfairness of Popularity Bias in Recommendation](https://mlsanity.com/paper/1907.13286/) (2019)
- [Controlling Fairness and Bias in Dynamic Learning-to-Rank](https://mlsanity.com/paper/2005.14713/) (2020)
- [Societal Biases in Retrieved Contents: Measurement Framework and Adversarial Mitigation for BERT Rankers](https://mlsanity.com/paper/2104.13640/) (2021)
- [Pre-trained Language Model based Ranking in Baidu Search](https://mlsanity.com/paper/2105.11108/) (2021)
- [Estimating Position Bias without Intrusive Interventions](https://mlsanity.com/paper/1812.05161/) (2018)
- [Do Neural Ranking Models Intensify Gender Bias?](https://mlsanity.com/paper/2005.00372/) (2020)
- [Fairness in Information Access Systems](https://mlsanity.com/paper/2105.05779/) (2021)
- [Doubly-Robust Estimation for Correcting Position-Bias in Click Feedback for Unbiased Learning to Rank](https://mlsanity.com/paper/2203.17118/) (2022)
- [Genetic AI: Evolutionary Games for ab initio dynamic Multi-Objective Optimization](https://mlsanity.com/paper/2501.19113/) (2025)
- [Feature weighting for data analysis via evolutionary simulation](https://mlsanity.com/paper/2511.06454/) (2025)
- [Evolutionary Data Theory: On the Similarities between Data Problems and Evolutionary Games](https://mlsanity.com/paper/2605.26685/) (2026)

## Abstract (arXiv)

Learning-to-rank (LTR) models can align rankings with undesignated signals when those signals appear as features or leak into training labels. We compare label-free genetic multi-criteria sorting (open Pikaia strategy variants), which reranks fixed candidate pools using an explicit criteria vector C, to label-trained LTR (LightGBM, XGBoost, RankSVM) under two controlled protocols on MSLR-WEB10K, Baidu-ULTR, WANDS, and Expedia. In the main proxy-skew study, labels remain clean while a calibrated proxy P is available as a feature: Genetic AI rankings show lower Spearman rank-proxy correlation than the LTR peers (e.g. about 0.15-0.16 vs. 0.59-0.87 on WANDS), with both families evaluated jointly on clean nDCG@10 on a bias-utility frontier. In a supporting label-contamination study, training labels are mixed with contaminant B: because Genetic AI methods do not use labels, their bias and utility curves stay flat, whereas LightGBM and XGBoost increase rank-B correlation as contamination rises (OLS bias_slope about 0.58-0.65 on WANDS/Baidu). The results support genetic sorting as an architectural option for optimizing declared attributes on a fixed pool when undesignated proxies or label contaminants must be refused.
