FARE: Deep Reinforcement Learning For Fair Exposure Constrained Uncertainty Aware Financial Content Personalization
On the map: Deep reinforcement learning methods → Adversarial robustness and RL in finance
Abstract (arXiv)
Content personalization systems in financial services must ensure fair exposure across diverse offerings-a requirement driven by contractual obligations and the need to prevent "rich-get-richer" dynamics where content with high click-through rate (CTR) dominates while other relevant products receive minimal visibility. Share of Voice (SOV) constraints, which guarantee each content category a target fraction of top-position exposure, address this by promoting product diversity and balanced user discovery. While re-ranking layers atop CTR models are common in practice, we propose two key novelties: (1) framing SOV-constrained ranking as a deep reinforcement learning problem analogous to constrained trade execution in algorithmic finance, and (2) explicitly incorporating CTR prediction uncertainty into the agent's state space and policy design-enabling larger ranking adjustments for high-uncertainty predictions where deviation from CTR-optimal ordering is less costly. We introduce FARE (Fair Ranking Executor), a modular uncertainty-aware execution layer that translates any black-box CTR model's predictions into SOV-fair rankings without retraining the underlying model. Our uncertainty-weighted proportional control policy (FARE-PC) and learned neural policies (FARE-ES, FARE-PPO) demonstrate that uncertainty-aware approaches can substantially reduce SOV deviation from fairness targets while minimizing engagement loss, with gradient-free evolution strategies outperforming policy gradient methods on synthetic data and the ordering reversing on KuaiRand-Pure.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Adversarial robustness and RL in finance, one of 15 directions in Deep reinforcement learning methods. Builds on 27 of its 37 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
27 of 37 references.
References · 27
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
- 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 774
- 2017A Distributional Perspective on Reinforcement Learningcited by 765
- 2017Evolution Strategies as a Scalable Alternative to Reinforcement Learningcited by 574
- 2015Weight Uncertainty in Neural Networkscited by 554
- 2016Deep Exploration via Bootstrapped DQNcited by 527
- 2018Fairness of Exposure in Rankingscited by 190
- 2018Equity of Attention: Amortizing Individual Fairness in Rankingscited by 124
15 more
- 2017FA*IR: A Fair Top-k Ranking Algorithmcited by 113
- 2022KuaiRand: An Unbiased Sequential Recommendation Dataset with Randomly Exposed Videoscited by 72
- 2020Controlling Fairness and Bias in Dynamic Learning-to-Rankcited by 68
- 2020Evaluating Stochastic Rankings with Expected Exposurecited by 53
- 2018Double Deep Q-Learning for Optimal Executioncited by 43
- 2022CPFair: Personalized Consumer and Producer Fairness Re-ranking for Recommender Systemscited by 29
- 2020Regularized Online Allocation Problems: Fairness and Beyondcited by 22
- 2019Multi-stakeholder Recommendation and its Connection to Multi-sided Fairnesscited by 19
- 2024EB-NeRD: A Large-Scale Dataset for News Recommendationcited by 12
- 2020ContentWise Impressions: An Industrial Dataset with Impressions Includedcited by 8
- 2023P-MMF: Provider Max-min Fairness Re-ranking in Recommender Systemcited by 7
- 2023Predictive Uncertainty-based Bias Mitigation in Rankingcited by 7
- 2024How Fair is Your Diffusion Recommender Model?cited by 5
- 2023Asynchronous Deep Double Duelling Q-Learning for Trading-Signal Execution in Limit Order Book Marketscited by 3
- 2014Online Allocation Rules in Display Advertisingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Constrained Policy Optimization for Provably Fair Order Matching
- 2025Balancing Profit and Fairness in Risk-Based Pricing Markets
- 2025Fairness-Aware Reinforcement Learning (FAReL): A Framework for Transparent and Balanced Sequential Decision-Making
- 2022Offline Deep Reinforcement Learning for Dynamic Pricing of Consumer Credit
- 2025ClauseLens: Clause-Grounded, CVaR-Constrained Reinforcement Learning for Trustworthy Reinsurance Pricing
- 2026A Three-Phase Foundation Model for Tax-Aware Personalized Portfolio Management
- 2024Hierarchical Reinforced Trader (HRT): A Bi-Level Approach for Optimizing Stock Selection and Execution
- 2024Deep Reinforcement Learning Strategies in Finance: Insights into Asset Holding, Trading Behavior, and Purchase Diversity