Beyond ESG Scores: Learning Dynamic Constraints for Sequential Portfolio Optimization
Not on the map. Why?
Abstract (arXiv)
ESG-aware portfolio optimization is increasingly important for sustainable capital allocation, yet most learning-based methods still operationalize ESG by appending static scores to the policy observation or reward. This creates a mismatch for sequential control: ESG scores are noisy, provider-dependent, low-frequency, and temporally misaligned with sequential portfolio decisions, while financial evidence suggests that ESG is better treated as a portfolio preference, risk-exposure, or hedge dimension than as a robust alpha factor. We propose to impose ESG constraints without modifying the financial policy's observation or reward, using a Multimodal Action-Conditioned Constraint Field (MACF) that learns mechanism-specific ESG costs from point-in-time multimodal evidence and contemplated portfolio transitions. We then introduce MACF-X, a family of optimizer-specific adapters that converts MACF costs and uncertainties into native constrained-optimization interfaces through a shared slack- and uncertainty-aware pressure layer. Across multiple constraint-integration interfaces, MACF-X reduces tail ESG budget pressure while maintaining competitive financial performance. Ablations show that this improvement depends on dynamic evidence inputs and three-head decomposition, while static ESG-score proxies are nearly indistinguishable from score-shuffled noise baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 33 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
13 of 33 references.
References · 13
- 2015Trust Region Policy Optimizationcited by 2,503
- 2017Constrained Policy Optimizationcited by 928
- 2018Reward Constrained Policy Optimizationcited by 397
- 2020Responsive Safety in Reinforcement Learning by PID Lagrangian Methodscited by 302
- 2020Projection-Based Constrained Policy Optimizationcited by 195
- 2020CRPO: A New Approach for Safe Reinforcement Learning with Convergence Guaranteecited by 128
- 2019IPO: Interior-point Policy Optimization under Constraintscited by 119
- 2021AI in Finance: Challenges, Techniques and Opportunitiescited by 81
- 2022Penalized Proximal Policy Optimization for Safe Reinforcement Learningcited by 60
- 2024Embedding Safety into RL: A New Take on Trust Region Methodscited by 9
- 2024Deep Reinforcement Learning and Mean-Variance Strategies for Responsible Portfolio Optimizationcited by 4
- 2022Balancing Profit, Risk, and Sustainability for Portfolio Managementcited by 2
1 more
Built on by
Not cited yet.