Towards Sustainable Investment Policies Informed by Opponent Shaping
Not on the map. Why?
Abstract (arXiv)
Addressing climate change requires global coordination, yet rational economic actors often prioritize immediate gains over collective welfare, resulting in social dilemmas. InvestESG is a recently proposed multi-agent simulation that captures the dynamic interplay between investors and companies under climate risk. We provide a formal characterization of the conditions under which InvestESG exhibits an intertemporal social dilemma, deriving theoretical thresholds at which individual incentives diverge from collective welfare. Building on this, we apply Advantage Alignment, a scalable opponent shaping algorithm shown to be effective in general-sum games, to influence agent learning in InvestESG. We offer theoretical insights into why Advantage Alignment systematically favors socially beneficial equilibria by biasing learning dynamics toward cooperative outcomes. Our results demonstrate that strategically shaping the learning processes of economic agents can result in better outcomes that could inform policy mechanisms to better align market incentives with long-term sustainability goals.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 26 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
11 of 26 references.
References · 11
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 903
- 2017Learning with Opponent-Learning Awarenesscited by 218
- 2018Stable Opponent Shaping in Differentiable Gamescited by 49
- 2021The AI Economist: Optimal Economic Policy Design via Two-level Deep Reinforcement Learningcited by 14
- 2024LOQA: Learning with Opponent Q-Learning Awarenesscited by 8
- 2014Translucent Players: Explaining Cooperative Behavior in Social Dilemmascited by 4
- 2024InvestESG: A multi-agent reinforcement learning benchmark for studying climate investment as a social dilemmacited by 3
- 2024Carbon Market Simulation with Adaptive Mechanism Designcited by 2
Built on by
Not cited yet.