mlsanityData to 14 Oct 2026

A Meta Reinforcement Learning Approach to Goals-Based Wealth Management

arXiv 2605.02300 ↗First posted 4 May 2026cs.LGcited by 0

On the map: Deep reinforcement learning methods → Adversarial robustness and RL in finance

Abstract (arXiv)

Applying concepts related to zero-shot meta-learning and pre-training of foundation models, we develop a meta reinforcement learning approach (denoted MetaRL) that is pre-trained on thousands of goals-based wealth management (GBWM) problems. Each GBWM problem involves a multiple year scenario over which the investor looks to optimally choose an investment portfolio each year and choose to fulfill all, some, or none of the different financial goals that arise each year. These choices seek to maximize the expected total investor utility obtained from the fulfilled financial goals. By eliminating separate training and optimization for each new investor problem, the MetaRL model in inference mode produces near-optimal dynamic investment portfolio and goal-fulfilling strategies for a new GBWM problem within a few hundredths of a second. This delivers expected utilities that are, on average, 97.8% of the optimal expected utilities (determined via Dynamic Programming). These results are remarkably robust to capital market regime changes, even when training uses only one capital market regime. Further, the MetaRL approach can enable solving problems with larger state spaces where Dynamic Programming becomes computationally infeasible.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Adversarial robustness and RL in finance, one of 15 directions in Deep reinforcement learning methods. Builds on 20 of its 79 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

20 of 79 references.

References · 20

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  4. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  7. 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
  8. 2015Trust Region Policy Optimizationcited by 2,580
  9. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
  10. 2020A Review of Generalized Zero-Shot Learning Methodscited by 159
  11. 2018Meta-Reinforcement Learning of Structured Exploration Strategiescited by 130
  12. 2017A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problemcited by 128
8 more
  1. 2021Recent Advances in Reinforcement Learning in Financecited by 110
  2. 2019Meta reinforcement learning as task inferencecited by 77
  3. 2017Meta-Learning and Universality: Deep Representations and Gradient Descent can Approximate any Learning Algorithmcited by 65
  4. 2022Model-Based Offline Meta-Reinforcement Learning with Regularizationcited by 15
  5. 2020G-Learner and GIRL: Goal Based Wealth Management with Reinforcement Learningcited by 9
  6. 2021Distributional Offline Continuous-Time Reinforcement Learning with Neural Physics-Informed PDEs (SciPhy RL for DOCTR-L)cited by 6
  7. 2021Embracing advanced AI/ML to help investors achieve success: Vanguard Reinforcement Learning for Financial Goal Planningcited by 1
  8. 2023Optimal Execution Using Reinforcement Learningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022MetaTrader: An Reinforcement Learning Approach Integrating Diverse Policies for Portfolio Optimization
  2. 2025Your Offline Policy is Not Trustworthy: Bilevel Reinforcement Learning for Sequential Portfolio Optimization
  3. 2024Pontryagin-Guided Policy Optimization for Merton's Portfolio Problem ↗
  4. 2025Reinforcement Learning for Portfolio Optimization with a Financial Goal and Defined Time Horizons
  5. 2022Combining Reinforcement Learning and Inverse Reinforcement Learning for Asset Allocation Recommendations
  6. 2025MARS: A Meta-Adaptive Reinforcement Learning Framework for Risk-Aware Multi-Agent Portfolio Management
  7. 2024The Evolution of Reinforcement Learning in Quantitative Finance: A Survey
  8. 2026Deep Reinforcement Learning for Optimal Portfolio Allocation: A Comparative Study with Mean-Variance Optimization