An Emerging Retail Portfolio Management Application: Personalized, Tax-Aware Reinforcement Learning with Natural Language Goals
Not on the map. Why?
Abstract (arXiv)
Retail investors lack access to the kind of personalized, tax-aware portfolio management that institutional clients take for granted -- existing robo-advisors use static, rule-based allocation, and institutional-grade systems require account minimums and technology stacks unavailable to individual investors. We present a fully built, integration-tested application that closes this gap: a FastAPI backend and web dashboard that let a user describe an investment goal in plain language (e.g. "I want steady growth but need to sell some shares next month for a down payment"), routes that goal to one of six investment mandates, and produces a live, broker-integrated portfolio recommendation from athree-phase reinforcement learning system -- a self-supervised cross-asset encoder, a Mixture-of-Experts (MoE) allocation policy with a learned intent router, and a lightweight LoRA adapter that personalizes recommendations from an individual's revealed brokerage behavior without retraining the shared model. The system is functionally complete and integration-tested end-to-end against a live brokerage API (Alpaca, paper-trading mode), including multi-user authentication, a trust first preview-before-apply confirmation flow, daily email digests, and an auditable action-integrity chain, but has not yet been opened to real end-users; we report this honestly as an emerging, pre-deployment application with a concrete path to full deployment, alongside 14-day walk-forward backtests (bootstrapped confidence intervals included) as preliminary, pre-deployment validation rather than production performance. We also report several practical engineering lessons -- silently-inactive integration paths, hanging third-party API calls, and the value of end-to-end empirical verification over trusting checkpoint metadata -- that we believe generalize to other applied RL systems built on external, live data sources.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 12 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
9 of 12 references.
References · 9
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2016Concrete Problems in AI Safetycited by 1,582
- 2017A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problemcited by 123
- 2020FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Financecited by 86
- 2017Adaptive Huber Regressioncited by 59
- 2020Reinforcement-Learning based Portfolio Management with Augmented Asset Movement Prediction Statescited by 55
- 2026A Three-Phase Foundation Model for Tax-Aware Personalized Portfolio Managementcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026High-Stakes Personalization: Rethinking LLM Customization for Individual Investor Decision-Making
- 2022MetaTrader: An Reinforcement Learning Approach Integrating Diverse Policies for Portfolio Optimization
- 2026Retrieval-augmented generation vs. deterministic tax computation in multi-agent financial advisory: A 2x2 factorial experiment
- 2025AI PB: A Grounded Generative Agent for Personalized Investment Insights
- 2025Trading-R1: Financial Trading with LLM Reasoning via Reinforcement Learning
- 2022Combining Reinforcement Learning and Inverse Reinforcement Learning for Asset Allocation Recommendations
- 2026FundaPod: A Multi-Persona Agent Pod Architecture with Knowledge Graph Memory for AI-Assisted Fundamental Investment Research
- 2025Generative AI-enhanced Sector-based Investment Portfolio Construction