Return Prediction for Mean-Variance Portfolio Selection: How Decision-Focused Learning Shapes Forecasting Models
Not on the map. Why?
Abstract (arXiv)
Markowitz laid the foundation of portfolio theory through the mean-variance optimization (MVO) framework. However, the effectiveness of MVO is contingent on the precise estimation of expected returns, variances, and covariances of asset returns, which are typically uncertain. Machine learning models are becoming useful in estimating uncertain parameters, and such models are trained to minimize prediction errors, such as mean squared errors (MSE), which treat prediction errors uniformly across assets. Recent studies have pointed out that this approach would lead to suboptimal decisions and proposed Decision-Focused Learning (DFL) as a solution, integrating prediction and optimization to improve decision-making outcomes. While studies have shown DFL's potential to enhance portfolio performance, the detailed mechanisms of how DFL modifies prediction models for MVO remain unexplored. This study investigates how DFL adjusts stock return prediction models to optimize decisions in MVO. Theoretically, we show that DFL's gradient can be interpreted as tilting the MSE-based prediction errors by the inverse covariance matrix, effectively incorporating inter-asset correlations into the learning process, while MSE treats each asset's error independently. This tilting mechanism leads to systematic prediction biases where DFL overestimates returns for assets included in portfolios while underestimating excluded assets. Our findings reveal why DFL achieves superior portfolio performance despite higher prediction errors. The strategic biases are features, not flaws.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 12 of its 38 references that are in the map. First posted on arXiv 15 Sep 2024.
Builds on
12 of 38 references.
References · 12
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
- 2019Differentiable Convex Optimization Layerscited by 458
- 2017Smart "Predict, then Optimize"cited by 332
- 2019Differentiation of Blackbox Combinatorial Solverscited by 224
- 2018Melding the Data-Decisions Pipeline: Decision-Focused Learning for Combinatorial Optimizationcited by 220
- 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
- 2021Decision-Focused Learning: Through the Lens of Learning to Rankcited by 61
- 2020Contrastive Losses and Solution Caching for Predict-and-Optimizecited by 52
- 2023Leaving the Nest: Going Beyond Local Loss Functions for Predict-Then-Optimizecited by 18
- 2022Distributionally Robust End-to-End Portfolio Constructioncited by 17
- 2024Locally Convex Global Loss Network for Decision-Focused Learningcited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Decision-Focused Learning via Tangent-Space Projection of Prediction Errorcited by 3
- 2026The Decision Geometry of Covariance Estimation for the Global Minimum-Variance Portfolio under Heavy Tailscited by 1
- 2026Generating Input Distributions for Explaining Portfolio Optimization Pipelinescited by 0
- 2026End-to-End Neural Shrinkage of Indefinite Pairwise Correlation Matrices for Small-Cap-Inclusive Portfolioscited by 0
- 2026Decision-Focused Learning for Mean-Variance Portfolio Optimization via KKT-Based Reformulationcited by 0
- 2026Decision-Focused Learning for Mean-Variance Portfolio Optimization via KKT-Based Reformulation18 Sep 2026
- 2026End-to-End Neural Shrinkage of Indefinite Pairwise Correlation Matrices for Small-Cap-Inclusive Portfolios31 Aug 2026
- 2026The Decision Geometry of Covariance Estimation for the Global Minimum-Variance Portfolio under Heavy Tails25 Jun 2026
- 2026Generating Input Distributions for Explaining Portfolio Optimization Pipelines24 Jun 2026
- 2026Decision-Focused Learning via Tangent-Space Projection of Prediction Error2 May 2026