mlsanityData to 7 Oct 2026

Return Prediction for Mean-Variance Portfolio Selection: How Decision-Focused Learning Shapes Forecasting Models

arXiv 2409.09684 ↗First posted 15 Sep 2024q-fin.PM cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Markowitz laid the foundation of portfolio theory through the mean-variance optimization (MVO) framework. However, the effectiveness of MVO is contingent on the precise estimation of expected returns, variances, and covariances of asset returns, which are typically uncertain. Machine learning models are becoming useful in estimating uncertain parameters, and such models are trained to minimize prediction errors, such as mean squared errors (MSE), which treat prediction errors uniformly across assets. Recent studies have pointed out that this approach would lead to suboptimal decisions and proposed Decision-Focused Learning (DFL) as a solution, integrating prediction and optimization to improve decision-making outcomes. While studies have shown DFL's potential to enhance portfolio performance, the detailed mechanisms of how DFL modifies prediction models for MVO remain unexplored. This study investigates how DFL adjusts stock return prediction models to optimize decisions in MVO. Theoretically, we show that DFL's gradient can be interpreted as tilting the MSE-based prediction errors by the inverse covariance matrix, effectively incorporating inter-asset correlations into the learning process, while MSE treats each asset's error independently. This tilting mechanism leads to systematic prediction biases where DFL overestimates returns for assets included in portfolios while underestimating excluded assets. Our findings reveal why DFL achieves superior portfolio performance despite higher prediction errors. The strategic biases are features, not flaws.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 12 of its 38 references that are in the map. First posted on arXiv 15 Sep 2024.

Builds on

12 of 38 references.

References · 12

  1. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  2. 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
  3. 2019Differentiable Convex Optimization Layerscited by 458
  4. 2017Smart "Predict, then Optimize"cited by 332
  5. 2019Differentiation of Blackbox Combinatorial Solverscited by 224
  6. 2018Melding the Data-Decisions Pipeline: Decision-Focused Learning for Combinatorial Optimizationcited by 220
  7. 2023Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunitiescited by 129
  8. 2021Decision-Focused Learning: Through the Lens of Learning to Rankcited by 61
  9. 2020Contrastive Losses and Solution Caching for Predict-and-Optimizecited by 52
  10. 2023Leaving the Nest: Going Beyond Local Loss Functions for Predict-Then-Optimizecited by 18
  11. 2022Distributionally Robust End-to-End Portfolio Constructioncited by 17
  12. 2024Locally Convex Global Loss Network for Decision-Focused Learningcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.