End-to-End Large Portfolio Optimization for Variance Minimization with Neural Networks through Covariance Cleaning
Not on the map. Why?
Abstract (arXiv)
We develop a rotation-invariant neural network that provides the global minimum-variance portfolio by jointly learning how to lag-transform historical returns and marginal volatilities and how to regularise the eigenvalues of large equity covariance matrices. This explicit mathematical mapping offers clear interpretability of each module's role, so the model cannot be regarded as a pure black box. The architecture mirrors the analytical form of the global minimum-variance solution yet remains agnostic to dimension, so a single model can be calibrated on panels of a few hundred stocks and applied, without retraining, to one thousand US equities, a cross-sectional jump that indicates robust generalization capability. The loss function is the future short-term realized minimum variance and is optimized end-to-end on real returns. In out-of-sample tests from January 2000 to December 2024, the estimator delivers systematically lower realized volatility, smaller maximum drawdowns, and higher Sharpe ratios than the best competitors, including state-of-the-art non-linear shrinkage, and these advantages persist across both short and long evaluation horizons despite the model's training focus is short-term. Furthermore, although the model is trained end-to-end to produce an unconstrained minimum-variance portfolio, we show that its learned covariance representation can be used in general optimizers under long-only constraints with virtually no loss in its performance advantage over competing estimators. These advantages persist when the strategy is executed under a highly realistic implementation framework that models market orders at the auctions, empirical slippage, exchange fees, and financing charges for leverage, and they remain stable during episodes of acute market stress.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 14 of its 84 references that are in the map. First posted on arXiv 2 Jul 2025.
Builds on
14 of 84 references.
References · 14
- 2017Attention Is All You Needcited by 60,361
- 2017Deep Setscited by 1,421
- 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 599
- 2021Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depthcited by 419
- 2020Understanding the Difficulty of Training Transformerscited by 210
- 2021Universal Approximation of Functions on Setscited by 62
- 2022Distributionally Robust End-to-End Portfolio Constructioncited by 17
- 2021Non-linear shrinkage of the price return covariance matrix is far from optimal for portfolio optimisationcited by 5
- 2020Deep Deterministic Portfolio Optimizationcited by 4
- 2020Estimation of Large Financial Covariances: A Cross-Validation Approachcited by 4
- 2025A Deep Learning Framework for Medium-Term Covariance Forecasting in Multi-Asset Portfolioscited by 2
- 2020Covariance matrix filtering with bootstrapped hierarchiescited by 1
2 more
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026Agentic Trading: When LLM Agents Meet Financial Marketscited by 7
- 2026Neural Network-Driven Volatility Drag Mitigation under Aggressive Leveragecited by 1
- 2025Integrated Prediction and Multi-period Portfolio Optimizationcited by 0
- 2026Physics-Informed Singular-Value Learning for Cross-Covariances Forecasting in Financial Marketscited by 0
- 2026End-to-End Neural Shrinkage of Indefinite Pairwise Correlation Matrices for Small-Cap-Inclusive Portfolioscited by 0
- 2026End-to-End Neural Shrinkage of Indefinite Pairwise Correlation Matrices for Small-Cap-Inclusive Portfolios31 Aug 2026
- 2026Neural Network-Driven Volatility Drag Mitigation under Aggressive Leverage25 Jul 2026
- 2026Agentic Trading: When LLM Agents Meet Financial Markets19 May 2026
- 2026Physics-Informed Singular-Value Learning for Cross-Covariances Forecasting in Financial Markets12 Jan 2026
- 2025Integrated Prediction and Multi-period Portfolio Optimization12 Dec 2025