# The Risk Shadow of Principal Component Analysis: When 99.9999% Variance Preservation Causes Catastrophic Decision Errors

arXiv: https://arxiv.org/abs/2606.14533 · HTML: https://mlsanity.com/paper/2606.14533/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 6 of its 69 references that are in the map.
- First posted on arXiv 12 Jun 2026.

## Builds on (most cited first, 6 of 6)

- [Representation Learning with Contrastive Predictive Coding](https://mlsanity.com/paper/1807.03748/) (2018)
- [Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks](https://mlsanity.com/paper/2106.09249/) (2021)
- [The Price of Fair PCA: One Extra Dimension](https://mlsanity.com/paper/1811.00103/) (2018)
- [Dataset: Rare Event Classification in Multivariate Time Series](https://mlsanity.com/paper/1809.10717/) (2018)
- [Breaking the Barriers of Text-Hungry and Audio-Deficient AI](https://mlsanity.com/paper/2506.02443/) (2025)
- [Causal Mirage Equilibrium in Agentic Machine Intelligence](https://mlsanity.com/paper/2606.03636/) (2026)

## Abstract (arXiv)

Principal Component Analysis (PCA) preserves variance, not the information needed to detect rare catastrophic events. This paper proves the existence of a it Risk Shadow: PCA can retain over 99.9999 percent of total variance while completely erasing all signal about rare, high-impact failures. When this happens, even the best possible classifier operating on the PCA representation reduces to a constant predictor. The root cause is a fundamental mismatch between variance maximization and tail risk awareness. To break the shadow, we introduce Expectile PCA (ExPCA) and Tail-Preserving PCA (TP-PCA), two methods that reweight the data covariance toward high-impact events. We prove theoretically that ExPCA strictly outperforms PCA in retaining rare-event information, and we validate our claims on synthetic data and a real-world credit card fraud detection benchmark. Our results call for a fundamental rethinking of variance-based dimensionality reduction in high-stakes decisions.