# A survey of dimensionality reduction techniques

arXiv: https://arxiv.org/abs/1403.2877 · HTML: https://mlsanity.com/paper/1403.2877/

## Key facts

- Cited by 50 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Mar 2014.

## Built on by (most cited first, 30 of 50)

- [At the Dawn of Generative AI Era: A Tutorial-cum-Survey on New Frontiers in 6G Wireless Intelligence](https://mlsanity.com/paper/2402.18587/) (2024)
- [FlowTransformer: A Transformer Framework for Flow-based Network Intrusion Detection Systems](https://mlsanity.com/paper/2304.14746/) (2023)
- [A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems](https://mlsanity.com/paper/2202.04648/) (2022)
- [To Transformers and Beyond: Large Language Models for the Genome](https://mlsanity.com/paper/2311.07621/) (2023)
- [VQC-Based Reinforcement Learning with Data Re-uploading: Performance and Trainability](https://mlsanity.com/paper/2401.11555/) (2024)
- [Project and Probe: Sample-Efficient Domain Adaptation by Interpolating Orthogonal Features](https://mlsanity.com/paper/2302.05441/) (2023)
- [UnProjection: Leveraging Inverse-Projections for Visual Analytics of High-Dimensional Data](https://mlsanity.com/paper/2111.01744/) (2021)
- [Stop Misusing t-SNE and UMAP for Visual Analytics](https://mlsanity.com/paper/2506.08725/) (2025)
- [HyperNP: Interactive Visual Exploration of Multidimensional Projection Hyperparameters](https://mlsanity.com/paper/2106.13777/) (2021)
- [LossPlot: A Better Way to Visualize Loss Landscapes](https://mlsanity.com/paper/2111.15133/) (2021)
- [Enhancing Neural Training via a Correlated Dynamics Model](https://mlsanity.com/paper/2312.13247/) (2023)
- ["Normalized Stress" is Not Normalized: How to Interpret Stress Correctly](https://mlsanity.com/paper/2408.07724/) (2024)
- [Local Explanation of Dimensionality Reduction](https://mlsanity.com/paper/2204.14012/) (2022)
- [Feature-Based Time-Series Analysis in R using the theft Package](https://mlsanity.com/paper/2208.06146/) (2022)
- [ShaRP: Shape-Regularized Multidimensional Projections](https://mlsanity.com/paper/2306.00554/) (2023)
- [Unsupervised Machine Learning for Scientific Discovery: Workflow and Best Practices](https://mlsanity.com/paper/2506.04553/) (2025)
- [Creating User-steerable Projections with Interactive Semantic Mapping](https://mlsanity.com/paper/2506.15479/) (2025)
- [Quality-Diversity Meta-Evolution: customising behaviour spaces to a meta-objective](https://mlsanity.com/paper/2109.03918/) (2021)
- [Visual Cluster Separation Using High-Dimensional Sharpened Dimensionality Reduction](https://mlsanity.com/paper/2110.00317/) (2021)
- [Interpretable Linear Dimensionality Reduction based on Bias-Variance Analysis](https://mlsanity.com/paper/2303.14734/) (2023)
- [Nonlinear Feature Aggregation: Two Algorithms driven by Theory](https://mlsanity.com/paper/2306.11143/) (2023)
- [Inspecting the Process of Bank Credit Rating via Visual Analytics](https://mlsanity.com/paper/2108.03011/) (2021)
- [LR-Net: A Block-based Convolutional Neural Network for Low-Resolution Image Classification](https://mlsanity.com/paper/2207.09531/) (2022)
- [Toward Flare-Free Images: A Survey](https://mlsanity.com/paper/2310.14354/) (2023)
- [Predicting loss-of-function impact of genetic mutations: a machine learning approach](https://mlsanity.com/paper/2402.00054/) (2024)
- [Circuit design in biology and machine learning. I. Random networks and dimensional reduction](https://mlsanity.com/paper/2408.09604/) (2024)
- [Improved Dimensionality Reduction for Inverse Problems in Nuclear Fusion and High-Energy Astrophysics](https://mlsanity.com/paper/2505.03849/) (2025)
- [Supervised Dynamic Dimension Reduction with Deep Neural Network](https://mlsanity.com/paper/2508.03546/) (2025)
- [How Scale Breaks "Normalized Stress" and KL Divergence: Rethinking Quality Metrics](https://mlsanity.com/paper/2510.08660/) (2025)
- [Multidimensional Scaling for Gene Sequence Data with Autoencoders](https://mlsanity.com/paper/2104.09014/) (2021)

## Abstract (arXiv)

Experimental life sciences like biology or chemistry have seen in the recent decades an explosion of the data available from experiments. Laboratory instruments become more and more complex and report hundreds or thousands measurements for a single experiment and therefore the statistical methods face challenging tasks when dealing with such high dimensional data. However, much of the data is highly redundant and can be efficiently brought down to a much smaller number of variables without a significant loss of information. The mathematical procedures making possible this reduction are called dimensionality reduction techniques; they have widely been developed by fields like Statistics or Machine Learning, and are currently a hot research topic. In this review we categorize the plethora of dimension reduction techniques available and give the mathematical insight behind them.