A Spectral Decomposition Framework for Multiscale Nonlinear Dimensionality Reduction
Not on the map. Why?
Abstract (arXiv)
Dimensionality reduction (DR) involves two longstanding trade-offs. First, preserving local neighborhoods can come at the cost of global structure. Neighbor embedding methods such as t-SNE and UMAP prioritize local similarity preservation but do not explicitly constrain global organization, whereas standard spectral methods such as Laplacian Eigenmaps capture smooth, coarse-scale graph structure but offer limited flexibility to depict finer local structure. Second, the flexibility of nonlinear DR methods often comes at the cost of analytical transparency. Many methods do not explicitly reveal how high-dimensional structure produces patterns in the embedding. We introduce SDMP (Spectral Decomposition for Multiscale Projection), a nonlinear DR framework built on an explicit spectral decomposition. In this formulation, each embedding dimension is expressed as a weighted combination of Laplacian eigenvectors derived from a neighborhood graph, with the weights learned via a UMAP-style cross-entropy objective. By progressively expanding the spectral subspace to capture increasingly fine graph structure, SDMP produces a sequence of embeddings, making the evolving balance between global organization and local detail explicit, controllable, and inspectable. The explicit decomposition also reveals which spectral scales shape the overall embedding and how individual eigenvectors influence point positions. Quantitative evaluations on synthetic, image, and single-cell data show competitive local and global structure preservation, while case studies illustrate how the decomposition supports interpretation of clusters and developmental trajectories across spectral scales.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 89 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
36 of 89 references.
References · 36
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
- 2020Understanding How Dimension Reduction Tools Work: An Empirical Approach to Deciphering t-SNE, UMAP, TriMAP, and PaCMAP for Data Visualizationcited by 173
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2022Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methodscited by 149
- 2016Visualizing Large-scale and High-dimensional Datacited by 79
- 2019TriMap: Large-scale Dimensionality Reduction Using Tripletscited by 60
- 2021Theoretical Foundations of t-SNE for Visualizing High-Dimensional Clustered Datacited by 55
- 2018NetLSD: Hearing the Shape of a Graphcited by 52
- 2020Attraction-Repulsion Spectrum in Neighbor Embeddingscited by 41
24 more
- 2021On UMAP's true loss functioncited by 32
- 2022From t-SNE to UMAP with contrastive learningcited by 28
- 2021Revisiting Dimensionality Reduction Techniques for Visual Cluster Analysis: An Empirical Studycited by 27
- 2019Supporting Analysis of Dimensionality Reduction Results with Contrastive Learningcited by 26
- 2017DimReader: Axis lines that explain non-linear projectionscited by 17
- 2025Unveiling High-dimensional Backstage: A Survey for Reliable Visual Analytics with Dimensionality Reductioncited by 16
- 2023ZADU: A Python Library for Evaluating the Reliability of Dimensionality Reduction Embeddingscited by 15
- 2023Assessing Neural Network Representations During Training Using Noise-Resilient Diffusion Spectral Entropycited by 13
- 2021Interactive Dimensionality Reduction for Comparative Analysiscited by 12
- 2023Classes are not Clusters: Improving Label-based Evaluation of Dimensionality Reductioncited by 11
- 2024Dimension Reduction with Locally Adjusted Graphscited by 9
- 2025Low-dimensional embeddings of high-dimensional datacited by 8
- 2023A Heat Diffusion Perspective on Geodesic Preserving Dimensionality Reductioncited by 6
- 2024Recovering Manifold Structure Using Ollivier-Ricci Curvaturecited by 6
- 2018Homology-Preserving Multi-Scale Graph Skeletonization Using Mapper on Graphscited by 5
- 2023Balancing between the Local and Global Structures (LGS) in Graph Embeddingcited by 5
- 2021HUMAP: Hierarchical Uniform Manifold Approximation and Projectioncited by 4
- 2025DREAMS: Preserving both Local and Global Structure in Dimensionality Reductioncited by 4
- 2022RankAxis: Towards a Systematic Combination of Projection and Ranking in Multi-Attribute Data Explorationcited by 3
- 2024DimBridge: Interactive Explanation of Visual Patterns in Dimensionality Reductions with Predicate Logiccited by 3
- 2024Graph Neural Networks Are More Than Filters: Revisiting and Benchmarking from A Spectral Perspectivecited by 3
- 2024DimVis: Interpreting Visual Clusters in Dimensionality Reduction With Explainable Boosting Machinecited by 2
- 2025Visual Analytics Using Tensor Unified Linear Comparative Analysiscited by 1
- 2026MAPLE: Self-Supervised Learning-Enhanced Nonlinear Dimensionality Reduction for Visual Analysiscited by 1
Built on by
Not cited yet.