Flows for simultaneous manifold learning and density estimation
Not on the map. Why?
Abstract (arXiv)
We introduce manifold-learning flows (M-flows), a new class of generative models that simultaneously learn the data manifold as well as a tractable probability density on that manifold. Combining aspects of normalizing flows, GANs, autoencoders, and energy-based models, they have the potential to represent datasets with a manifold structure more faithfully and provide handles on dimensionality reduction, denoising, and out-of-distribution detection. We argue why such models should not be trained by maximum likelihood alone and present a new training algorithm that separates manifold and density updates. In a range of experiments we demonstrate how M-flows learn the data manifold and allow for better inference than standard flows in the ambient data space.
Key facts. Cited by 117 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 30; 2023: 28; 2024: 15; 2025: 14; 2026: 7.
117 papers.
Sort:
By area:
- 2022Riemannian Score-Based Generative Modellingcited by 216
- 2022Weakly supervised causal representation learningcited by 140
- 2021Hyperbolic Deep Neural Networks: A Surveycited by 138
- 2022Riemannian Diffusion Modelscited by 120
- 2021A Living Review of Machine Learning for Particle Physicscited by 77
- 2022Verifying the Union of Manifolds Hypothesis for Image Datacited by 62
- 2021Smooth Normalizing Flowscited by 52
- 2021Rectangular Flows for Manifold Learningcited by 49
- 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connectionscited by 47
- 2021CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flowscited by 46
- 2021Trumpets: Injective Flows for Inference and Inverse Problemscited by 36
- 2021Tractable Density Estimation on Learned Manifolds with Conformal Embedding Flowscited by 30
38 more
- 2022LIDL: Local Intrinsic Dimension Estimation Using Approximate Likelihoodcited by 30
- 2023Explicitly Minimizing the Blur Error of Variational Autoencoderscited by 29
- 2022Diagnosing and Fixing Manifold Overfitting in Deep Generative Modelscited by 28
- 2021Autoencoding Under Normalization Constraintscited by 26
- 2021Solving Inverse Problems by Joint Posterior Maximization with Autoencoding Priorcited by 24
- 2024Mutual Information Estimation via Normalizing Flowscited by 22
- 2024A Geometric Explanation of the Likelihood OOD Detection Paradoxcited by 22
- 2024Trivialized Momentum Facilitates Diffusion Generative Modeling on Lie Groupscited by 19
- 2023Scaling Riemannian Diffusion Modelscited by 18
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Reviewcited by 18
- 2021Understanding Event-Generation Networks via Uncertaintiescited by 17
- 2023Lifting Architectural Constraints of Injective Flowscited by 17
- 2021Go with the Flows: Mixtures of Normalizing Flows for Point Cloud Generation and Reconstructioncited by 16
- 2021Riemannian Convex Potential Mapscited by 16
- 2021Entropic Issues in Likelihood-Based OOD Detectioncited by 16
- 2021E Pluribus Unum Ex Machina: Learning from Many Collider Events at Oncecited by 15
- 2023Canonical normalizing flows for manifold learningcited by 15
- 2022Adaptive and Dynamic Multi-Resolution Hashing for Pairwise Summationscited by 14
- 2023Self-supervised Representation Learning From Random Data Projectorscited by 14
- 2024Neural Contractive Dynamical Systemscited by 14
- 2021Universal Joint Approximation of Manifolds and Densities by Simple Injective Flowscited by 13
- 2022Conditional Injective Flows for Bayesian Imagingcited by 13
- 2023On Explicit Curvature Regularization in Deep Generative Modelscited by 13
- 2022Effects of Data Geometry in Early Deep Learningcited by 12
- 2023A Review of Change of Variable Formulas for Generative Modelingcited by 12
- 2021Density estimation on low-dimensional manifolds: an inflation-deflation approachcited by 11
- 2022TrafficFlowGAN: Physics-informed Flow based Generative Adversarial Network for Uncertainty Quantificationcited by 11
- 2022Gradual Domain Adaptation via Normalizing Flowscited by 11
- 2022nu-Flows: Conditional Neutrino Regressioncited by 11
- 2024Learning Neural Contracting Dynamics: Extended Linearization and Global Guaranteescited by 11
- 2025Accurate Forgetting for Heterogeneous Federated Continual Learningcited by 11
- 2021Principal Component Density Estimation for Scenario Generation Using Normalizing Flowscited by 10
- 2021Latent Space Refinement for Deep Generative Modelscited by 10
- 2021Density estimation on smooth manifolds with normalizing flowscited by 10
- 2021Particle Graph Autoencoders and Differentiable, Learned Energy Mover's Distancecited by 10
- 2022VQ-Flows: Vector Quantized Local Normalizing Flowscited by 10
- 2023Injectivity of ReLU networks: perspectives from statistical physicscited by 10
- 2024Distributional Principal Autoencoderscited by 10
50 most cited of 117 All 117 (JSON)
- 2026FloDR: An invertible dimensionality reduction method based on a normalising flow28 Jul 2026
- 2026Constructing VAE Latent Spaces with Prescribed Topology5 Jun 2026
- 2026Understanding Self-Supervised Learning via Latent Distribution Matching5 May 2026
- 2026Reparameterization through Coverings and Topological Weight Priors26 Apr 2026
- 2026Complex normalizing flows can almost be information K"ahler-Ricci flows20 Apr 2026
- 2026Manifold Aware Denoising Score Matching (MAD)2 Mar 2026
- 2026From Core to Detail: Unsupervised Disentanglement with Entropy-Ordered Flows6 Feb 2026
- 2025Latent Diffusion Inversion Requires Understanding the Latent Space25 Nov 2025
- 2025Split-Flows: Measure Transport and Information Loss Across Molecular Resolutions3 Nov 2025
- 2025Marginal Flow: a flexible and efficient framework for density estimation30 Sep 2025
- 2025Misspecification-robust amortised simulation-based inference using variational methods6 Sep 2025
- 2025On Convolutions, Intrinsic Dimension, and Diffusion Models25 Jun 2025
38 more
- 2025Offline RL with Smooth OOD Generalization in Convex Hull and its Neighborhood10 Jun 2025
- 2025Sparse Autoencoders, Again?5 Jun 2025
- 2025Beyond Diagonal Covariance: Flexible Posterior VAEs via Free-Form Injective Flows2 Jun 2025
- 2025Learning Geometry and Topology via Multi-Chart Flows30 May 2025
- 2025Follow the Energy, Find the Path: Riemannian Metrics from Energy-Based Models23 May 2025
- 2025Accurate Forgetting for Heterogeneous Federated Continual Learning20 Feb 2025
- 2025Identifying Metric Structures of Deep Latent Variable Models19 Feb 2025
- 2025Riemannian Manifold Learning for Stackelberg Games with Neural Flow Representations8 Feb 2025
- 2025Diffusion Generative Modeling on Lie Group Representations4 Feb 2025
- 2024Extended Neural Contractive Dynamical Systems: On Multiple Tasks and Riemannian Safety Regions18 Nov 2024
- 2024Analyzing Generative Models by Manifold Entropic Metrics25 Oct 2024
- 2024Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMax9 Oct 2024
- 2024A Likelihood Based Approach to Distribution Regression Using Conditional Deep Generative Models2 Oct 2024
- 2024Improved Image Classification with Manifold Neural Networks19 Sep 2024
- 2024Inflationary Flows: Calibrated Bayesian Inference with Diffusion-Based Models11 Jul 2024
- 2024Injective flows for star-like manifolds13 Jun 2024
- 2024Trivialized Momentum Facilitates Diffusion Generative Modeling on Lie Groups25 May 2024
- 2024FUSE: Fast Unified Simulation and Estimation for PDEs23 May 2024
- 2024Distributional Principal Autoencoders21 Apr 2024
- 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connections3 Apr 2024
- 2024A Geometric Explanation of the Likelihood OOD Detection Paradox27 Mar 2024
- 2024Mutual Information Estimation via Normalizing Flows4 Mar 2024
- 2024Learning Neural Contracting Dynamics: Extended Linearization and Global Guarantees12 Feb 2024
- 2024Neural Contractive Dynamical Systems17 Jan 2024
- 2023Unified framework for diffusion generative models in SO(3): applications in computer vision and astrophysics18 Dec 2023
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Review15 Dec 2023
- 2023Multivariate Scenario Generation of Day-Ahead Electricity Prices using Normalizing Flows23 Nov 2023
- 2023Scaling Riemannian Diffusion Models30 Oct 2023
- 2023Canonical normalizing flows for manifold learning19 Oct 2023
- 2023Simple Mechanisms for Representing, Indexing and Manipulating Concepts18 Oct 2023
- 2023Self-supervised Representation Learning From Random Data Projectors11 Oct 2023
- 2023Implicit Variational Inference for High-Dimensional Posteriors10 Oct 2023
- 2023On Explicit Curvature Regularization in Deep Generative Models19 Sep 2023
- 2023Learning Nonparametric High-Dimensional Generative Models: The Empirical-Beta-Copula Autoencoder18 Sep 2023
- 2023Computing excited states of molecules using normalizing flows31 Aug 2023
- 2023Out-of-distribution detection using normalizing flows on the data manifold26 Aug 2023
- 2023Calorimeter shower superresolution22 Aug 2023
- 2023A Review of Change of Variable Formulas for Generative Modeling4 Aug 2023
50 newest of 117 All 117 (JSON)
- 2022Riemannian Score-Based Generative Modellingcited by 216
- 2022Riemannian Diffusion Modelscited by 120
- 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connectionscited by 47
- 2024Trivialized Momentum Facilitates Diffusion Generative Modeling on Lie Groupscited by 19
- 2023Scaling Riemannian Diffusion Modelscited by 18
- 2025Diffusion Generative Modeling on Lie Group Representationscited by 6
- 2023Unified framework for diffusion generative models in SO(3): applications in computer vision and astrophysicscited by 5
- 2025On Convolutions, Intrinsic Dimension, and Diffusion Modelscited by 2
- 2025Latent Diffusion Inversion Requires Understanding the Latent Spacecited by 2
- 2025Latent Diffusion Inversion Requires Understanding the Latent Space25 Nov 2025
- 2025On Convolutions, Intrinsic Dimension, and Diffusion Models25 Jun 2025
- 2025Diffusion Generative Modeling on Lie Group Representations4 Feb 2025
- 2024Trivialized Momentum Facilitates Diffusion Generative Modeling on Lie Groups25 May 2024
- 2024Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connections3 Apr 2024
- 2023Unified framework for diffusion generative models in SO(3): applications in computer vision and astrophysics18 Dec 2023
- 2023Scaling Riemannian Diffusion Models30 Oct 2023
- 2022Riemannian Diffusion Models16 Aug 2022
- 2022Riemannian Score-Based Generative Modelling6 Feb 2022
- 2022Weakly supervised causal representation learningcited by 140
- 2021Hyperbolic Deep Neural Networks: A Surveycited by 138
- 2021A Living Review of Machine Learning for Particle Physicscited by 77
- 2022Verifying the Union of Manifolds Hypothesis for Image Datacited by 62
- 2021Smooth Normalizing Flowscited by 52
- 2021Rectangular Flows for Manifold Learningcited by 49
- 2021CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flowscited by 46
- 2021Trumpets: Injective Flows for Inference and Inverse Problemscited by 36
- 2021Tractable Density Estimation on Learned Manifolds with Conformal Embedding Flowscited by 30
- 2022LIDL: Local Intrinsic Dimension Estimation Using Approximate Likelihoodcited by 30
- 2023Explicitly Minimizing the Blur Error of Variational Autoencoderscited by 29
- 2022Diagnosing and Fixing Manifold Overfitting in Deep Generative Modelscited by 28
12 most cited of 107 All 107 (JSON)
- 2026FloDR: An invertible dimensionality reduction method based on a normalising flow28 Jul 2026
- 2026Constructing VAE Latent Spaces with Prescribed Topology5 Jun 2026
- 2026Understanding Self-Supervised Learning via Latent Distribution Matching5 May 2026
- 2026Reparameterization through Coverings and Topological Weight Priors26 Apr 2026
- 2026Complex normalizing flows can almost be information K"ahler-Ricci flows20 Apr 2026
- 2026Manifold Aware Denoising Score Matching (MAD)2 Mar 2026
- 2026From Core to Detail: Unsupervised Disentanglement with Entropy-Ordered Flows6 Feb 2026
- 2025Split-Flows: Measure Transport and Information Loss Across Molecular Resolutions3 Nov 2025
- 2025Marginal Flow: a flexible and efficient framework for density estimation30 Sep 2025
- 2025Misspecification-robust amortised simulation-based inference using variational methods6 Sep 2025
- 2025Sparse Autoencoders, Again?5 Jun 2025
- 2025Beyond Diagonal Covariance: Flexible Posterior VAEs via Free-Form Injective Flows2 Jun 2025
12 newest of 107 All 107 (JSON)