Manifold Density Estimation via Generalized Dequantization
Not on the map. Why?
Abstract (arXiv)
Density estimation is an important technique for characterizing distributions given observations. Much existing research on density estimation has focused on cases wherein the data lies in a Euclidean space. However, some kinds of data are not well-modeled by supposing that their underlying geometry is Euclidean. Instead, it can be useful to model such data as lying on a it manifold with some known structure. For instance, some kinds of data may be known to lie on the surface of a sphere. We study the problem of estimating densities on manifolds. We propose a method, inspired by the literature on "dequantization," which we interpret through the lens of a coordinate transformation of an ambient Euclidean space and a smooth manifold of interest. Using methods from normalizing flows, we apply this method to the dequantization of smooth manifold structures in order to model densities on the sphere, tori, and the orthogonal group.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 14 of its 31 references that are in the map. First posted on arXiv 14 Feb 2021.
Builds on
14 of 31 references.
References · 14
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2016Density estimation using Real NVPcited by 2,029
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 584
- 2015A note on the evaluation of generative modelscited by 291
- 2019Flow++: Improving Flow-Based Generative Models with Variational Dequantization and Architecture Designcited by 258
- 2018Neural Autoregressive Flowscited by 207
- 2020Normalizing Flows on Tori and Spherescited by 117
- 2020Neural Manifold Ordinary Differential Equationscited by 81
- 2013RNADE: The real-valued neural autoregressive density-estimatorcited by 65
- 2019Sum-of-Squares Polynomial Flowcited by 62
- 2020Latent Variable Modelling with Hyperbolic Normalizing Flowscited by 49
2 more
- 2020Categorical Normalizing Flows via Continuous Transformationscited by 36
- 2020Learning Discrete Distributions by Dequantizationcited by 17
Built on by
Citing papers per year: 2022: 2; 2023: 2.
4 papers.
- 2023SE(3)-Stochastic Flow Matching for Protein Backbone Generationcited by 147
- 2022Riemannian Diffusion Modelscited by 120
- 2022Flow-matching -- efficient coarse-graining of molecular dynamics without forcescited by 36
- 2023Learning Distributions on Manifolds with Free-Form Flowscited by 7
- 2023Learning Distributions on Manifolds with Free-Form Flows15 Dec 2023
- 2023SE(3)-Stochastic Flow Matching for Protein Backbone Generation3 Oct 2023
- 2022Riemannian Diffusion Models16 Aug 2022
- 2022Flow-matching -- efficient coarse-graining of molecular dynamics without forces21 Mar 2022