Manifold Diffusion Fields
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
We present Manifold Diffusion Fields (MDF), an approach that unlocks learning of diffusion models of data in general non-Euclidean geometries. Leveraging insights from spectral geometry analysis, we define an intrinsic coordinate system on the manifold via the eigen-functions of the Laplace-Beltrami Operator. MDF represents functions using an explicit parametrization formed by a set of multiple input-output pairs. Our approach allows to sample continuous functions on manifolds and is invariant with respect to rigid and isometric transformations of the manifold. In addition, we show that MDF generalizes to the case where the training set contains functions on different manifolds. Empirical results on multiple datasets and manifolds including challenging scientific problems like weather prediction or molecular conformation show that MDF can capture distributions of such functions with better diversity and fidelity than previous approaches.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 45 of its 78 references that are in the map. First posted on arXiv 24 May 2023.
Builds on
45 of 78 references.
Closest ancestors · 8
Same direction, newest first
- 2023∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified States31 Mar
- 2023Diffusion Probabilistic Fields1 Mar
- 2022Riemannian Score-Based Generative Modelling6 Feb
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2021Improved Denoising Diffusion Probabilistic Models18 Feb
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 37
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2022Video Diffusion Modelscited by 2,280
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2016HyperNetworkscited by 1,003
- 2020Benchmarking Graph Neural Networkscited by 672
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
- 2021Neural Fields in Visual Computing and Beyondcited by 539
25 more
- 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
- 2018Neural Processescited by 307
- 2019Attentive Neural Processescited by 280
- 2022Torsional Diffusion for Molecular Conformer Generationcited by 262
- 2023Flow Matching on General Geometriescited by 260
- 2020The Creation and Detection of Deepfakes: A Surveycited by 246
- 2020DiffusionNet: Discretization Agnostic Learning on Surfacescited by 163
- 2021An Attention Free Transformercited by 111
- 2021GeoMol: Torsional Geometric Generation of Molecular 3D Conformer Ensemblescited by 106
- 2022A Generalization of ViT/MLP-Mixer to Graphscited by 93
- 2021Generative Models as Distributions of Functionscited by 89
- 2021Learning Neural Generative Dynamics for Molecular Conformation Generationcited by 87
- 2020Mat'ern Gaussian processes on Riemannian manifoldscited by 82
- 2016Normalizing Flows on Riemannian Manifoldscited by 68
- 2021Moser Flow: Divergence-based Generative Modeling on Manifoldscited by 67
- 2023Spatial Functa: Scaling Functa to ImageNet Classification and Generationcited by 55
- 2022Neural Diffusion Processescited by 50
- 2021Learning Signal-Agnostic Manifolds of Neural Fieldscited by 45
- 2020This Face Does Not Exist ... But It Might Be Yours! Identity Leakage in Generative Modelscited by 33
- 2022Generalised Implicit Neural Representationscited by 31
- 2020Imperfect ImaGANation: Implications of GANs Exacerbating Biases on Facial Data Augmentation and Snapchat Selfie Lensescited by 27
- 2022Generalized Laplacian Positional Encoding for Graph Representation Learningcited by 21
- 2022Intrinsic Neural Fields: Learning Functions on Manifoldscited by 20
- 2021Vector-valued Gaussian Processes on Riemannian Manifolds via Gauge Independent Projected Kernelscited by 19
- 2021Ethics and Creativity in Computer Visioncited by 15
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 3; 2026: 3.
11 papers.
- 2023Single Mesh Diffusion Models with Field Latents for Texture Generationcited by 11
- 2023Generative Hyperelasticity with Physics-Informed Probabilistic Diffusion Fieldscited by 7
- 2024CaFA: Global Weather Forecasting with Factorized Attention on Spherecited by 6
- 2024UV-free Texture Generation with Denoising and Geodesic Heat Diffusionscited by 3
- 2025Physically Valid Biomolecular Interaction Modeling with Gauss-Seidel Projectioncited by 3
- 2025A Malliavin-Gamma calculus approach to Score Based Diffusion Generative models for random fieldscited by 2
- 2026Divergence-Free Diffusion Models for Incompressible Fluid Flowscited by 2
- 2026Manifold-Aware Perturbations for Constrained Generative Modelingcited by 2
- 2025DoubleDiffusion: Combining Heat Diffusion with Denoising Diffusion for Texture Generation on 3D Meshescited by 1
- 2024MING: A Functional Approach to Learning Molecular Generative Modelscited by 0
- 2026Manifold Diffusion for Structure Generation of Transition Metal Complexescited by 0
- 2026Manifold Diffusion for Structure Generation of Transition Metal Complexes30 May 2026
- 2026Manifold-Aware Perturbations for Constrained Generative Modeling30 Jan 2026
- 2026Divergence-Free Diffusion Models for Incompressible Fluid Flows27 Jan 2026
- 2025Physically Valid Biomolecular Interaction Modeling with Gauss-Seidel Projection10 Oct 2025
- 2025A Malliavin-Gamma calculus approach to Score Based Diffusion Generative models for random fields19 May 2025
- 2025DoubleDiffusion: Combining Heat Diffusion with Denoising Diffusion for Texture Generation on 3D Meshes6 Jan 2025
- 2024MING: A Functional Approach to Learning Molecular Generative Models16 Oct 2024
- 2024UV-free Texture Generation with Denoising and Geodesic Heat Diffusions29 Aug 2024
- 2024CaFA: Global Weather Forecasting with Factorized Attention on Sphere12 May 2024
- 2023Single Mesh Diffusion Models with Field Latents for Texture Generation14 Dec 2023
- 2023Generative Hyperelasticity with Physics-Informed Probabilistic Diffusion Fields11 Sep 2023
Similar, not cited
Close in wording, no citation either way
- 2026Diffusion Model for Manifold Data: Score Decomposition, Curvature, and Statistical Complexity
- 2023Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion Processes
- 2025Efficient Diffusion Models for Symmetric Manifolds
- 2026Riemannian Diffusion Models on General Manifolds via Physics-Informed Neural Networks
- 2025Improving the Euclidean Diffusion Generation of Manifold Data by Mitigating Score Function Singularity
- 2025What's Inside Your Diffusion Model? A Score-Based Riemannian Metric to Explore the Data Manifold
- 2023Learning Distributions on Manifolds with Free-Form Flows
- 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Models