Diffusion Probabilistic Fields
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion probabilistic models have quickly become a major approach for generative modeling of images, 3D geometry, video and other domains. However, to adapt diffusion generative modeling to these domains the denoising network needs to be carefully designed for each domain independently, oftentimes under the assumption that data lives in a Euclidean grid. In this paper we introduce Diffusion Probabilistic Fields (DPF), a diffusion model that can learn distributions over continuous functions defined over metric spaces, commonly known as fields. We extend the formulation of diffusion probabilistic models to deal with this field parametrization in an explicit way, enabling us to define an end-to-end learning algorithm that side-steps the requirement of representing fields with latent vectors as in previous approaches (Dupont et al., 2022a; Du et al., 2021). We empirically show that, while using the same denoising network, DPF effectively deals with different modalities like 2D images and 3D geometry, in addition to modeling distributions over fields defined on non-Euclidean metric spaces.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 49 of its 71 references that are in the map. First posted on arXiv 1 Mar 2023.
Builds on
49 of 71 references.
Closest ancestors · 10
Same direction, newest first
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noise19 Aug
- 2022Riemannian Score-Based Generative Modelling6 Feb
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Score-based Generative Modeling in Latent Space10 Jun
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2021Improved Denoising Diffusion Probabilistic Models18 Feb
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
- 2020Improved Techniques for Training Score-Based Generative Models16 Jun
Other references · 39
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2016Improved Techniques for Training GANscited by 2,938
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2022Video Diffusion Modelscited by 2,280
27 more
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2016HyperNetworkscited by 1,003
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 666
- 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2018Spherical CNNscited by 452
- 2018Assessing Generative Models via Precision and Recallcited by 401
- 2018Neural Processescited by 307
- 2019Attentive Neural Processescited by 280
- 2020The Creation and Detection of Deepfakes: A Surveycited by 246
- 2022Generative Modelling With Inverse Heat Dissipationcited by 164
- 2021An Attention Free Transformercited by 111
- 2021Generative Models as Distributions of Functionscited by 89
- 2016Normalizing Flows on Riemannian Manifoldscited by 68
- 2021Moser Flow: Divergence-based Generative Modeling on Manifoldscited by 67
- 2021Learning Signal-Agnostic Manifolds of Neural Fieldscited by 45
- 2020This Face Does Not Exist ... But It Might Be Yours! Identity Leakage in Generative Modelscited by 33
- 2018Autoregressive Quantile Networks for Generative Modelingcited by 31
- 2020Imperfect ImaGANation: Implications of GANs Exacerbating Biases on Facial Data Augmentation and Snapchat Selfie Lensescited by 27
- 2021Ethics and Creativity in Computer Visioncited by 15
Built on by
Citing papers per year: 2023: 12; 2024: 7; 2025: 7; 2026: 2.
28 papers.
Sort:
By area:
- 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 109
- 2023On the Design Fundamentals of Diffusion Models: A Surveycited by 59
- 2023Swallowing the Bitter Pill: Simplified Scalable Conformer Generationcited by 55
- 2024ET-Flow: Equivariant Flow-Matching for Molecular Conformer Generationcited by 41
- 2023∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified Statescited by 21
- 2024Grounding Continuous Representations in Geometry: Equivariant Neural Fieldscited by 19
- 2024DDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representationscited by 16
- 2024Stochastic Optimal Control for Diffusion Bridges in Function Spacescited by 16
- 2023Functional Diffusioncited by 13
- 2023Manifold Diffusion Fieldscited by 11
- 2023Single Mesh Diffusion Models with Field Latents for Texture Generationcited by 11
16 more
- 2023Generative Neural Fields by Mixtures of Neural Implicit Functionscited by 10
- 20243D Shape Tokenization via Latent Flow Matchingcited by 10
- 2023Generative Hyperelasticity with Physics-Informed Probabilistic Diffusion Fieldscited by 7
- 2023Latent Field Discovery In Interacting Dynamical Systems With Neural Fieldscited by 7
- 2024E(3)-equivariant models cannot learn chirality: Field-based molecular generationcited by 6
- 2025MedFuncta: A Unified Framework for Learning Efficient Medical Neural Fieldscited by 6
- 2025Flow Straight and Fast in Hilbert Space: Functional Rectified Flowcited by 5
- 2025Functional Mean Flow in Hilbert Spacecited by 5
- 2025LIFT: Latent Implicit Functions for Task- and Data-Agnostic Encodingcited by 2
- 2025Incomplete Data, Complete Dynamics: A Diffusion Approachcited by 2
- 2026Trajectory Consistency for One-Step Generation on Euler Mean Flowscited by 2
- 2023T1: Scaling Diffusion Probabilistic Fields to High-Resolution on Unified Visual Modalitiescited by 1
- 2025DoubleDiffusion: Combining Heat Diffusion with Denoising Diffusion for Texture Generation on 3D Meshescited by 1
- 2026Neural Field Tokenizations with Hierarchy and Spatial Locality Priorscited by 1
- 2024MING: A Functional Approach to Learning Molecular Generative Modelscited by 0
- 2025A standard transformer and attention with linear biases for molecular conformer generationcited by 0
- 2026Neural Field Tokenizations with Hierarchy and Spatial Locality Priors6 Jun 2026
- 2026Trajectory Consistency for One-Step Generation on Euler Mean Flows31 Jan 2026
- 2025Functional Mean Flow in Hilbert Space17 Nov 2025
- 2025Incomplete Data, Complete Dynamics: A Diffusion Approach24 Sep 2025
- 2025Flow Straight and Fast in Hilbert Space: Functional Rectified Flow12 Sep 2025
- 2025A standard transformer and attention with linear biases for molecular conformer generation24 Jun 2025
- 2025LIFT: Latent Implicit Functions for Task- and Data-Agnostic Encoding19 Mar 2025
- 2025MedFuncta: A Unified Framework for Learning Efficient Medical Neural Fields20 Feb 2025
- 2025DoubleDiffusion: Combining Heat Diffusion with Denoising Diffusion for Texture Generation on 3D Meshes6 Jan 2025
- 20243D Shape Tokenization via Latent Flow Matching20 Dec 2024
- 2024ET-Flow: Equivariant Flow-Matching for Molecular Conformer Generation29 Oct 2024
- 2024MING: A Functional Approach to Learning Molecular Generative Models16 Oct 2024
16 more
- 2024Grounding Continuous Representations in Geometry: Equivariant Neural Fields9 Jun 2024
- 2024Stochastic Optimal Control for Diffusion Bridges in Function Spaces31 May 2024
- 2024E(3)-equivariant models cannot learn chirality: Field-based molecular generation24 Feb 2024
- 2024DDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representations23 Jan 2024
- 2023Single Mesh Diffusion Models with Field Latents for Texture Generation14 Dec 2023
- 2023Swallowing the Bitter Pill: Simplified Scalable Conformer Generation27 Nov 2023
- 2023Functional Diffusion26 Nov 2023
- 2023Latent Field Discovery In Interacting Dynamical Systems With Neural Fields31 Oct 2023
- 2023Generative Neural Fields by Mixtures of Neural Implicit Functions30 Oct 2023
- 2023Generative Hyperelasticity with Physics-Informed Probabilistic Diffusion Fields11 Sep 2023
- 2023On the Design Fundamentals of Diffusion Models: A Survey7 Jun 2023
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidance30 May 2023
- 2023Manifold Diffusion Fields24 May 2023
- 2023T1: Scaling Diffusion Probabilistic Fields to High-Resolution on Unified Visual Modalities24 May 2023
- 2023∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified States31 Mar 2023
- 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusion29 Mar 2023
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 109
- 2023On the Design Fundamentals of Diffusion Models: A Surveycited by 59
- 2023Swallowing the Bitter Pill: Simplified Scalable Conformer Generationcited by 55
- 2023∞-Diff: Infinite Resolution Diffusion with Subsampled Mollified Statescited by 21
- 2024DDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representationscited by 16
- 2024Stochastic Optimal Control for Diffusion Bridges in Function Spacescited by 16
- 2023Functional Diffusioncited by 13
- 2023Manifold Diffusion Fieldscited by 11
- 2023Single Mesh Diffusion Models with Field Latents for Texture Generationcited by 11
- 20243D Shape Tokenization via Latent Flow Matchingcited by 10
- 2025Flow Straight and Fast in Hilbert Space: Functional Rectified Flowcited by 5
- 2025Functional Mean Flow in Hilbert Spacecited by 5
12 most cited of 14 All 14 (JSON)
- 2025Functional Mean Flow in Hilbert Space17 Nov 2025
- 2025Flow Straight and Fast in Hilbert Space: Functional Rectified Flow12 Sep 2025
- 2025DoubleDiffusion: Combining Heat Diffusion with Denoising Diffusion for Texture Generation on 3D Meshes6 Jan 2025
- 20243D Shape Tokenization via Latent Flow Matching20 Dec 2024
- 2024Stochastic Optimal Control for Diffusion Bridges in Function Spaces31 May 2024
- 2024DDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representations23 Jan 2024
- 2023Single Mesh Diffusion Models with Field Latents for Texture Generation14 Dec 2023
- 2023Swallowing the Bitter Pill: Simplified Scalable Conformer Generation27 Nov 2023
- 2023Functional Diffusion26 Nov 2023
- 2023On the Design Fundamentals of Diffusion Models: A Survey7 Jun 2023
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidance30 May 2023
- 2023Manifold Diffusion Fields24 May 2023
12 newest of 14 All 14 (JSON)
- 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
- 2024ET-Flow: Equivariant Flow-Matching for Molecular Conformer Generationcited by 41
- 2024Grounding Continuous Representations in Geometry: Equivariant Neural Fieldscited by 19
- 2023Generative Neural Fields by Mixtures of Neural Implicit Functionscited by 10
- 2023Generative Hyperelasticity with Physics-Informed Probabilistic Diffusion Fieldscited by 7
- 2023Latent Field Discovery In Interacting Dynamical Systems With Neural Fieldscited by 7
- 2024E(3)-equivariant models cannot learn chirality: Field-based molecular generationcited by 6
- 2025MedFuncta: A Unified Framework for Learning Efficient Medical Neural Fieldscited by 6
- 2025LIFT: Latent Implicit Functions for Task- and Data-Agnostic Encodingcited by 2
- 2025Incomplete Data, Complete Dynamics: A Diffusion Approachcited by 2
- 2026Trajectory Consistency for One-Step Generation on Euler Mean Flowscited by 2
- 2026Neural Field Tokenizations with Hierarchy and Spatial Locality Priorscited by 1
12 most cited of 14 All 14 (JSON)
- 2026Neural Field Tokenizations with Hierarchy and Spatial Locality Priors6 Jun 2026
- 2026Trajectory Consistency for One-Step Generation on Euler Mean Flows31 Jan 2026
- 2025Incomplete Data, Complete Dynamics: A Diffusion Approach24 Sep 2025
- 2025A standard transformer and attention with linear biases for molecular conformer generation24 Jun 2025
- 2025LIFT: Latent Implicit Functions for Task- and Data-Agnostic Encoding19 Mar 2025
- 2025MedFuncta: A Unified Framework for Learning Efficient Medical Neural Fields20 Feb 2025
- 2024ET-Flow: Equivariant Flow-Matching for Molecular Conformer Generation29 Oct 2024
- 2024MING: A Functional Approach to Learning Molecular Generative Models16 Oct 2024
- 2024Grounding Continuous Representations in Geometry: Equivariant Neural Fields9 Jun 2024
- 2024E(3)-equivariant models cannot learn chirality: Field-based molecular generation24 Feb 2024
- 2023Latent Field Discovery In Interacting Dynamical Systems With Neural Fields31 Oct 2023
- 2023Generative Neural Fields by Mixtures of Neural Implicit Functions30 Oct 2023
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024An overview of diffusion models for generative artificial intelligence
- 2022Diffusion Models in Vision: A Survey
- 2023Generalised Diffusion Probabilistic Scale-Spaces
- 2025Diffusion Models: A Mathematical Introduction
- 2021Structured Denoising Diffusion Models in Discrete State-Spaces
- 2023Diffusion Probabilistic Models for Scene-Scale 3D Categorical Data
- 2024Learning to Discretize Denoising Diffusion ODEs
- 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision