DVD: Discrete Voxel Diffusion for 3D Generation and Editing
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We introduce Discrete Voxel Diffusion (DVD), a discrete diffusion framework to generate, assess, and edit sparse voxels for SLat (Structured LATent) based 3D generative pipelines. Although discrete diffusion has not generally displaced continuous diffusion in image-like generation, we show that it can be an effective first-stage prior for sparse voxel scaffolds. By treating voxel occupancy as a native discrete variable, DVD avoids continuous-to-discrete thresholding and provides a simple framework for voxel generation, uncertainty estimation, and editing. Beyond quality gains, DVD provides more interpretable generation dynamics through explicit categorical modeling. Furthermore, we leverage the predictive entropy as a robust uncertainty metric to identify ambiguous voxel regions and complicated samples, facilitating tasks such as data filtering and quality assessment. Finally, we propose a lightweight fine-tuning strategy using block-structured perturbation patterns. This approach empowers the model to inpaint and edit voxels within a single sampling round, requiring negligible auxiliary computation and no additional model evaluations. Code is available at https://github.com/TeCai/DVD.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 48 of its 58 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
48 of 58 references.
Closest ancestors · 10
Same direction, newest first
- 2025Topology Sculptor, Shape Refiner: Discrete Diffusion Model for High-Fidelity 3D Meshes Generation24 Oct
- 2025Scaffold Diffusion: Sparse Multi-Category Voxel Structure Generation with Discrete Diffusion26 Aug
- 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modeling20 May
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Models10 Feb
- 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoders23 Dec
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets30 May
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer23 May
- 2023Pyramid Diffusion for Fine 3D Large Scene Generation20 Nov
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan
Other references · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2022Denoising Diffusion Restoration Modelscited by 963
- 2025Large Language Diffusion Modelscited by 912
26 more
- 2024Simple and Effective Masked Diffusion Language Modelscited by 848
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
- 2022A Continuous Time Framework for Discrete Denoising Modelscited by 451
- 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 381
- 2024Discrete Flow Matchingcited by 317
- 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Designcited by 305
- 2025Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusionscited by 214
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
- 2025Remasking Discrete Diffusion Models with Inference-Time Scalingcited by 189
- 2024A Survey on Diffusion Models for Inverse Problemscited by 180
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2024Simple Guidance Mechanisms for Discrete Diffusion Modelscited by 155
- 2025The Diffusion Dualitycited by 135
- 2024Unlocking Guidance for Discrete State-Space Diffusion and Flow Modelscited by 129
- 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 118
- 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 110
- 2025Unified Multimodal Discrete Diffusioncited by 49
- 2025Is Noise Conditioning Necessary for Denoising Generative Models?cited by 44
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
- 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 33
- 2025Equilibrium Matching: Generative Modeling with Implicit Energy-Based Modelscited by 21
- 2025Objaverse++: Curated 3D Object Dataset with Quality Annotationscited by 20
- 2025UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinementcited by 16
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2023Vox-E: Text-guided Voxel Editing of 3D Objects
- 20213D Shape Generation and Completion through Point-Voxel Diffusion
- 2023Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation
- 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation
- 2025ReDDiT: Rehashing Noise for Discrete Visual Generation
- 2024Diffusion2: Dynamic 3D Content Generation via Score Composition of Video and Multi-view Diffusion Models
- 2026FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representation