mlsanityData to 14 Oct 2026

DVD: Discrete Voxel Diffusion for 3D Generation and Editing

arXiv 2605.07971 ↗First posted 8 May 2026cs.CV cs.LGcited by 2

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We introduce Discrete Voxel Diffusion (DVD), a discrete diffusion framework to generate, assess, and edit sparse voxels for SLat (Structured LATent) based 3D generative pipelines. Although discrete diffusion has not generally displaced continuous diffusion in image-like generation, we show that it can be an effective first-stage prior for sparse voxel scaffolds. By treating voxel occupancy as a native discrete variable, DVD avoids continuous-to-discrete thresholding and provides a simple framework for voxel generation, uncertainty estimation, and editing. Beyond quality gains, DVD provides more interpretable generation dynamics through explicit categorical modeling. Furthermore, we leverage the predictive entropy as a robust uncertainty metric to identify ambiguous voxel regions and complicated samples, facilitating tasks such as data filtering and quality assessment. Finally, we propose a lightweight fine-tuning strategy using block-structured perturbation patterns. This approach empowers the model to inpaint and edit voxels within a single sampling round, requiring negligible auxiliary computation and no additional model evaluations. Code is available at https://github.com/TeCai/DVD.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 48 of its 58 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

48 of 58 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Topology Sculptor, Shape Refiner: Discrete Diffusion Model for High-Fidelity 3D Meshes Generation24 Oct
  2. 2025Scaffold Diffusion: Sparse Multi-Category Voxel Structure Generation with Discrete Diffusion26 Aug
  3. 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modeling20 May
  4. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Models10 Feb
  5. 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoders23 Dec
  6. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets30 May
  7. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer23 May
  8. 2023Pyramid Diffusion for Fine 3D Large Scene Generation20 Nov
  9. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan
  10. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan

Other references · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  7. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  8. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  10. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  11. 2022Denoising Diffusion Restoration Modelscited by 963
  12. 2025Large Language Diffusion Modelscited by 912
26 more
  1. 2024Simple and Effective Masked Diffusion Language Modelscited by 848
  2. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  3. 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
  4. 2022A Continuous Time Framework for Discrete Denoising Modelscited by 451
  5. 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 381
  6. 2024Discrete Flow Matchingcited by 317
  7. 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Designcited by 305
  8. 2025Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusionscited by 214
  9. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
  10. 2025Remasking Discrete Diffusion Models with Inference-Time Scalingcited by 189
  11. 2024A Survey on Diffusion Models for Inverse Problemscited by 180
  12. 2025Native and Compact Structured Latents for 3D Generationcited by 175
  13. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
  14. 2024Simple Guidance Mechanisms for Discrete Diffusion Modelscited by 155
  15. 2025The Diffusion Dualitycited by 135
  16. 2024Unlocking Guidance for Discrete State-Space Diffusion and Flow Modelscited by 129
  17. 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 118
  18. 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 110
  19. 2025Unified Multimodal Discrete Diffusioncited by 49
  20. 2025Is Noise Conditioning Necessary for Denoising Generative Models?cited by 44
  21. 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
  22. 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35
  23. 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 33
  24. 2025Equilibrium Matching: Generative Modeling with Implicit Energy-Based Modelscited by 21
  25. 2025Objaverse++: Curated 3D Object Dataset with Quality Annotationscited by 20
  26. 2025UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinementcited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Vox-E: Text-guided Voxel Editing of 3D Objects
  2. 20213D Shape Generation and Completion through Point-Voxel Diffusion
  3. 2023Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting
  4. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation
  5. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation
  6. 2025ReDDiT: Rehashing Noise for Discrete Visual Generation
  7. 2024Diffusion2: Dynamic 3D Content Generation via Score Composition of Video and Multi-view Diffusion Models
  8. 2026FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representation