mlsanityData to 14 Oct 2026

Unleashing Vecset Diffusion Model for Fast Shape Generation

arXiv 2503.16302 ↗First posted 20 Mar 2025cs.CV cs.AI eess.IVcited by 26

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

3D shape generation has greatly flourished through the development of so-called "native" 3D diffusion, particularly through the Vecset Diffusion Model (VDM). While recent advancements have shown promising results in generating high-resolution 3D shapes, VDM still struggles with high-speed generation. Challenges exist because of difficulties not only in accelerating diffusion sampling but also VAE decoding in VDM, areas under-explored in previous works. To address these challenges, we present FlashVDM, a systematic framework for accelerating both VAE and DiT in VDM. For DiT, FlashVDM enables flexible diffusion sampling with as few as 5 inference steps and comparable quality, which is made possible by stabilizing consistency distillation with our newly introduced Progressive Flow Distillation. For VAE, we introduce a lightning vecset decoder equipped with Adaptive KV Selection, Hierarchical Volume Decoding, and Efficient Network Design. By exploiting the locality of the vecset and the sparsity of shape surface in the volume, our decoder drastically lowers FLOPs, minimizing the overall decoding overhead. We apply FlashVDM to Hunyuan3D-2 to obtain Hunyuan3D-2 Turbo. Through systematic evaluation, we show that our model significantly outperforms existing fast 3D generation methods, achieving comparable performance to the state-of-the-art while reducing inference time by over 45x for reconstruction and 32x for generation. Code and models are available at https://github.com/Tencent/FlashVDM.

Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 56 of its 59 references that are in the map. First posted on arXiv 20 Mar 2025.

Builds on

56 of 59 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Models10 Feb
  2. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation21 Jan
  3. 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoders23 Dec
  4. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets30 May
  5. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refiner23 May
  6. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer23 May
  7. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov
  8. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
  9. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  10. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  11. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan

Other references · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  4. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  5. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  6. 2023Consistency Modelscited by 1,822
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  8. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  9. 2022Token Merging: Your ViT But Fastercited by 1,021
  10. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  11. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  12. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
33 more
  1. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  2. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  3. 2023Adversarial Diffusion Distillationcited by 759
  4. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  5. 2022On Distillation of Guided Diffusion Modelscited by 725
  6. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  7. 2023Improved Techniques for Training Consistency Modelscited by 439
  8. 2023DeepCache: Accelerating Diffusion Models for Freecited by 359
  9. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
  10. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  11. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
  12. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
  13. 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
  14. 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 237
  15. 2017Geometric GANcited by 233
  16. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
  17. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
  18. 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
  19. 2023Token Merging for Fast Stable Diffusioncited by 224
  20. 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
  21. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
  22. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
  23. 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
  24. 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANscited by 166
  25. 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 114
  26. 2024PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Acceleratorcited by 97
  27. 2024Phased Consistency Modelscited by 85
  28. 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
  29. 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Imagescited by 42
  30. 2024Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillationcited by 39
  31. 2024Accelerating Image Generation with Sub-path Linear Approximation Modelcited by 14
  32. 2024Turbo3D: Ultra-fast Text-to-3D Generationcited by 14
  33. 2024Accelerating Video Diffusion Models via Distribution Matchingcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 16.

26 papers.

Sort:

By area:

  1. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
  2. 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
  3. 2025Diffusion-NPO: Negative Preference Optimization for Better Preference Aligned Generation of Diffusion Modelscited by 23
  4. 2025Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assetscited by 22
  5. 2025UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinementcited by 16
  6. 2025Hunyuan3D Studio: End-to-End AI Pipeline for Game-Ready 3D Asset Generationcited by 13
  7. 2026Elastic Diffusion Transformercited by 8
  8. 2025NaTex: Seamless Texture Generation as Latent Color Diffusioncited by 7
  9. 2025Light-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshescited by 6
  10. 2026Mesh-Pro: Asynchronous Advantage-guided Ranking Preference Optimization for Artist-style Quadrilateral Mesh Generationcited by 3
  11. 2026Know3D: Prompting 3D Generation with Knowledge from Vision-Language Modelscited by 2
  12. 2026UniMesh: Unifying 3D Mesh Understanding and Generationcited by 2
14 more
  1. 2026AssetGen: Deployable 3D Asset Generation at Interactive Speedcited by 2
  2. 2025Self-NPO: Data-Free Diffusion Model Enhancement via Truncated Diffusion Fine-Tuningcited by 1
  3. 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generationcited by 1
  4. 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learningcited by 1
  5. 2026MSVS-VAE: Multi-Scale Anchored VecSet for High-Fidelity 3D Reconstructioncited by 1
  6. 2026ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixescited by 1
  7. 2025Generative AI Pipeline for Interactive Prompt-driven 2D-to-3D Vascular Reconstruction for Fontan Geometries from Contrast-Enhanced X-Ray Fluoroscopy Imagingcited by 0
  8. 2026ATATA: One Algorithm to Align Them Allcited by 0
  9. 2026Generative Shape Reconstruction with Geometry-Guided Langevin Dynamicscited by 0
  10. 2026Towards Realistic and Consistent Orbital Video Generation via 3D Foundation Priorscited by 0
  11. 2026Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformerscited by 0
  12. 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Imagecited by 0
  13. 2026Point2Part: Unified 3D Partitioning from Point Promptscited by 0
  14. 2026Channel Match: Calibrating Shape Latents for Few-Step 3D Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Rethinking 3D Shape Generation: Diffusion over Superquadrics
  2. 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generation
  3. 2024Efficient 3D Shape Generation via Diffusion Mamba with Bidirectional SSMs
  4. 2025A Mesh Is Worth 512 Numbers: Spectral-domain Diffusion Modeling for High-dimension Shape Generation
  5. 2026Flash-VAED: Plug-and-Play VAE Decoders for Efficient Video Generation
  6. 2022TetraDiffusion: Tetrahedral Diffusion Models for 3D Shape Generation
  7. 2025DyDiT++: Diffusion Transformers with Timestep and Spatial Dynamics for Efficient Visual Generation
  8. 2025Few-step Flow for 3D Generation via Marginal-Data Transport Distillation