Unleashing Vecset Diffusion Model for Fast Shape Generation
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
3D shape generation has greatly flourished through the development of so-called "native" 3D diffusion, particularly through the Vecset Diffusion Model (VDM). While recent advancements have shown promising results in generating high-resolution 3D shapes, VDM still struggles with high-speed generation. Challenges exist because of difficulties not only in accelerating diffusion sampling but also VAE decoding in VDM, areas under-explored in previous works. To address these challenges, we present FlashVDM, a systematic framework for accelerating both VAE and DiT in VDM. For DiT, FlashVDM enables flexible diffusion sampling with as few as 5 inference steps and comparable quality, which is made possible by stabilizing consistency distillation with our newly introduced Progressive Flow Distillation. For VAE, we introduce a lightning vecset decoder equipped with Adaptive KV Selection, Hierarchical Volume Decoding, and Efficient Network Design. By exploiting the locality of the vecset and the sparsity of shape surface in the volume, our decoder drastically lowers FLOPs, minimizing the overall decoding overhead. We apply FlashVDM to Hunyuan3D-2 to obtain Hunyuan3D-2 Turbo. Through systematic evaluation, we show that our model significantly outperforms existing fast 3D generation methods, achieving comparable performance to the state-of-the-art while reducing inference time by over 45x for reconstruction and 32x for generation. Code and models are available at https://github.com/Tencent/FlashVDM.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 56 of its 59 references that are in the map. First posted on arXiv 20 Mar 2025.
Builds on
56 of 59 references.
Closest ancestors · 11
Same direction, newest first
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Models10 Feb
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation21 Jan
- 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoders23 Dec
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets30 May
- 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refiner23 May
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer23 May
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
- 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
- 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan
Other references · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2023Consistency Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2022Token Merging: Your ViT But Fastercited by 1,021
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
33 more
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2023Adversarial Diffusion Distillationcited by 759
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2022On Distillation of Guided Diffusion Modelscited by 725
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2023Improved Techniques for Training Consistency Modelscited by 439
- 2023DeepCache: Accelerating Diffusion Models for Freecited by 359
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 237
- 2017Geometric GANcited by 233
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
- 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
- 2023Token Merging for Fast Stable Diffusioncited by 224
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
- 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANscited by 166
- 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 114
- 2024PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Acceleratorcited by 97
- 2024Phased Consistency Modelscited by 85
- 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
- 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Imagescited by 42
- 2024Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillationcited by 39
- 2024Accelerating Image Generation with Sub-path Linear Approximation Modelcited by 14
- 2024Turbo3D: Ultra-fast Text-to-3D Generationcited by 14
- 2024Accelerating Video Diffusion Models via Distribution Matchingcited by 11
Built on by
Citing papers per year: 2025: 10; 2026: 16.
26 papers.
Sort:
By area:
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
- 2025Diffusion-NPO: Negative Preference Optimization for Better Preference Aligned Generation of Diffusion Modelscited by 23
- 2025Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assetscited by 22
- 2025UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinementcited by 16
- 2025Hunyuan3D Studio: End-to-End AI Pipeline for Game-Ready 3D Asset Generationcited by 13
- 2026Elastic Diffusion Transformercited by 8
- 2025NaTex: Seamless Texture Generation as Latent Color Diffusioncited by 7
- 2025Light-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshescited by 6
- 2026Mesh-Pro: Asynchronous Advantage-guided Ranking Preference Optimization for Artist-style Quadrilateral Mesh Generationcited by 3
- 2026Know3D: Prompting 3D Generation with Knowledge from Vision-Language Modelscited by 2
- 2026UniMesh: Unifying 3D Mesh Understanding and Generationcited by 2
14 more
- 2026AssetGen: Deployable 3D Asset Generation at Interactive Speedcited by 2
- 2025Self-NPO: Data-Free Diffusion Model Enhancement via Truncated Diffusion Fine-Tuningcited by 1
- 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generationcited by 1
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learningcited by 1
- 2026MSVS-VAE: Multi-Scale Anchored VecSet for High-Fidelity 3D Reconstructioncited by 1
- 2026ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixescited by 1
- 2025Generative AI Pipeline for Interactive Prompt-driven 2D-to-3D Vascular Reconstruction for Fontan Geometries from Contrast-Enhanced X-Ray Fluoroscopy Imagingcited by 0
- 2026ATATA: One Algorithm to Align Them Allcited by 0
- 2026Generative Shape Reconstruction with Geometry-Guided Langevin Dynamicscited by 0
- 2026Towards Realistic and Consistent Orbital Video Generation via 3D Foundation Priorscited by 0
- 2026Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformerscited by 0
- 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Imagecited by 0
- 2026Point2Part: Unified 3D Partitioning from Point Promptscited by 0
- 2026Channel Match: Calibrating Shape Latents for Few-Step 3D Generationcited by 0
- 2026Channel Match: Calibrating Shape Latents for Few-Step 3D Generation11 Oct 2026
- 2026Point2Part: Unified 3D Partitioning from Point Prompts29 Sep 2026
- 2026ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixes1 Sep 2026
- 2026MSVS-VAE: Multi-Scale Anchored VecSet for High-Fidelity 3D Reconstruction27 Jul 2026
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning8 Jul 2026
- 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Image4 Jul 2026
- 2026Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers1 Jul 2026
- 2026AssetGen: Deployable 3D Asset Generation at Interactive Speed22 May 2026
- 2026UniMesh: Unifying 3D Mesh Understanding and Generation19 Apr 2026
- 2026Towards Realistic and Consistent Orbital Video Generation via 3D Foundation Priors14 Apr 2026
- 2026Generative Shape Reconstruction with Geometry-Guided Langevin Dynamics27 Mar 2026
- 2026Know3D: Prompting 3D Generation with Knowledge from Vision-Language Models24 Mar 2026
14 more
- 2026Mesh-Pro: Asynchronous Advantage-guided Ranking Preference Optimization for Artist-style Quadrilateral Mesh Generation28 Feb 2026
- 2026Elastic Diffusion Transformer15 Feb 2026
- 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generation27 Jan 2026
- 2026ATATA: One Algorithm to Align Them All16 Jan 2026
- 2025UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinement24 Dec 2025
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scale24 Nov 2025
- 2025NaTex: Seamless Texture Generation as Latent Color Diffusion20 Nov 2025
- 2025Light-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshes29 Sep 2025
- 2025Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assets25 Sep 2025
- 2025Generative AI Pipeline for Interactive Prompt-driven 2D-to-3D Vascular Reconstruction for Fontan Geometries from Contrast-Enhanced X-Ray Fluoroscopy Imaging16 Sep 2025
- 2025Hunyuan3D Studio: End-to-End AI Pipeline for Game-Ready 3D Asset Generation16 Sep 2025
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Details19 Jun 2025
- 2025Self-NPO: Data-Free Diffusion Model Enhancement via Truncated Diffusion Fine-Tuning17 May 2025
- 2025Diffusion-NPO: Negative Preference Optimization for Better Preference Aligned Generation of Diffusion Models16 May 2025
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
- 2025Diffusion-NPO: Negative Preference Optimization for Better Preference Aligned Generation of Diffusion Modelscited by 23
- 2026Elastic Diffusion Transformercited by 8
- 2025NaTex: Seamless Texture Generation as Latent Color Diffusioncited by 7
- 2025Self-NPO: Data-Free Diffusion Model Enhancement via Truncated Diffusion Fine-Tuningcited by 1
- 2026MSVS-VAE: Multi-Scale Anchored VecSet for High-Fidelity 3D Reconstructioncited by 1
- 2026ATATA: One Algorithm to Align Them Allcited by 0
- 2026Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformerscited by 0
- 2026MSVS-VAE: Multi-Scale Anchored VecSet for High-Fidelity 3D Reconstruction27 Jul 2026
- 2026Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers1 Jul 2026
- 2026Elastic Diffusion Transformer15 Feb 2026
- 2026ATATA: One Algorithm to Align Them All16 Jan 2026
- 2025NaTex: Seamless Texture Generation as Latent Color Diffusion20 Nov 2025
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Details19 Jun 2025
- 2025Self-NPO: Data-Free Diffusion Model Enhancement via Truncated Diffusion Fine-Tuning17 May 2025
- 2025Diffusion-NPO: Negative Preference Optimization for Better Preference Aligned Generation of Diffusion Models16 May 2025
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
- 2025Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assetscited by 22
- 2025UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinementcited by 16
- 2025Hunyuan3D Studio: End-to-End AI Pipeline for Game-Ready 3D Asset Generationcited by 13
- 2025Light-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshescited by 6
- 2026UniMesh: Unifying 3D Mesh Understanding and Generationcited by 2
- 2026AssetGen: Deployable 3D Asset Generation at Interactive Speedcited by 2
- 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generationcited by 1
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learningcited by 1
- 2026ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixescited by 1
- 2025Generative AI Pipeline for Interactive Prompt-driven 2D-to-3D Vascular Reconstruction for Fontan Geometries from Contrast-Enhanced X-Ray Fluoroscopy Imagingcited by 0
- 2026Generative Shape Reconstruction with Geometry-Guided Langevin Dynamicscited by 0
12 most cited of 16 All 16 (JSON)
- 2026Channel Match: Calibrating Shape Latents for Few-Step 3D Generation11 Oct 2026
- 2026Point2Part: Unified 3D Partitioning from Point Prompts29 Sep 2026
- 2026ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixes1 Sep 2026
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning8 Jul 2026
- 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Image4 Jul 2026
- 2026AssetGen: Deployable 3D Asset Generation at Interactive Speed22 May 2026
- 2026UniMesh: Unifying 3D Mesh Understanding and Generation19 Apr 2026
- 2026Towards Realistic and Consistent Orbital Video Generation via 3D Foundation Priors14 Apr 2026
- 2026Generative Shape Reconstruction with Geometry-Guided Langevin Dynamics27 Mar 2026
- 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generation27 Jan 2026
- 2025UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinement24 Dec 2025
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scale24 Nov 2025
12 newest of 16 All 16 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking 3D Shape Generation: Diffusion over Superquadrics
- 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generation
- 2024Efficient 3D Shape Generation via Diffusion Mamba with Bidirectional SSMs
- 2025A Mesh Is Worth 512 Numbers: Spectral-domain Diffusion Modeling for High-dimension Shape Generation
- 2026Flash-VAED: Plug-and-Play VAE Decoders for Efficient Video Generation
- 2022TetraDiffusion: Tetrahedral Diffusion Models for 3D Shape Generation
- 2025DyDiT++: Diffusion Transformers with Timestep and Spatial Dynamics for Efficient Visual Generation
- 2025Few-step Flow for 3D Generation via Marginal-Data Transport Distillation