mlsanityData to 7 Oct 2026

Fusion-Aware Direct 3D Gaussian Generation with Structured Patch Latent Flows

arXiv 2609.27779 ↗First posted 18 Aug 2026cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Class-guided 3D object generation is important for intelligent content creation, virtual environments, and digital asset design. Although 3D Gaussian Splatting (3DGS) offers an explicit and render-efficient representation, directly generating 3D Gaussian objects is difficult because Gaussian primitives are unordered, variable-sized, locally dense, and highly sensitive to rendering. Existing 3DGS generation methods usually depend on multi-view synthesis, reconstruction, or lifted 2D priors, fusing information mainly from observed views rather than modeling the intrinsic structural distribution of 3D Gaussian objects. This paper proposes a fusion-aware hierarchical Gaussian patch representation for direct class-guided 3DGS generation with rectified flow. Irregular Gaussian sets are decomposed into canonical local patches and encoded as structured tokens. The resulting hierarchical latent space fuses global class semantics, patch-level geometry and appearance, spatial correspondence, and rendering-sensitive cues. On this basis, we design a structure-aware rectified flow model with patch-position conditioning, global-local coupled velocity prediction, and density-aware velocity weighting, enabling direct latent generation of class-conditioned 3DGS objects within seconds. A render-feedback fusion strategy further aligns latent flow learning with decoded multi-view rendering quality. Experiments show that the proposed method generates 3D Gaussian objects with more coherent geometry, sharper local details, and better multi-view consistency than baseline latent generative models. Ablation studies confirm the contributions of hierarchical information fusion, global-local coupling, density-aware supervision, and render-feedback learning while preserving practical sampling efficiency overall.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 31 of its 40 references that are in the map. First posted on arXiv 18 Aug 2026.

Builds on

31 of 40 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis25 Nov
  2. 2024DiffGS: Functional Gaussian Splatting Diffusion25 Oct
  3. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models12 Oct
  4. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  5. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 26

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  6. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  7. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  8. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  9. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
  10. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  11. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  12. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
14 more
  1. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
  2. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
  3. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
  4. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
  5. 2023Text-to-3D using Gaussian Splattingcited by 299
  6. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  7. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  8. 2023Flow Matching on General Geometriescited by 260
  9. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
  10. 2023Simulation-free Schr"odinger bridges via score and flow matchingcited by 81
  11. 2024GaussianCube: A Structured and Explicit Radiance Representation for 3D Generative Modelingcited by 44
  12. 2024MVG-Splatting: Multi-View Guided Gaussian Splatting with Adaptive Quantile-Based Geometric Consistency Densificationcited by 16
  13. 2024Advancing 3D Point Cloud Understanding through Deep Transfer Learning: A Comprehensive Surveycited by 9
  14. 2025DirectTriGS: Triplane-based Gaussian Splatting Field Representation for 3D Generationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025GSV3D: Gaussian Splatting-based Geometric Distillation with Stable Video Diffusion for Single-Image 3D Object Generation
  2. 2025Dragen3D: Multiview Geometry Consistent 3D Gaussian Generation with Drag-Based Control
  3. 2024Enhancing Single Image to 3D Generation using Gaussian Splatting and Hybrid Diffusion Priors
  4. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors
  5. 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
  6. 2025Geometry and Perception Guided Gaussians for Multiview-consistent 3D Generation from a Single Image
  7. 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction
  8. 2025GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting