Visibility-Guided Structured Measure Flow for Class-Conditioned 3D Gaussian Generation
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has made real-time, high-fidelity 3D rendering practical, yet turning this explicit representation into a native generative space remains an open challenge. Directly generating 3DGS objects is difficult because Gaussian primitives are unordered, variable-sized, locally dense, and highly sensitive to rendering behavior. We present VISTA-GS, a visibility-guided structured measure flow framework for class-conditioned 3D Gaussian generation. Instead of treating a 3DGS object as a flat primitive sequence or a generic latent token grid, we formulate it as a structured Gaussian measure weighted by opacity, anisotropic covariance, and multi-view visibility. Based on this formulation, we introduce a visibility-aware measure VAE that learns permutation-invariant, variable-size-compatible, and rendering-aware latent representations of 3DGS objects. We further develop a renderer-consistent measure flow that transports class-conditioned priors toward the learned 3DGS measure distribution while aligning the decoded objects with their multi-view rendering distributions. To preserve object layout and local details, VISTA-GS incorporates structure-preserving patch transport that couples global class semantics, local Gaussian measure patches, and spatial anchors during flow prediction. On VISTA-Obj30, VISTA-GS improves over the strongest baseline by roughly 60--72% across geometry, appearance, view-consistency error, and generation speed. This design enables efficient generation of coherent, detailed, and view-consistent 3D Gaussian objects without relying on per-instance optimization, multi-view image synthesis, or reconstruction-based lifting pipelines. Project code and model checkpoints will be released.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 40 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
32 of 40 references.
References · 32
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
20 more
- 2018Computational Optimal Transportcited by 780
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 2021Advances in Neural Renderingcited by 365
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
- 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 218
- 2024DiffGS: Functional Gaussian Splatting Diffusioncited by 51
- 2024GaussianCube: A Structured and Explicit Radiance Representation for 3D Generative Modelingcited by 45
- 2024L3DG: Latent 3D Gaussian Diffusioncited by 42
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesiscited by 34
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2024Atlas Gaussians Diffusion for 3D Generationcited by 15
- 2024GaussianAnything: Interactive Point Cloud Flow Matching For 3D Object Generationcited by 12
- 2026Generative 3D Gaussians with Learned Density Controlcited by 4
- 2025DirectTriGS: Triplane-based Gaussian Splatting Field Representation for 3D Generationcited by 3
- 2026PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generationcited by 2
Built on by
Not cited yet.