mlsanityData to 14 Oct 2026

UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generation

arXiv 2509.25079 ↗First posted 29 Sep 2025cs.CV cs.AI cs.GRcited by 20

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

High-fidelity 3D asset generation is crucial for various industries. While recent 3D pretrained models show strong capability in producing realistic content, most are built upon diffusion models and follow a two-stage pipeline that first generates geometry and then synthesizes appearance. Such a decoupled design tends to produce geometry-texture misalignment and non-negligible cost. In this paper, we propose UniLat3D, a unified framework that encodes geometry and appearance in a single latent space, enabling direct single-stage generation. Our key contribution is a geometry-appearance Unified VAE, which compresses high-resolution sparse features into a compact latent representation -- UniLat. UniLat integrates structural and visual information into a dense low-resolution latent, which can be efficiently decoded into diverse 3D formats, e.g., 3D Gaussians and meshes. Based on this unified representation, we train a single flow-matching model to map Gaussian noise directly into UniLat, eliminating redundant stages. Trained solely on public datasets, UniLat3D produces high-quality 3D assets in seconds from a single image, achieving superior appearance fidelity and geometric quality. More demos & code are available at https://unilat3d.github.io/

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 89 of its 94 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

89 of 94 references.

Closest ancestors · 28

Same direction, newest first

  1. 2025Gaussian Variation Field Diffusion for High-fidelity Video-to-4D Synthesis31 Jul
  2. 2025From One to More: Contextual Part Latents for 3D Generation11 Jul
  3. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Details19 Jun
  4. 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modeling20 May
  5. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assets12 May
  6. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation21 Jan
  7. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models24 Dec
  8. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models27 Nov
  9. 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generation4 Nov
  10. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
  11. 2024OctFusion: Octree-based Diffusion Models for 3D Shape Generation27 Aug
  12. 2024Atlas Gaussians Diffusion for 3D Generation23 Aug
16 more
  1. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets30 May
  2. 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Models26 May
  3. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refiner23 May
  4. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer23 May
  5. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
  6. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistency28 Dec
  7. 2023Sherpa3D: Boosting High-Fidelity Text-to-3D Generation via Coarse 3D Prior11 Dec
  8. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
  9. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  10. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
  11. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  13. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan
  14. 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
  15. 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
  16. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 61

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2022Classifier-Free Diffusion Guidancecited by 5,847
  7. 2022Flow Matching for Generative Modelingcited by 5,702
  8. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  9. 2015Fast R-CNNcited by 2,933
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  12. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
38 more
  1. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  2. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  3. 2025DINOv3cited by 1,414
  4. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  5. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  6. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  7. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  8. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  9. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 519
  10. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  11. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  12. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  13. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
  14. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
  15. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
  16. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
  17. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
  18. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
  19. 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
  20. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  21. 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 237
  22. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
  23. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
  24. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
  25. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
  26. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
  27. 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 178
  28. 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
  29. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
  30. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
  31. 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 118
  32. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
  33. 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 110
  34. 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 99
  35. 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
  36. 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 61
  37. 2024GaussianObject: High-Quality 3D Object Reconstruction from Four Views with Gaussian Splattingcited by 59
  38. 2024GenXD: Generating Any 3D and 4D Scenescited by 50

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 18.

20 papers.

Sort:

By area:

  1. 2025WorldGrow: Generating Infinite 3D Worldcited by 16
  2. 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesiscited by 15
  3. 2025Feedforward 3D Editing via Text-Steerable Image-to-3Dcited by 7
  4. 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generationcited by 6
  5. 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimationcited by 4
  6. 2026Generative 3D Gaussians with Learned Density Controlcited by 4
  7. 2026Grasp in Gaussians: Fast Monocular Reconstruction of Dynamic Hand-Object Interactionscited by 3
  8. 2026EVA01: Unified Native 3D Understanding and Generation via Mixture-of-Transformerscited by 3
  9. 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Modelscited by 3
  10. 2026Text-Image Conditioned 3D Generationcited by 2
  11. 2026TopoMesh: High-Fidelity Mesh Autoencoding via Topological Unificationcited by 2
  12. 2026WorldAct: Activating Monolithic 3D Worlds into Interactive-Ready Object-Centric Scenescited by 2
8 more
  1. 2026FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelitycited by 1
  2. 2026ATATA: One Algorithm to Align Them Allcited by 0
  3. 2026Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusioncited by 0
  4. 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillationcited by 0
  5. 2026Beyond Global Latents: Chunk-Based Sparse Grid VAE for Scalable 3D Modelingcited by 0
  6. 2026SCULPT: Subtractive Composition for 3D Part Generationcited by 0
  7. 2026Learning 3D Editing without Paired Supervision via Generative Prior Distillationcited by 0
  8. 2026HI3D 3.0 (Twinkle3D): Object-specific 3D Asset Generation with High Resolutioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Native and Compact Structured Latents for 3D Generation
  2. 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latents
  3. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers
  4. 2024Compress3D: a Compressed Latent Space for 3D Generation from a Single Image
  5. 2024GaussianAnything: Interactive Point Cloud Flow Matching For 3D Object Generation
  6. 2026Beyond Gaussian Bottlenecks: Topologically Aligned Encoding of Vision-Transformer Feature Spaces
  7. 2024Direct and Explicit 3D Generation from a Single Image
  8. 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generation