UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generation
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
High-fidelity 3D asset generation is crucial for various industries. While recent 3D pretrained models show strong capability in producing realistic content, most are built upon diffusion models and follow a two-stage pipeline that first generates geometry and then synthesizes appearance. Such a decoupled design tends to produce geometry-texture misalignment and non-negligible cost. In this paper, we propose UniLat3D, a unified framework that encodes geometry and appearance in a single latent space, enabling direct single-stage generation. Our key contribution is a geometry-appearance Unified VAE, which compresses high-resolution sparse features into a compact latent representation -- UniLat. UniLat integrates structural and visual information into a dense low-resolution latent, which can be efficiently decoded into diverse 3D formats, e.g., 3D Gaussians and meshes. Based on this unified representation, we train a single flow-matching model to map Gaussian noise directly into UniLat, eliminating redundant stages. Trained solely on public datasets, UniLat3D produces high-quality 3D assets in seconds from a single image, achieving superior appearance fidelity and geometric quality. More demos & code are available at https://unilat3d.github.io/
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 89 of its 94 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
89 of 94 references.
Closest ancestors · 28
Same direction, newest first
- 2025Gaussian Variation Field Diffusion for High-fidelity Video-to-4D Synthesis31 Jul
- 2025From One to More: Contextual Part Latents for 3D Generation11 Jul
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Details19 Jun
- 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modeling20 May
- 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assets12 May
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation21 Jan
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models24 Dec
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models27 Nov
- 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generation4 Nov
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
- 2024OctFusion: Octree-based Diffusion Models for 3D Shape Generation27 Aug
- 2024Atlas Gaussians Diffusion for 3D Generation23 Aug
16 more
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets30 May
- 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Models26 May
- 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refiner23 May
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer23 May
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
- 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistency28 Dec
- 2023Sherpa3D: Boosting High-Fidelity Text-to-3D Generation via Coarse 3D Prior11 Dec
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
- 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
- 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 61
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2015Fast R-CNNcited by 2,933
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
38 more
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2025DINOv3cited by 1,414
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 519
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 237
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 178
- 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
- 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 118
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
- 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 110
- 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 99
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 61
- 2024GaussianObject: High-Quality 3D Object Reconstruction from Four Views with Gaussian Splattingcited by 59
- 2024GenXD: Generating Any 3D and 4D Scenescited by 50
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 18.
20 papers.
Sort:
By area:
- 2025WorldGrow: Generating Infinite 3D Worldcited by 16
- 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesiscited by 15
- 2025Feedforward 3D Editing via Text-Steerable Image-to-3Dcited by 7
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generationcited by 6
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimationcited by 4
- 2026Generative 3D Gaussians with Learned Density Controlcited by 4
- 2026Grasp in Gaussians: Fast Monocular Reconstruction of Dynamic Hand-Object Interactionscited by 3
- 2026EVA01: Unified Native 3D Understanding and Generation via Mixture-of-Transformerscited by 3
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Modelscited by 3
- 2026Text-Image Conditioned 3D Generationcited by 2
- 2026TopoMesh: High-Fidelity Mesh Autoencoding via Topological Unificationcited by 2
- 2026WorldAct: Activating Monolithic 3D Worlds into Interactive-Ready Object-Centric Scenescited by 2
8 more
- 2026FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelitycited by 1
- 2026ATATA: One Algorithm to Align Them Allcited by 0
- 2026Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusioncited by 0
- 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillationcited by 0
- 2026Beyond Global Latents: Chunk-Based Sparse Grid VAE for Scalable 3D Modelingcited by 0
- 2026SCULPT: Subtractive Composition for 3D Part Generationcited by 0
- 2026Learning 3D Editing without Paired Supervision via Generative Prior Distillationcited by 0
- 2026HI3D 3.0 (Twinkle3D): Object-specific 3D Asset Generation with High Resolutioncited by 0
- 2026HI3D 3.0 (Twinkle3D): Object-specific 3D Asset Generation with High Resolution8 Oct 2026
- 2026Learning 3D Editing without Paired Supervision via Generative Prior Distillation4 Sep 2026
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Models26 Aug 2026
- 2026SCULPT: Subtractive Composition for 3D Part Generation13 Aug 2026
- 2026Beyond Global Latents: Chunk-Based Sparse Grid VAE for Scalable 3D Modeling3 Aug 2026
- 2026FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelity17 Jun 2026
- 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillation20 May 2026
- 2026EVA01: Unified Native 3D Understanding and Generation via Mixture-of-Transformers16 May 2026
- 2026WorldAct: Activating Monolithic 3D Worlds into Interactive-Ready Object-Centric Scenes15 May 2026
- 2026Generative 3D Gaussians with Learned Density Control8 May 2026
- 2026Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusion6 May 2026
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation5 May 2026
8 more
- 2026Grasp in Gaussians: Fast Monocular Reconstruction of Dynamic Hand-Object Interactions14 Apr 2026
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generation13 Apr 2026
- 2026TopoMesh: High-Fidelity Mesh Autoencoding via Topological Unification25 Mar 2026
- 2026Text-Image Conditioned 3D Generation22 Mar 2026
- 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesis20 Jan 2026
- 2026ATATA: One Algorithm to Align Them All16 Jan 2026
- 2025Feedforward 3D Editing via Text-Steerable Image-to-3D15 Dec 2025
- 2025WorldGrow: Generating Infinite 3D World24 Oct 2025
- 2025WorldGrow: Generating Infinite 3D Worldcited by 16
- 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesiscited by 15
- 2025Feedforward 3D Editing via Text-Steerable Image-to-3Dcited by 7
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimationcited by 4
- 2026Generative 3D Gaussians with Learned Density Controlcited by 4
- 2026Grasp in Gaussians: Fast Monocular Reconstruction of Dynamic Hand-Object Interactionscited by 3
- 2026Text-Image Conditioned 3D Generationcited by 2
- 2026TopoMesh: High-Fidelity Mesh Autoencoding via Topological Unificationcited by 2
- 2026Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusioncited by 0
- 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillationcited by 0
- 2026Beyond Global Latents: Chunk-Based Sparse Grid VAE for Scalable 3D Modelingcited by 0
- 2026SCULPT: Subtractive Composition for 3D Part Generationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026HI3D 3.0 (Twinkle3D): Object-specific 3D Asset Generation with High Resolution8 Oct 2026
- 2026Learning 3D Editing without Paired Supervision via Generative Prior Distillation4 Sep 2026
- 2026SCULPT: Subtractive Composition for 3D Part Generation13 Aug 2026
- 2026Beyond Global Latents: Chunk-Based Sparse Grid VAE for Scalable 3D Modeling3 Aug 2026
- 2026CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillation20 May 2026
- 2026Generative 3D Gaussians with Learned Density Control8 May 2026
- 2026Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusion6 May 2026
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation5 May 2026
- 2026Grasp in Gaussians: Fast Monocular Reconstruction of Dynamic Hand-Object Interactions14 Apr 2026
- 2026TopoMesh: High-Fidelity Mesh Autoencoding via Topological Unification25 Mar 2026
- 2026Text-Image Conditioned 3D Generation22 Mar 2026
- 2026Motion 3-to-4: 3D Motion Reconstruction for 4D Synthesis20 Jan 2026
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Native and Compact Structured Latents for 3D Generation
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latents
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers
- 2024Compress3D: a Compressed Latent Space for 3D Generation from a Single Image
- 2024GaussianAnything: Interactive Point Cloud Flow Matching For 3D Object Generation
- 2026Beyond Gaussian Bottlenecks: Topologically Aligned Encoding of Vision-Transformer Feature Spaces
- 2024Direct and Explicit 3D Generation from a Single Image
- 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generation