LATTICE: Democratize High-Fidelity 3D Generation at Scale
Not on the map. Why?
Abstract (arXiv)
We present LATTICE, a new framework for high-fidelity 3D asset generation that bridges the quality and scalability gap between 3D and 2D generative models. While 2D image synthesis benefits from fixed spatial grids and well-established transformer architectures, 3D generation remains fundamentally more challenging due to the need to predict both spatial structure and detailed geometric surfaces from scratch. These challenges are exacerbated by the computational complexity of existing 3D representations and the lack of structured and scalable 3D asset encoding schemes. To address this, we propose VoxSet, a semi-structured representation that compresses 3D assets into a compact set of latent vectors anchored to a coarse voxel grid, enabling efficient and position-aware generation. VoxSet retains the simplicity and compression advantages of prior VecSet methods while introducing explicit structure into the latent space, allowing positional embeddings to guide generation and enabling strong token-level test-time scaling. Built upon this representation, LATTICE adopts a two-stage pipeline: first generating a sparse voxelized geometry anchor, then producing detailed geometry using a rectified flow transformer. Our method is simple at its core, but supports arbitrary resolution decoding, low-cost training, and flexible inference schemes, achieving state-of-the-art performance on various aspects, and offering a significant step toward scalable, high-quality 3D asset creation.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Builds on 52 of its 66 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
52 of 66 references.
References · 52
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
38 more
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 262
- 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 231
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 180
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
- 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 138
- 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
- 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
- 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 93
- 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 87
- 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 85
- 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 84
- 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generationcited by 82
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 76
- 2024Scaling Mesh Generation via Compressive Tokenizationcited by 71
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
- 2025X-Part: high fidelity and structure coherent shape decompositioncited by 42
- 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 40
- 2023ShapeGPT: 3D Shape Generation with A Unified Multi-modal Language Modelcited by 38
- 2025SynCity: Training-Free Generation of 3D Worldscited by 30
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 40.
41 papers.
Sort:
By area:
- 2025UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinementcited by 16
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtentscited by 10
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual Worldcited by 8
- 2026Elastic Diffusion Transformercited by 7
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flowcited by 6
- 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generatorcited by 5
- 2026Nexus: Native Mesh Generation with Diffusioncited by 5
- 2026Points-to-3D: Structure-Aware 3D Generation with Point Cloud Priorscited by 4
- 2026Seed3D 2.0: Advancing High-Fidelity Simulation-Ready 3D Content Generationcited by 4
- 2026Generative 3D Gaussians with Learned Density Controlcited by 4
- 2026FIRE3D: Feed-forward Interactive 3D Scene Reconstruction Within A Minutecited by 3
- 2026Hitem3D 2.0: Multi-View Guided Native 3D Texture Generationcited by 2
29 more
- 2026DVD: Discrete Voxel Diffusion for 3D Generation and Editingcited by 2
- 2026EVA01: Unified Native 3D Understanding and Generation via Mixture-of-Transformerscited by 2
- 2026ROAR-3D: Routing Arbitrary Views for High-Fidelity 3D Generationcited by 2
- 2026AssetGen: Deployable 3D Asset Generation at Interactive Speedcited by 2
- 2026TanGO: Training-Free 3D Editing via Tangent-Space Guidance and Optimizationcited by 2
- 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generationcited by 1
- 2026SK-Adapter: Skeleton-Based Structural Control for Native 3D Generationcited by 1
- 2026Know3D: Prompting 3D Generation with Knowledge from Vision-Language Modelscited by 1
- 2026Velocity-Space 3D Asset Editingcited by 1
- 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generationcited by 1
- 2026DreamCharacter-1: From 3D Generative Foundation Models to Product-Ready Character Generationcited by 1
- 2026SpatialCrafter: Single Image World Modeling with Generative 3D Proxiescited by 1
- 2026Flow3D-OPD: Multi-Teacher On-Policy Distillation for 3D Geometry Generation with Flow-Matching Diffusion Transformercited by 1
- 2026Point-MF: Stabilizing One-Step Mean Flows for Single-Image Point Cloud Reconstructioncited by 0
- 2026ISAP-3D: Identity-Slot Aligned Part-Aware 3D Generationcited by 0
- 2026Home3D 1.0: A High-Fidelity Image-to-3D Asset Generation System for Interior Designcited by 0
- 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Imagecited by 0
- 2026MSVS-VAE: Multi-Scale Anchored VecSet for High-Fidelity 3D Reconstructioncited by 0
- 2026AIMold: An Autonomous AI-based Pipeline for Complex Mold Designcited by 0
- 2026Beyond Global Latents: Chunk-Based Sparse Grid VAE for Scalable 3D Modelingcited by 0
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editingcited by 0
- 2026MegaParts: Scaling Part-Aware 3D Object Generation to 300 Parts via Token-Efficient Autoregressive Modelingcited by 0
- 2026MultiCube: Compositional 3D Generation With Part-Level Semantic and Spatial Controlcited by 0
- 2026ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixescited by 0
- 2026Scaling 3D Generative Priors to Large-Scale Scene Meshes from Multi-View Imagescited by 0
- 2026PLSR: Progressive and Localized Super-Resolution of 3D Objects via Localized Latent Voxel Diffusioncited by 0
- 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generationcited by 0
- 2026MeshOctave: Vertex Split-and-Rewire Cascades for Native Mesh Generationcited by 0
- 2026Flow Matching Reinforcement for 3D Mesh Generation via Dynamic Homing Optimizationcited by 0
- 2026Flow Matching Reinforcement for 3D Mesh Generation via Dynamic Homing Optimization1 Oct 2026
- 2026MeshOctave: Vertex Split-and-Rewire Cascades for Native Mesh Generation30 Sep 2026
- 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generation28 Sep 2026
- 2026FIRE3D: Feed-forward Interactive 3D Scene Reconstruction Within A Minute8 Sep 2026
- 2026Flow3D-OPD: Multi-Teacher On-Policy Distillation for 3D Geometry Generation with Flow-Matching Diffusion Transformer7 Sep 2026
- 2026PLSR: Progressive and Localized Super-Resolution of 3D Objects via Localized Latent Voxel Diffusion6 Sep 2026
- 2026Scaling 3D Generative Priors to Large-Scale Scene Meshes from Multi-View Images6 Sep 2026
- 2026ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixes1 Sep 2026
- 2026SpatialCrafter: Single Image World Modeling with Generative 3D Proxies27 Aug 2026
- 2026MultiCube: Compositional 3D Generation With Part-Level Semantic and Spatial Control20 Aug 2026
- 2026MegaParts: Scaling Part-Aware 3D Object Generation to 300 Parts via Token-Efficient Autoregressive Modeling14 Aug 2026
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing3 Aug 2026
29 more
- 2026Beyond Global Latents: Chunk-Based Sparse Grid VAE for Scalable 3D Modeling3 Aug 2026
- 2026AIMold: An Autonomous AI-based Pipeline for Complex Mold Design1 Aug 2026
- 2026MSVS-VAE: Multi-Scale Anchored VecSet for High-Fidelity 3D Reconstruction27 Jul 2026
- 2026TanGO: Training-Free 3D Editing via Tangent-Space Guidance and Optimization16 Jul 2026
- 2026Nexus: Native Mesh Generation with Diffusion15 Jul 2026
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flow12 Jul 2026
- 2026DreamCharacter-1: From 3D Generative Foundation Models to Product-Ready Character Generation8 Jul 2026
- 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Image4 Jul 2026
- 2026Home3D 1.0: A High-Fidelity Image-to-3D Asset Generation System for Interior Design26 Jun 2026
- 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generation25 Jun 2026
- 2026ISAP-3D: Identity-Slot Aligned Part-Aware 3D Generation10 Jun 2026
- 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generator27 May 2026
- 2026AssetGen: Deployable 3D Asset Generation at Interactive Speed22 May 2026
- 2026ROAR-3D: Routing Arbitrary Views for High-Fidelity 3D Generation20 May 2026
- 2026EVA01: Unified Native 3D Understanding and Generation via Mixture-of-Transformers16 May 2026
- 2026Generative 3D Gaussians with Learned Density Control8 May 2026
- 2026DVD: Discrete Voxel Diffusion for 3D Generation and Editing8 May 2026
- 2026Velocity-Space 3D Asset Editing8 May 2026
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World6 May 2026
- 2026Point-MF: Stabilizing One-Step Mean Flows for Single-Image Point Cloud Reconstruction27 Apr 2026
- 2026Seed3D 2.0: Advancing High-Fidelity Simulation-Ready 3D Content Generation22 Apr 2026
- 2026Hitem3D 2.0: Multi-View Guided Native 3D Texture Generation10 Apr 2026
- 2026Know3D: Prompting 3D Generation with Knowledge from Vision-Language Models24 Mar 2026
- 2026Points-to-3D: Structure-Aware 3D Generation with Point Cloud Priors19 Mar 2026
- 2026SK-Adapter: Skeleton-Based Structural Control for Native 3D Generation14 Mar 2026
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents6 Mar 2026
- 2026Elastic Diffusion Transformer15 Feb 2026
- 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generation27 Jan 2026
- 2025UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinement24 Dec 2025
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtentscited by 10
- 2026Elastic Diffusion Transformercited by 7
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flowcited by 6
- 2026Nexus: Native Mesh Generation with Diffusioncited by 5
- 2026DVD: Discrete Voxel Diffusion for 3D Generation and Editingcited by 2
- 2026TanGO: Training-Free 3D Editing via Tangent-Space Guidance and Optimizationcited by 2
- 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generationcited by 1
- 2026Flow3D-OPD: Multi-Teacher On-Policy Distillation for 3D Geometry Generation with Flow-Matching Diffusion Transformercited by 1
- 2026MSVS-VAE: Multi-Scale Anchored VecSet for High-Fidelity 3D Reconstructioncited by 0
- 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generationcited by 0
- 2026Flow Matching Reinforcement for 3D Mesh Generation via Dynamic Homing Optimizationcited by 0
- 2026Flow Matching Reinforcement for 3D Mesh Generation via Dynamic Homing Optimization1 Oct 2026
- 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generation28 Sep 2026
- 2026Flow3D-OPD: Multi-Teacher On-Policy Distillation for 3D Geometry Generation with Flow-Matching Diffusion Transformer7 Sep 2026
- 2026MSVS-VAE: Multi-Scale Anchored VecSet for High-Fidelity 3D Reconstruction27 Jul 2026
- 2026TanGO: Training-Free 3D Editing via Tangent-Space Guidance and Optimization16 Jul 2026
- 2026Nexus: Native Mesh Generation with Diffusion15 Jul 2026
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flow12 Jul 2026
- 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generation25 Jun 2026
- 2026DVD: Discrete Voxel Diffusion for 3D Generation and Editing8 May 2026
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents6 Mar 2026
- 2026Elastic Diffusion Transformer15 Feb 2026
- 2025UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinementcited by 16
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual Worldcited by 8
- 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generatorcited by 5
- 2026Points-to-3D: Structure-Aware 3D Generation with Point Cloud Priorscited by 4
- 2026Seed3D 2.0: Advancing High-Fidelity Simulation-Ready 3D Content Generationcited by 4
- 2026Generative 3D Gaussians with Learned Density Controlcited by 4
- 2026FIRE3D: Feed-forward Interactive 3D Scene Reconstruction Within A Minutecited by 3
- 2026Hitem3D 2.0: Multi-View Guided Native 3D Texture Generationcited by 2
- 2026ROAR-3D: Routing Arbitrary Views for High-Fidelity 3D Generationcited by 2
- 2026AssetGen: Deployable 3D Asset Generation at Interactive Speedcited by 2
- 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generationcited by 1
- 2026SK-Adapter: Skeleton-Based Structural Control for Native 3D Generationcited by 1
12 most cited of 27 All 27 (JSON)
- 2026MeshOctave: Vertex Split-and-Rewire Cascades for Native Mesh Generation30 Sep 2026
- 2026FIRE3D: Feed-forward Interactive 3D Scene Reconstruction Within A Minute8 Sep 2026
- 2026PLSR: Progressive and Localized Super-Resolution of 3D Objects via Localized Latent Voxel Diffusion6 Sep 2026
- 2026Scaling 3D Generative Priors to Large-Scale Scene Meshes from Multi-View Images6 Sep 2026
- 2026ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixes1 Sep 2026
- 2026MultiCube: Compositional 3D Generation With Part-Level Semantic and Spatial Control20 Aug 2026
- 2026MegaParts: Scaling Part-Aware 3D Object Generation to 300 Parts via Token-Efficient Autoregressive Modeling14 Aug 2026
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing3 Aug 2026
- 2026Beyond Global Latents: Chunk-Based Sparse Grid VAE for Scalable 3D Modeling3 Aug 2026
- 2026AIMold: An Autonomous AI-based Pipeline for Complex Mold Design1 Aug 2026
- 2026DreamCharacter-1: From 3D Generative Foundation Models to Product-Ready Character Generation8 Jul 2026
- 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Image4 Jul 2026
12 newest of 27 All 27 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Native and Compact Structured Latents for 3D Generation
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusion
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers
- 2026Meshy T2: Fast Native Mesh Generation with Flow Matching
- 2026Rethinking 3D Shape Generation: Diffusion over Superquadrics
- 2024Compress3D: a Compressed Latent Space for 3D Generation from a Single Image
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generation