mlsanityData to 7 Oct 2026

LATTICE: Democratize High-Fidelity 3D Generation at Scale

arXiv 2512.03052 ↗First posted 24 Nov 2025cs.GR cs.CVcited by 41

Not on the map. Why?

Abstract (arXiv)

We present LATTICE, a new framework for high-fidelity 3D asset generation that bridges the quality and scalability gap between 3D and 2D generative models. While 2D image synthesis benefits from fixed spatial grids and well-established transformer architectures, 3D generation remains fundamentally more challenging due to the need to predict both spatial structure and detailed geometric surfaces from scratch. These challenges are exacerbated by the computational complexity of existing 3D representations and the lack of structured and scalable 3D asset encoding schemes. To address this, we propose VoxSet, a semi-structured representation that compresses 3D assets into a compact set of latent vectors anchored to a coarse voxel grid, enabling efficient and position-aware generation. VoxSet retains the simplicity and compression advantages of prior VecSet methods while introducing explicit structure into the latent space, allowing positional embeddings to guide generation and enabling strong token-level test-time scaling. Built upon this representation, LATTICE adopts a two-stage pipeline: first generating a sparse voxelized geometry anchor, then producing detailed geometry using a rectified flow transformer. Our method is simple at its core, but supports arbitrary resolution decoding, low-cost training, and flexible inference schemes, achieving state-of-the-art performance on various aspects, and offering a significant step toward scalable, high-quality 3D asset creation.

Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Builds on 52 of its 66 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

52 of 66 references.

References · 52

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2022Classifier-Free Diffusion Guidancecited by 5,717
  8. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  9. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  10. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  12. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
38 more
  1. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  2. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  3. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  4. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  5. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  6. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  7. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
  8. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  9. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  10. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  11. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  12. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  13. 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 262
  14. 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
  15. 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
  16. 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 231
  17. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
  18. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
  19. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
  20. 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 180
  21. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
  22. 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 138
  23. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
  24. 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
  25. 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
  26. 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
  27. 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 93
  28. 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 87
  29. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 85
  30. 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 84
  31. 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generationcited by 82
  32. 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 76
  33. 2024Scaling Mesh Generation via Compressive Tokenizationcited by 71
  34. 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
  35. 2025X-Part: high fidelity and structure coherent shape decompositioncited by 42
  36. 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 40
  37. 2023ShapeGPT: 3D Shape Generation with A Unified Multi-modal Language Modelcited by 38
  38. 2025SynCity: Training-Free Generation of 3D Worldscited by 30

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 40.

41 papers.

Sort:

By area:

  1. 2025UltraShape 1.0: High-Fidelity 3D Shape Generation via Scalable Geometric Refinementcited by 16
  2. 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtentscited by 10
  3. 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual Worldcited by 8
  4. 2026Elastic Diffusion Transformercited by 7
  5. 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flowcited by 6
  6. 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generatorcited by 5
  7. 2026Nexus: Native Mesh Generation with Diffusioncited by 5
  8. 2026Points-to-3D: Structure-Aware 3D Generation with Point Cloud Priorscited by 4
  9. 2026Seed3D 2.0: Advancing High-Fidelity Simulation-Ready 3D Content Generationcited by 4
  10. 2026Generative 3D Gaussians with Learned Density Controlcited by 4
  11. 2026FIRE3D: Feed-forward Interactive 3D Scene Reconstruction Within A Minutecited by 3
  12. 2026Hitem3D 2.0: Multi-View Guided Native 3D Texture Generationcited by 2
29 more
  1. 2026DVD: Discrete Voxel Diffusion for 3D Generation and Editingcited by 2
  2. 2026EVA01: Unified Native 3D Understanding and Generation via Mixture-of-Transformerscited by 2
  3. 2026ROAR-3D: Routing Arbitrary Views for High-Fidelity 3D Generationcited by 2
  4. 2026AssetGen: Deployable 3D Asset Generation at Interactive Speedcited by 2
  5. 2026TanGO: Training-Free 3D Editing via Tangent-Space Guidance and Optimizationcited by 2
  6. 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generationcited by 1
  7. 2026SK-Adapter: Skeleton-Based Structural Control for Native 3D Generationcited by 1
  8. 2026Know3D: Prompting 3D Generation with Knowledge from Vision-Language Modelscited by 1
  9. 2026Velocity-Space 3D Asset Editingcited by 1
  10. 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generationcited by 1
  11. 2026DreamCharacter-1: From 3D Generative Foundation Models to Product-Ready Character Generationcited by 1
  12. 2026SpatialCrafter: Single Image World Modeling with Generative 3D Proxiescited by 1
  13. 2026Flow3D-OPD: Multi-Teacher On-Policy Distillation for 3D Geometry Generation with Flow-Matching Diffusion Transformercited by 1
  14. 2026Point-MF: Stabilizing One-Step Mean Flows for Single-Image Point Cloud Reconstructioncited by 0
  15. 2026ISAP-3D: Identity-Slot Aligned Part-Aware 3D Generationcited by 0
  16. 2026Home3D 1.0: A High-Fidelity Image-to-3D Asset Generation System for Interior Designcited by 0
  17. 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Imagecited by 0
  18. 2026MSVS-VAE: Multi-Scale Anchored VecSet for High-Fidelity 3D Reconstructioncited by 0
  19. 2026AIMold: An Autonomous AI-based Pipeline for Complex Mold Designcited by 0
  20. 2026Beyond Global Latents: Chunk-Based Sparse Grid VAE for Scalable 3D Modelingcited by 0
  21. 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editingcited by 0
  22. 2026MegaParts: Scaling Part-Aware 3D Object Generation to 300 Parts via Token-Efficient Autoregressive Modelingcited by 0
  23. 2026MultiCube: Compositional 3D Generation With Part-Level Semantic and Spatial Controlcited by 0
  24. 2026ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixescited by 0
  25. 2026Scaling 3D Generative Priors to Large-Scale Scene Meshes from Multi-View Imagescited by 0
  26. 2026PLSR: Progressive and Localized Super-Resolution of 3D Objects via Localized Latent Voxel Diffusioncited by 0
  27. 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generationcited by 0
  28. 2026MeshOctave: Vertex Split-and-Rewire Cascades for Native Mesh Generationcited by 0
  29. 2026Flow Matching Reinforcement for 3D Mesh Generation via Dynamic Homing Optimizationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Native and Compact Structured Latents for 3D Generation
  2. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer
  3. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusion
  4. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers
  5. 2026Meshy T2: Fast Native Mesh Generation with Flow Matching
  6. 2026Rethinking 3D Shape Generation: Diffusion over Superquadrics
  7. 2024Compress3D: a Compressed Latent Space for 3D Generation from a Single Image
  8. 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generation