mlsanityData to 14 Oct 2026

Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignment

arXiv 2606.07117 ↗First posted 5 Jun 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents Native3D, the first end-to-end 3D scene generation framework that completely bypasses 2D intermediate representations. Traditional approaches typically require adapting 3D representations to the 2D domain to leverage pre-trained diffusion models, which inevitably introduces domain adaptation issues including geometric structural distortion and texture detail degradation. To address these limitations, we design a unified mesh-texture joint representation that simultaneously models both geometric structures and texture features through a Transformer-based scene encoder, effectively maintaining spatial relationships and visual consistency among objects within scenes. We further propose the 3D Representation Alignment Loss (3D REPA Loss), which employs an improved contrastive learning mechanism to align multi-level semantic representations in the latent space, significantly enhancing geometric and textural fidelity. Experimental results demonstrate that Native3D outperforms existing methods in both generation quality and editing flexibility, providing a novel solution for 3D scene editing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 43 references that are in the map. First posted on arXiv 5 Jun 2026.

Builds on

36 of 43 references.

References · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  7. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  8. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  9. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  10. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  11. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  12. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
24 more
  1. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  2. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  3. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  4. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  5. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
  6. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  7. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
  8. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  9. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212
  10. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  11. 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
  12. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
  13. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 123
  14. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
  15. 2025Diffuse and Disperse: Image Generation with Representation Regularizationcited by 70
  16. 2019COCO-GAN: Generation by Parts via Conditional Coordinatingcited by 67
  17. 2017Improved Adversarial Systems for 3D Object Generation and Reconstructioncited by 66
  18. 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
  19. 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 60
  20. 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priorscited by 43
  21. 2023Text2Immersion: Generative Immersive Scene with 3D Gaussianscited by 43
  22. 2024RoomPainter: View-Integrated Diffusion for Consistent Indoor Scene Texturingcited by 10
  23. 2018No-Reference Color Image Quality Assessment: From Entropy to Perceptual Qualitycited by 7
  24. 2025ReStyle3D: Scene-Level Appearance Transfer with Semantic Correspondencescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Any 3D Scene is Worth 1K Tokens: 3D-Grounded Representation for Scene Generation at Scale
  2. 20243D-SceneDreamer: Text-Driven 3D-Consistent Scene Generation
  3. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers
  4. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assets
  5. 2025TRELLISWorld: Training-Free World Generation from Object Generators
  6. 2024LT3SD: Latent Trees for 3D Scene Diffusion
  7. 2025SceneCompleter: Dense 3D Scene Completion for Generative Novel View Synthesis
  8. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models