mlsanityData to 14 Oct 2026

NaLA: A 3D Native LLM Layout Agent for High-quality 3D Scene Generation

arXiv 2606.29395 ↗First posted 28 Jun 2026cs.CVcited by 2

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Recently, Large Language Models (LLMs) have emerged as promising layout agents for 3D scene generation. Existing layout agents still suffer from implausible layout generation because most of them convert 3D assets and 3D layouts into textual descriptions as inputs and outputs, which involves severe information loss due to the modality gap between texts and 3D assets and 3D layouts. We propose NaLA, a native 3D LLM layout Agent for high-quality 3D scene generation by placing 3D assets in the scene. For the inputs, NaLA encodes 3D scene boundaries and 3D assets directly into the LLM, preserving fine-grained geometry and enabling explicit reasoning over relationships like collisions, surface supporting, and containment. To accurately output the positions and orientations of assets, NaLA adopts a coarse-to-fine prediction mechanism that first predicts discrete poses in an autoregressive manner and then refines the discrete poses with a continuous regression. Trained on diverse layout datasets, NaLA attains strong geometric perception and layout coherence. Experiments demonstrate that NaLA outperforms prior layout agents in both generation quality and inference efficiency, with comprehensive ablation studies to verify each component's effectiveness.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 50 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

29 of 50 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generation5 May

Other references · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  5. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  6. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
  7. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  8. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
  9. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
  10. 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 183
  11. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
  12. 2023WonderJourney: Going from Anywhere to Everywherecited by 158
16 more
  1. 2022Superpoint Transformer for 3D Scene Instance Segmentationcited by 116
  2. 2023GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphscited by 97
  3. 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 96
  4. 2023NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Modelscited by 76
  5. 2022Scene Graph Generation: A Comprehensive Surveycited by 73
  6. 2025SpatialLM: Training Large Language Models for Structured Indoor Modelingcited by 65
  7. 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Modelscited by 64
  8. 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50
  9. 2024SceneTeller: Language-to-3D Scene Generationcited by 43
  10. 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
  11. 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoningcited by 28
  12. 20253D Scene Generation: A Surveycited by 24
  13. 2025InternScenes: A Large-scale Simulatable Indoor Scene Dataset with Realistic Layoutscited by 20
  14. 2024Regress, Don't Guess -- A Regression-like Loss on Number Tokens for Language Modelscited by 13
  15. 2025Imaginarium: Vision-guided High-Quality 3D Scene Layout Generationcited by 11
  16. 2025M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generationcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Towards Language-guided Interactive 3D Generation: LLMs as Layout Interpreter with Generative Feedback
  2. 2025PhiP-G: Physics-Guided Text-to-3D Compositional Scene Generation
  3. 2026SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs
  4. 2026Repurposing 3D Generative Model for Autoregressive Layout Generation
  5. 2026SceneAssistant: A Visual Feedback Agent for Open-Vocabulary 3D Scene Generation
  6. 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generation
  7. 2025Let Language Constrain Geometry: Vision-Language Models as Semantic and Spatial Critics for 3D Generation
  8. 20253UR-LLM: An End-to-End Multimodal Large Language Model for 3D Scene Understanding