AstraLOD3: Zero-shot multimodal agentic reconstruction of LOD3 building models
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Automated LOD3 building modeling typically relies on purpose-built geometric or learning-based pipelines, limiting flexibility across heterogeneous buildings and input evidence conditions. This study investigates whether Astra, a general-purpose multimodal foundation model, can address these limitations through zero-shot reconstruction of LOD3 building models within an agentic framework under bounded autonomy. AstraLOD3 combines multi-view images, calibrated cameras, and a filtered sparse SfM point cloud with a natural-language reconstruction specification, while the Astra agent dynamically selects and executes computational procedures using Python and Blender. Across 35 runs, including 24 benchmark buildings, AstraLOD3 achieved a mean FRDS of 0.9647 and geometric agreement comparable to that of previous purpose-built methods. Controlled ablations further revealed the effects of reconstruction guidance, evidence modalities, model configuration, and run-to-run variability. The results demonstrate that structured LOD3 reconstruction can be formulated as a constrained agentic process rather than as a fixed pipeline. Future work will investigate adaptive refinement, user-guided correction, task-specific specialization, and damage-aware reconstruction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 49 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
17 of 49 references.
Closest ancestors · 3
Same direction, newest first
- 2025BIMgent: Towards Autonomous Building Modeling via Computer-use Agents8 Jun
- 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code2 Mar
- 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents9 Nov
Other references · 14
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Visual Instruction Tuningcited by 7,792
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2024Executable Code Actions Elicit Better LLM Agentscited by 537
- 2022City3D: Large-Scale Building Reconstruction from Airborne LiDAR Point Cloudscited by 22
- 2021Reconstructing Compact Building Models from Point Clouds Using Deep Implicit Fieldscited by 20
- 2023Scan2LoD3: Reconstructing semantic 3D building models at LoD3 using ray casting and Bayesian networkscited by 16
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Agentic Building-Aware Satellite Gaussian Splatting for Auditable Urban DSM Reconstruction
- 2026CoMa: Contextual Massing Generation with Vision-Language Models
- 2026BuildAnyPoint: 3D Building Structured Abstraction from Diverse Point Clouds
- 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction
- 2026WorldAgents: Can Foundation Image Models be Agents for 3D World Models?
- 2026Can Large Multimodal Models Inspect Buildings? A Hierarchical Benchmark for Structural Pathology Reasoning
- 2025UrbanWorld2.0: A Multimodal Agentic Framework for Reality-Aligned 3D World Generation at City-Scale
- 2026MMArch: Benchmarking Multimodal Reasoning Grounded in Architectural Evidence