AREA3D: Active Reconstruction Agent with Unified Feed-Forward 3D Perception and Vision-Language Guidance
Not on the map. Why?
Abstract (arXiv)
Active 3D reconstruction enables an agent to autonomously select viewpoints to efficiently obtain accurate and complete scene geometry, rather than passively reconstructing scenes from pre-collected images. However, existing active reconstruction methods often rely on hand-crafted geometric heuristics, which can lead to redundant observations without substantially improving reconstruction quality. To address this limitation, we propose AREA3D, an active reconstruction agent that leverages feed-forward 3D reconstruction models and vision-language guidance. Our framework decouples view-uncertainty modeling from the underlying feed-forward reconstructor, enabling precise uncertainty estimation without expensive online optimization. In addition, an integrated vision-language model provides high-level semantic guidance, encouraging informative and diverse viewpoints beyond purely geometric cues. Extensive experiments on both scene-level and object-level benchmarks demonstrate that AREA3D achieves state-of-the-art reconstruction accuracy, particularly in the sparse-view regime. Code will be made available at: https://github.com/TianlingXu/AREA3D .
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 42 of its 50 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
42 of 50 references.
References · 42
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Qwen Technical Reportcited by 3,344
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
30 more
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 228
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 205
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
- 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
- 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 127
- 2023Bayes' Rays: Uncertainty Quantification for Neural Radiance Fieldscited by 91
- 2022Uncertainty Guided Policy for Active Robotic 3D Reconstruction using Neural Radiance Fieldscited by 54
- 2023NeU-NBV: Next Best View Planning Using Uncertainty Estimation in Image-Based Neural Renderingcited by 54
- 2025Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigationcited by 51
- 2024GenNBV: Generalizable Next-Best-View Policy for Active 3D Reconstructioncited by 39
- 2024ImagineNav: Prompting Vision-Language Models as Embodied Navigator through Scene Imaginationcited by 38
- 2024ActiveGS: Active Scene Reconstruction Using Gaussian Splattingcited by 35
- 2024ActiveSplat: High-Fidelity Scene Reconstruction through Active Gaussian Splattingcited by 32
- 2023Active Neural Mappingcited by 31
- 2023Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimizationcited by 28
- 2024NARUTO: Neural Active Reconstruction from Uncertain Target Observationscited by 28
- 2025NextBestPath: Efficient 3D Mapping of Unseen Environmentscited by 13
- 2025GLEAM: Learning Generalizable Exploration Policy for Active Mapping in Complex 3D Indoor Scenescited by 11
- 2024Multimodal LLM Guided Exploration and Active Mapping using Fisher Informationcited by 9
- 2025ExploreVLM: Closed-Loop Robot Exploration Task Planning with Vision-Language Modelscited by 7
- 2024Scene Exploration by Vision-Language Modelscited by 6
- 2024AIR-Embodied: An Efficient Active 3DGS-based Interaction and Reconstruction Framework with Embodied Large Language Modelcited by 4
- 2025History-Augmented Vision-Language Models for Frontier-Based Zero-Shot Object Navigationcited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026R2S-EGO: Dual-Proxy Refinement for Sparse-Capture Real-to-Simcited by 1
- 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Modelscited by 1
- 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verificationcited by 0
- 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verification30 Sep 2026
- 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Models6 Sep 2026
- 2026R2S-EGO: Dual-Proxy Refinement for Sparse-Capture Real-to-Sim7 Aug 2026
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective15 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026COLMAR: Cooperative View Policy Learning for Multi-Agent Active 3D Reconstruction ↗
- 2025IR3D-Bench: Evaluating Vision-Language Model Scene Understanding as Agentic Inverse Rendering
- 2024Agent3D-Zero: An Agent for Zero-shot 3D Understanding
- 2025Reg3D: Reconstructive Geometry Instruction Tuning for 3D Scene Understanding
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstruction
- 2026DeSpatial: The devil of Agentic Spatial Reasoning Lies in 3D Itself
- 2026GeneralVLA-2: Geometry-Aware Reconstruction and Governed Memory for Robot Planning
- 2026Agentic Collaborative Cognition for Zero-Shot 3D Understanding