EAGLE-360: Embodied Active Global-to-Local Exploration in 360^circ
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
While Multimodal Large Language Models (MLLMs) have demonstrated exceptional capabilities in standard visual understanding, adapting them for active visual search in 360^circ panoramic environments exposes fundamental limitations. Specifically, standard MLLMs struggle to effectively model inherent panoramic properties, such as severe polar distortion and continuous cylindrical topologies, which significantly degrades target detection accuracy. Consequently, existing panoramic search methods attempt to compensate by relying heavily on fragmented local viewpoints. Burdened by rigid initialization and a lack of global panoramic priors, these approaches suffer from myopic, inefficient exploration and struggle with robust error recovery when targets are out of view. To overcome these challenges, we propose EAGLE-360, a novel Embodied Active Global-to-Local Exploration framework. Rather than performing exhaustive local searches, EAGLE-360 leverages global priors to establish an initial holistic perspective, iteratively reasoning and progressively narrowing the search space. Architecturally, we adapt RoPE Rolling, a coordinate-shifting positional encoding mechanism, to seamlessly model the continuous topologies of panoramas. To facilitate this paradigm, we construct the large-scale EAGLE-360 dataset, comprising 14,000+ 4K panoramas and 70,000+ rounds of high-quality VQA dialogues. By employing a training pipeline that integrates Supervised Fine-Tuning (SFT) with Group Relative Policy Optimization (GRPO), we effectively elicit complex spatial reasoning and tool-calling capabilities. Extensive experiments demonstrate that EAGLE-360 establishes a new state-of-the-art for 360^circ visual search, achieving nearly an 8-fold increase in accuracy over the base model while significantly enhancing exploration efficiency.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 41 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
28 of 41 references.
Closest ancestors · 3
Same direction, newest first
- 2026360deg Image Perception with MLLMs: A Comprehensive Benchmark and a Training-Free Method17 Mar
- 2025Dense360: Dense Understanding from Omnidirectional Panoramas17 Jun
- 2025Are Multimodal Large Language Models Ready for Omnidirectional Spatial Reasoning?17 May
Other references · 25
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2018Spherical CNNscited by 452
- 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 404
- 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 330
- 2023Towards Learning a Generalist Model for Embodied Navigationcited by 135
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 116
- 2019HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentationcited by 107
13 more
- 2020HoHoNet: 360 Indoor Holistic Understanding with Latent Horizontal Featurescited by 104
- 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 93
- 2021Pano-AVQA: Grounded Audio-Visual Question Answering on 360^circ Videoscited by 86
- 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
- 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
- 2019360-Indoor: Towards Learning Real-World Objects in 360deg Indoor Equirectangular Imagescited by 25
- 2023PanoSwin: a Pano-style Swin Transformer for Panorama Understandingcited by 18
- 2025Towards Omnidirectional Reasoning with 360-R1: A Dataset, Benchmark, and GRPO-based Methodcited by 13
- 2024SphereUFormer: A U-Shaped Transformer for Spherical 360 Perceptioncited by 12
- 2025ODI-Bench: Can MLLMs Understand Immersive Omnidirectional Environments?cited by 12
- 2025PanoSplatt3R: Leveraging Perspective Pretraining for Generalized Unposed Wide-Baseline Panorama Reconstructioncited by 7
- 2026PanoEnv: Exploring 3D Spatial Intelligence in Panoramic Environments with Reinforcement Learningcited by 7
- 2026ReasonNavi: Human-Inspired Global Map Reasoning for Zero-Shot Embodied Navigationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama World
- 2026PanoVLN: Towards Effective Panoramic Vision-and-Language Navigation
- 2026OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoning
- 2025PanoGen++: Domain-Adapted Text-Guided Panoramic Environment Generation for Vision-and-Language Navigation
- 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigation
- 2025NavBench: Probing Multimodal Large Language Models for Embodied Navigation
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers
- 2026OmniVLN: Omnidirectional 3D Perception and Token-Efficient LLM Reasoning for Visual-Language Navigation across Air and Ground Platforms