mlsanityData to 7 Oct 2026

EAGLE-360: Embodied Active Global-to-Local Exploration in 360^circ

arXiv 2607.02479 ↗First posted 2 Jul 2026cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

While Multimodal Large Language Models (MLLMs) have demonstrated exceptional capabilities in standard visual understanding, adapting them for active visual search in 360^circ panoramic environments exposes fundamental limitations. Specifically, standard MLLMs struggle to effectively model inherent panoramic properties, such as severe polar distortion and continuous cylindrical topologies, which significantly degrades target detection accuracy. Consequently, existing panoramic search methods attempt to compensate by relying heavily on fragmented local viewpoints. Burdened by rigid initialization and a lack of global panoramic priors, these approaches suffer from myopic, inefficient exploration and struggle with robust error recovery when targets are out of view. To overcome these challenges, we propose EAGLE-360, a novel Embodied Active Global-to-Local Exploration framework. Rather than performing exhaustive local searches, EAGLE-360 leverages global priors to establish an initial holistic perspective, iteratively reasoning and progressively narrowing the search space. Architecturally, we adapt RoPE Rolling, a coordinate-shifting positional encoding mechanism, to seamlessly model the continuous topologies of panoramas. To facilitate this paradigm, we construct the large-scale EAGLE-360 dataset, comprising 14,000+ 4K panoramas and 70,000+ rounds of high-quality VQA dialogues. By employing a training pipeline that integrates Supervised Fine-Tuning (SFT) with Group Relative Policy Optimization (GRPO), we effectively elicit complex spatial reasoning and tool-calling capabilities. Extensive experiments demonstrate that EAGLE-360 establishes a new state-of-the-art for 360^circ visual search, achieving nearly an 8-fold increase in accuracy over the base model while significantly enhancing exploration efficiency.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 41 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

28 of 41 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026360deg Image Perception with MLLMs: A Comprehensive Benchmark and a Training-Free Method17 Mar
  2. 2025Dense360: Dense Understanding from Omnidirectional Panoramas17 Jun
  3. 2025Are Multimodal Large Language Models Ready for Omnidirectional Spatial Reasoning?17 May

Other references · 25

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  4. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  5. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  6. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  7. 2018Spherical CNNscited by 452
  8. 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 404
  9. 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 330
  10. 2023Towards Learning a Generalist Model for Embodied Navigationcited by 135
  11. 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 116
  12. 2019HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentationcited by 107
13 more
  1. 2020HoHoNet: 360 Indoor Holistic Understanding with Latent Horizontal Featurescited by 104
  2. 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 93
  3. 2021Pano-AVQA: Grounded Audio-Visual Question Answering on 360^circ Videoscited by 86
  4. 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
  5. 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
  6. 2019360-Indoor: Towards Learning Real-World Objects in 360deg Indoor Equirectangular Imagescited by 25
  7. 2023PanoSwin: a Pano-style Swin Transformer for Panorama Understandingcited by 18
  8. 2025Towards Omnidirectional Reasoning with 360-R1: A Dataset, Benchmark, and GRPO-based Methodcited by 13
  9. 2024SphereUFormer: A U-Shaped Transformer for Spherical 360 Perceptioncited by 12
  10. 2025ODI-Bench: Can MLLMs Understand Immersive Omnidirectional Environments?cited by 12
  11. 2025PanoSplatt3R: Leveraging Perspective Pretraining for Generalized Unposed Wide-Baseline Panorama Reconstructioncited by 7
  12. 2026PanoEnv: Exploring 3D Spatial Intelligence in Panoramic Environments with Reinforcement Learningcited by 7
  13. 2026ReasonNavi: Human-Inspired Global Map Reasoning for Zero-Shot Embodied Navigationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama World
  2. 2026PanoVLN: Towards Effective Panoramic Vision-and-Language Navigation
  3. 2026OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoning
  4. 2025PanoGen++: Domain-Adapted Text-Guided Panoramic Environment Generation for Vision-and-Language Navigation
  5. 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigation
  6. 2025NavBench: Probing Multimodal Large Language Models for Embodied Navigation
  7. 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers
  8. 2026OmniVLN: Omnidirectional 3D Perception and Token-Efficient LLM Reasoning for Visual-Language Navigation across Air and Ground Platforms