mlsanityData to 7 Oct 2026

Towards Embodied Air-Ground Cooperative Object Search: Benchmark, Dataset and Agentic Method

arXiv 2609.08402 ↗First posted 8 Sep 2026cs.CV cs.AIcited by 1

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Air-Ground Object Search (AGOS) in urban environments is a challenging embodied task, which requires an Unmanned Aerial Vehicle (UAV) and an Unmanned Ground Vehicle (UGV) to jointly search for and verify a specified target vehicle from multi-view visual references. To study this underexplored problem, we introduce AGOS-Bench, the first dedicated benchmark for evaluating whether general-purpose Vision-Language Models (VLMs) can integrate aerial discoveries and ground-level verification through UAV-UGV cooperation. We further provide AGOS-Dataset as the companion resource of exemplary trajectories constructed by an automatic pipeline. It consists of 7.7k episodes for searching objects of diverse categories and attributes, spanning three difficulty levels. To address the AGOS task, we propose AGOS-Agent, a training-free and tool-augmented approach. The agentic method relieves VLMs from complex and dynamic coordination via a deliberate search-handoff-verify cooperation protocol, only demanding VLMs for scene understanding and decision-making. Extensive experiments on nine VLMs show that AGOS-Agent improves overall success rate for eight of the nine evaluated backbones while reducing decision steps for all nine. On the hard split, the SR and SPL of Gemini-3.6-Flash increase from 8.6% to 55.7% and from 7.6% to 44.0%, respectively.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 31 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

22 of 31 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026MECoBench: A Systematic Study of Multimodal Agent Collaboration in Embodied Environments30 Jun
  2. 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarms2 Jul
  3. 2025CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City Space18 Feb
  4. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents13 Feb
  5. 2024EmbodiedCity: A Benchmark Platform for Embodied Agent in Real-world City Environment12 Oct

Other references · 17

  1. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  2. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  3. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  4. 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
  5. 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 118
  6. 2025WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigationcited by 42
  7. 2024MetaUrban: An Embodied AI Simulation Platform for Urban Micromobilitycited by 19
  8. 2025AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoningcited by 19
  9. 2025PanoNav: Mapless Zero-Shot Object Navigation with Panoramic Scene Parsing and Dynamic Memorycited by 8
  10. 2025CitySeeker: How Do VLMS Explore Embodied Urban Navigation With Implicit Human Needs?cited by 8
  11. 2026CityCube: Benchmarking Cross-view Spatial Reasoning on Vision-Language Models in Urban Environmentscited by 8
  12. 2026CapNav: Benchmarking Vision Language Models on Capability-conditioned Indoor Navigationcited by 6
5 more
  1. 2025SayCoNav: Utilizing Large Language Models for Adaptive Collaboration in Decentralized Multi-Robot Navigationcited by 5
  2. 2026CARLA-Air: Fly Drones Inside a CARLA World -- A Unified Infrastructure for Air-Ground Embodied Intelligencecited by 5
  3. 2026AirSimAG: A High-Fidelity Simulation Platform for Air-Ground Collaborative Roboticscited by 3
  4. 2026AirGroundBench: Probing Spatial Intelligence in Multimodal Large Models under Heterogeneous Multi-View Embodied Collaborationcited by 2
  5. 2026IntentionNav: A Benchmark for Intent-Driven Object Navigation from Implicit Human Instructioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Autonomous UAV Visual Object Search in City Space: Benchmark and Agentic Methodology
  2. 2026AerialDojo-200K: A Large-Scale Benchmark Suite for Open-World Aerial Object-Goal Search
  3. 2026AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoning
  4. 2026Air-Ground Collaborative Vision-and-Language Navigation via Shared Bird's-Eye Maps
  5. 2025AirVista-II: An Agentic System for Embodied UAVs Toward Dynamic Scene Semantic Understanding
  6. 2026Finder: Agentic Closed-Loop Object Finding for Embodied Grounding
  7. 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
  8. 2026SatNav: A Scalable Benchmark for Long-Horizon UAV Vision-Language Navigation from Satellite Imagery