HiRS-Agent: A Hierarchical Multi-Agent System for Reliable Long-Horizon Remote Sensing Task Solving
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Recent advances in large language models and multimodal models have pushed remote sensing (RS) processing from simple perception models to agentic systems designed to tackle complex, long-horizon RS tasks. However, existing systems often rely on monolithic decision-making frameworks, which fail to accommodate the multi-stage, interdependent nature of RS tasks. This centralized approach leads to challenges such as unstable task execution, incorrect tool usage, and error propagation across stages. To address these issues, we propose HiRS-Agent, a hierarchical multi-agent system for long-horizon RS task solving. HiRS-Agent adopts a two-level collaborative architecture: the Manager Layer handles dynamic routing, step-level verification, replanning, and termination control, while the Specialist Layer organizes domain-specific tools according to the RS workflow and is responsible for subtask reasoning and tool execution. To further enhance the system's capability, we introduce a two-stage supervised tuning strategy and a verification-guided hierarchical reinforcement learning stage to jointly optimize coordination and tool-use policies. Experiments on Earth-Agent Benchmark and ThinkGeo show that HiRS-Agent substantially improves long-horizon tool-use capability and final-task correctness, demonstrating the effectiveness of structured multi-agent collaboration for reliable RS agents. The code is publicly available at https://github.com/IntelliSensing/HiRS-Agent.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 37 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
20 of 37 references.
Closest ancestors · 3
Same direction, newest first
- 2025CangLing-KnowFlow: A Unified Knowledge-and-Flow-fused Agent for Comprehensive Remote Sensing Applications17 Dec
- 2025Designing Domain-Specific Agents via Hierarchical Task Abstraction Mechanism21 Nov
- 2025ThinkGeo: Evaluating Tool-Augmented Agents for Remote Sensing Tasks29 May
Other references · 17
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 181
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Modelcited by 133
- 2024Multi-IF: Benchmarking LLMs on Multi-Turn and Multilingual Instructions Followingcited by 94
- 2023Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignmentcited by 71
5 more
- 2024Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysiscited by 60
- 2025Do Large Language Model Benchmarks Test Reliability?cited by 50
- 2024Remote Sensing ChatGPT: Solving Remote Sensing Tasks with ChatGPT and Visual Modelscited by 30
- 2026OpenEarthAgent: A Unified Framework for Tool-Augmented Geospatial Agentscited by 13
- 2025Agent-as-Tool: A Study on the Hierarchical Decision Making with Reinforcement Learningcited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent
- 2025Multi-Agent Geospatial Copilots for Remote Sensing Workflows
- 2026RS-Claw: Progressive Active Tool Exploration via Hierarchical Skill Trees for Remote Sensing Agents
- 2026Bridging Perception and Action: A Lightweight Multimodal Meta-Planner Framework for Robust Earth Observation Agents ↗
- 2026RS-Claw-Evolution: Environment-Feedback-Driven Evolution for Lightweight Remote Sensing Agents in Long-Horizon Tasks
- 2026TerraLogic: A Benchmark for Hierarchical Geospatial Reasoning in Earth Observation
- 2026Agentic AI in Remote Sensing: Foundations, Taxonomy, and Emerging Systems
- 2026SimCRAFT: Distilling Remote Sensing Agents via Synthetic Trajectories and Contextual Retrieval-Augmented Fine-Tuning