mlsanityData to 14 Oct 2026

RS-Claw-Evolution: Environment-Feedback-Driven Evolution for Lightweight Remote Sensing Agents in Long-Horizon Tasks

arXiv 2609.22258 ↗First posted 6 Sep 2026cs.LG cs.AI cs.CVcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Large language model-driven remote sensing (RS) agents offer a promising approach to automating geospatial analysis. However, lightweight RS agents based on compact language models struggle with multi-step interactive tasks due to loss of long-horizon states, inefficient environmental feedback utilization, and sparse optimization signals. We propose RS-Claw-Evolution, an environment-feedback-driven framework that progressively improves lightweight agents through three stages. Interaction evolution uses executable code to control observations, maintain intermediate states, and reduce context redundancy. Experience evolution combines failure-aware trajectory generation with error-turn masking to learn from informative failure-recovery experiences without imitating faulty actions. Decision evolution uses reinforcement learning with multi-dimensional environment rewards and turn-level advantage protection to optimize tool-use behaviors and improve credit assignment in long sequences. On Earth-Bench, the optimized Qwen3-4B-based agent achieves 65.9% accuracy in Autonomous Planning mode, outperforming the untrained Qwen3-32B baseline (43.8%) and DeepSeek-V3.1 (60.8%), while approaching GPT-5 (71.6%). These results demonstrate that learning from environmental feedback can improve lightweight agents and narrow their performance gap with larger models in long-horizon RS tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 37 of its 92 references that are in the map. First posted on arXiv 6 Sep 2026.

Builds on

37 of 92 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026RS-Claw: Progressive Active Tool Exploration via Hierarchical Skill Trees for Remote Sensing Agents13 May
  2. 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMs9 Apr
  3. 2025Earth-Agent: Unlocking the Full Landscape of Earth Observation with Agents27 Sep
  4. 2025ThinkGeo: Evaluating Tool-Augmented Agents for Remote Sensing Tasks29 May
  5. 2025Multi-Agent Geospatial Copilots for Remote Sensing Workflows27 Jan
  6. 2024RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent11 Jun

Other references · 31

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  7. 2023Let's Verify Step by Stepcited by 3,789
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  9. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  10. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  11. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  12. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
19 more
  1. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  2. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
  3. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  4. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
  5. 2023JudgeLM: Fine-tuned Large Language Models are Scalable Judgescited by 367
  6. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
  7. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
  8. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
  9. 2023FireAct: Toward Language Agent Fine-tuningcited by 256
  10. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
  11. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
  12. 2025Agentic Reinforced Policy Optimizationcited by 172
  13. 2025ACON: Optimizing Context Compression for Long-horizon LLM Agentscited by 136
  14. 2025Agent Lightning: Train ANY AI Agents with Reinforcement Learningcited by 109
  15. 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 85
  16. 2025Tree Search for LLM Agent Reinforcement Learningcited by 79
  17. 2024Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysiscited by 63
  18. 2026OpenEarthAgent: A Unified Framework for Tool-Augmented Geospatial Agentscited by 15
  19. 2025Geo-OLM: Enabling Sustainable Earth Observation Studies with Cost-Efficient Open Language Models & State-Driven Workflowscited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026HiRS-Agent: A Hierarchical Multi-Agent System for Reliable Long-Horizon Remote Sensing Task Solving
  2. 2026RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation
  3. 2026Agentic AI in Remote Sensing: Foundations, Taxonomy, and Emerging Systems
  4. 2026Experience-Driven Multi-Agent Systems Are Training-free Context-aware Earth Observers
  5. 2026SimCRAFT: Distilling Remote Sensing Agents via Synthetic Trajectories and Contextual Retrieval-Augmented Fine-Tuning
  6. 2026GeoForge: Non-Parametric Self-Evolving Agents for Earth-Observation Reasoning
  7. 2025GeoEvolve: Automating Geospatial Model Discovery via Multi-Agent Large Language Models
  8. 2025GeoVLM-R1: Reinforcement Fine-Tuning for Improved Remote Sensing Reasoning