mlsanityData to 14 Oct 2026

SimCRAFT: Distilling Remote Sensing Agents via Synthetic Trajectories and Contextual Retrieval-Augmented Fine-Tuning

arXiv 2608.30277 ↗First posted 31 Aug 2026cs.AI cs.MAcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

The unprecedented surge in Earth observation data volume and diversity has exposed a critical bottleneck for traditional manual workflows, catalyzing the emergence of Remote Sensing (RS) Agents. However, the practical deployment of these advanced agents is severely hindered by their heavy reliance on large-scale general-purpose LLMs, which lack deep domain expertise and impose prohibitive infrastructure demands. To resolve this, we propose SimCRAFT, a model-agnostic framework that distills sophisticated RS orchestration capabilities into a compact 7B-scale model. Addressing data scarcity, we first pair a multiagent synthesis engine with a Mock Execution Engine that checks schema correctness, inter-tool dependencies, and sensor/tool compatibility, producing SimRS-14k, a large-scale, constraint-validated workflow planning corpus. Second, we propose Contextual Retrieval-Augmented Fine-Tuning (CRAFT) that finetunes the model to reason analogically by adapting retrieved Standard Operating Procedures to novel queries under a noise-robust objective, generalizing RAFT to multi-step RS workflow planning without mechanical copying. Extensive experiments demonstrate that SimCRAFT-7B significantly outperforms openweights LLMs and rivals advanced closedsource models and specialized RS agents, while reproducing across three 7B backbones. This work contributes a competitive open-weights baseline for lightweight RS intelligence, enabling efficient autonomous deployment under resource-constrained or resource-conserving conditions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 38 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

23 of 38 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Designing Domain-Specific Agents via Hierarchical Task Abstraction Mechanism21 Nov
  2. 2025Earth-Agent: Unlocking the Full Landscape of Earth Observation with Agents27 Sep
  3. 2025ThinkGeo: Evaluating Tool-Augmented Agents for Remote Sensing Tasks29 May
  4. 2025GeoBenchX: Benchmarking LLMs in Agent Solving Multistep Geospatial Tasks23 Mar
  5. 2024GIS Copilot: Towards an Autonomous GIS Agent for Spatial Analysis5 Nov
  6. 2024RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent11 Jun

Other references · 17

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  5. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
  6. 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 393
  7. 2024RAFT: Adapting Language Model to Domain Specific RAGcited by 262
  8. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
  9. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 198
  10. 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 195
  11. 2024RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agentscited by 80
  12. 2024GTA: A Benchmark for General Tool Agentscited by 77
5 more
  1. 2025TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environmentscited by 69
  2. 2025RingMo-Agent: A Unified Remote Sensing Foundation Model for Multi-Platform and Multi-Modal Reasoningcited by 20
  3. 2025Geospatial Foundation Models to Enable Progress on Sustainable Development Goalscited by 10
  4. 2025CORE: Full-Path Evaluation of LLM Agents Beyond Final Statecited by 9
  5. 2025InstructRAG: Leveraging Retrieval-Augmented Generation on Instruction Graphs for LLM-Based Task Planningcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025CangLing-KnowFlow: A Unified Knowledge-and-Flow-fused Agent for Comprehensive Remote Sensing Applications
  2. 2025Multi-Agent Geospatial Copilots for Remote Sensing Workflows
  3. 2026OpenEarth-Agent: From Tool Calling to Tool Creation for Open-Environment Earth Observation
  4. 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directions
  5. 2026RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation
  6. 2026Earth-Agent-Pro: Towards Real-World Full-Chain Earth Observation with Agents
  7. 2026HiRS-Agent: A Hierarchical Multi-Agent System for Reliable Long-Horizon Remote Sensing Task Solving
  8. 2026Agentic AI in Remote Sensing: Foundations, Taxonomy, and Emerging Systems