mlsanityData to 7 Oct 2026

SpaceMind: A Modular and Self-Evolving Embodied Vision-Language Agent Framework for Autonomous On-orbit Servicing

arXiv 2604.14399 ↗First posted 15 Apr 2026cs.RO cs.AI cs.SYcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

also in 1 more
Abstract (arXiv)

Autonomous on-orbit servicing demands embodied agents that perceive through visual sensors, reason about 3D spatial situations, and execute multi-phase tasks over extended horizons. We present SpaceMind, a modular and self-evolving vision-language model (VLM) agent framework that decomposes knowledge, tools, and reasoning into three independently extensible dimensions: skill modules with dynamic routing, Model Context Protocol (MCP) tools with configurable profiles, and injectable reasoning-mode skills. An MCP-Redis interface layer enables the same codebase to operate across simulation and physical hardware without modification, and a Skill Self-Evolution mechanism distills operational experience into persistent skill files without model fine-tuning. We validate SpaceMind through 192 closed-loop runs across five satellites, three task types, and two environments, a UE5 simulation and a physical laboratory, deliberately including degraded conditions to stress-test robustness. Under nominal conditions all modes achieve 90--100% navigation success; under degradation, the Prospective mode uniquely succeeds in search-and-approach tasks where other modes fail. A self-evolution study shows that the agent recovers from failure in four of six groups from a single failed episode, including complete failure to 100% success and inspection scores improving from 12 to 59 out of 100. Real-world validation confirms zero-code-modification transfer to a physical robot with 100% rendezvous success. Code: https://github.com/wuaodi/SpaceMind

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 33 references that are in the map. First posted on arXiv 15 Apr 2026.

Builds on

25 of 33 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Visual Language Models as Operator Agents in the Space Domain14 Jan

Other references · 24

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  6. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  7. 2025Qwen3-VL Technical Reportcited by 2,534
  8. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  9. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  10. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  11. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  12. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
12 more
  1. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  2. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
  3. 2023GPT-Driver: Learning to Drive with GPTcited by 344
  4. 2023Tool Learning with Foundation Modelscited by 302
  5. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
  6. 2019Satellite Pose Estimation Challenge: Dataset, Competition Design and Resultscited by 62
  7. 2021SPEED+: Next-Generation Dataset for Spacecraft Pose Estimation across Domain Gapcited by 57
  8. 2022Robust Multi-Task Learning and Online Refinement for Spacecraft Pose Estimation across Domain Gapcited by 44
  9. 2023A Survey on Deep Learning-Based Monocular Spacecraft Pose Estimation: Current State, Limitations and Prospectscited by 30
  10. 2021A Spacecraft Dataset for Detection, Segmentation and Parts Recognitioncited by 22
  11. 2024Language Models are Spacecraft Operatorscited by 8
  12. 2026SpaceSense-Bench: A Large-Scale Multi-Modal Benchmark for Spacecraft Perception and Pose Estimationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ASENA: Self-evolving Agents for Embodied Navigation
  2. 2025ASTREA: Introducing Agentic Intelligence for Orbital Thermal Autonomy
  3. 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence
  4. 2026Argus: A General-Purpose Agentic Reasoning Runtime for Long-Horizon Tasks
  5. 2026A Deployable Embodied Vision-Language Navigation System with Hierarchical Cognition and Context-Aware Exploration ↗
  6. 2026Embodied Agents Take Control: Minimal-Interface Zero-Shot Agents Rival Industrial-Scale Policies in Vision-and-Language Navigation
  7. 2026AeroWeaver: An Embodied-Agent Harness for Weaving Aerial Skills into Distributed, Adaptive Swarm Execution
  8. 2025PhysiAgent: An Embodied Agent Framework in Physical World