Post-Launch Capability Expansion of Vision-Language Models via Prompting for On-Orbit Spacecraft Inspection
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Spaceborne inspection systems often deploy perception models prior to launch, after which updating model weights or expanding fixed label sets becomes operationally impractical. While supervised models can be integrated pre-flight, adding new semantic capabilities in orbit requires retraining and re-uploading parameters. We investigate whether prompt-driven vision--language models can enable post-launch semantic expansion, allowing new spacecraft components to be specified via natural-language prompts without modifying onboard weights. We evaluate zero-shot instance segmentation of spacecraft components under a strictly frozen, single-pass inference protocol on a test set of 129 images of previously unseen satellites. Under fixed global thresholds and no post-processing, SAM3 achieves 0.385 [email protected] and 0.267 [email protected]:0.95. Performance is strongly scale-dependent: large structural elements like spacecraft bodies (0.639 [email protected]) and solar arrays (0.598 [email protected]) localize reliably, while relatively small appendages like antennas (0.221 [email protected]) and thrusters (0.081 [email protected]) remain difficult. Prompt formulation influences performance, with structured prompts incorporating spatial and geometric descriptors yielding up to 82% improvement over short category-name prompts. The model operates within the memory and compute envelope of contemporary embedded GPUs, suggesting prompt-driven grounding can provide a practical mechanism for post-launch semantic extension of dominant spacecraft structures while highlighting limitations of zero-shot localization for fine-scale components under orbital domain shift.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 3 of its 6 references that are in the map. First posted on arXiv 13 Jun 2026.
Builds on
3 of 6 references.
References · 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026NAVI-Orbital: First In-Orbit Demonstration of a Zero-Shot Vision-Language Model for Autonomous Earth Observation
- 2026Annotation Free Spacecraft Detection and Segmentation using Vision Language Models
- 2024DreamSat: Towards a General 3D Model for Novel View Synthesis of Space Objects
- 2024Space-LLaVA: a Vision-Language Model Adapted to Extraterrestrial Applications
- 2026Exploiting answer-invariant redundancies in satellite imagery for efficient VLM inference on edge
- 2025Few-Shot Vision-Language Reasoning for Satellite Imagery via Verifiable Rewards
- 2024Semantics from Space: Satellite-Guided Thermal Semantic Segmentation Annotation for Aerial Field Robots
- 2025Enabling Near-realtime Remote Sensing via Satellite-Ground Collaboration of Large Vision-Language Models