# An Automated Tip-and-Cue Framework for Optimized Satellite Tasking and Visual Intelligence

arXiv: https://arxiv.org/abs/2512.09670 · HTML: https://mlsanity.com/paper/2512.09670/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 18 of its 52 references that are in the map.
- First posted on arXiv 10 Dec 2025.

## Builds on (most cited first, 18 of 18)

- [Learning Transferable Visual Models From Natural Language Supervision](https://mlsanity.com/paper/2103.00020/) (2021)
- [BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation](https://mlsanity.com/paper/2201.12086/) (2022)
- [Convex optimization](https://mlsanity.com/paper/2106.01946/) (2021)
- [VILA: On Pre-training for Visual Language Models](https://mlsanity.com/paper/2312.07533/) (2023)
- [RemoteCLIP: A Vision Language Foundation Model for Remote Sensing](https://mlsanity.com/paper/2306.11029/) (2023)
- [RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing](https://mlsanity.com/paper/2306.11300/) (2023)
- [Foundation Models for Remote Sensing and Earth Observation: A Survey](https://mlsanity.com/paper/2410.16602/) (2024)
- [TrAISformer -- A Transformer Network with Sparse Augmented Data Representation and Cross Entropy Loss for AIS-based Vessel Trajectory Prediction](https://mlsanity.com/paper/2109.03958/) (2021)
- [GeoTrackNet-A Maritime Anomaly Detector using Probabilistic Neural Network Representation of AIS Tracks and A Contrario Detection](https://mlsanity.com/paper/1912.00682/) (2019)
- [Simulated annealing based heuristic for multiple agile satellites scheduling under cloud coverage uncertainty](https://mlsanity.com/paper/2003.08363/) (2020)
- [Gradient descent with nonconvex constraints: local concavity determines convergence](https://mlsanity.com/paper/1703.07755/) (2017)
- [Machine Learning-Assisted Anomaly Detection in Maritime Navigation Using AIS Data](https://mlsanity.com/paper/2002.05013/) (2020)
- [Detecting Intentional AIS Shutdown in Open Sea Maritime Surveillance Using Self-Supervised Deep Learning](https://mlsanity.com/paper/2310.15586/) (2023)
- [MapGlue: Multimodal Remote Sensing Image Matching](https://mlsanity.com/paper/2503.16185/) (2025)
- [PulseSatellite: A tool using human-AI feedback loops for satellite image analysis in humanitarian contexts](https://mlsanity.com/paper/2001.10685/) (2020)
- [Safe Hierarchical Reinforcement Learning for CubeSat Task Scheduling Based on Energy Consumption](https://mlsanity.com/paper/2309.12004/) (2023)
- [Smooth Exact Penalty Functions: A General Approach](https://mlsanity.com/paper/1801.06567/) (2018)
- [An energy-efficient learning solution for the Agile Earth Observation Satellite Scheduling Problem](https://mlsanity.com/paper/2503.04803/) (2025)

## Abstract (arXiv)

The proliferation of satellite constellations, coupled with reduced tasking latency and diverse sensor capabilities, has expanded the opportunities for automated Earth observation. This paper introduces a fully automated Tip-and-Cue framework designed for satellite imaging tasking and scheduling. In this context, tips are generated from external data sources or analyses of prior satellite imagery, identifying spatiotemporal targets and prioritizing them for downstream planning. Corresponding cues are the imaging tasks formulated in response, which incorporate sensor constraints, timing requirements, and utility functions. The system autonomously generates candidate tasks, optimizes their scheduling across multiple satellites using continuous utility functions that reflect the expected value of each observation, and processes the resulting imagery using artificial-intelligence-based models, including object detectors and vision-language models. Structured visual reports are generated to support both interpretability and the identification of new insights for downstream tasking. The efficacy of the framework is demonstrated through a maritime vessel tracking scenario, utilizing Automatic Identification System (AIS) data for trajectory prediction, targeted observations, and the generation of actionable outputs. Maritime vessel tracking is a widely researched application, often used to benchmark novel approaches to satellite tasking, forecasting, and analysis. The system is extensible to broader applications such as smart-city monitoring and disaster response, where timely tasking and automated analysis are critical.