Embedding-Only Uplink for Onboard Retrieval Under Shift in Remote Sensing
Not on the map. Why?
Abstract (arXiv)
Downlink bottlenecks motivate onboard systems that prioritize hazards without transmitting raw pixels. We study a strict setting where a ground station uplinks only compact embeddings plus metadata, and an onboard system performs vector search to triage new captures. We ask whether this embedding-only pipeline remains useful under explicit remote-sensing shift: cross-time (pre/post-event), cross-event/location (different disasters), cross-site cloud (15 geographic sites), and cross-city AOI holdout (buildings). Using OlmoEarth embeddings on a scaled public multi-task benchmark (27 Sentinel-2 L2A scenes, 15 cloud sites, 5 SpaceNet-2 AOIs; 10 seeds), we find that all effective methods rely on the same uplinked embeddings, but the optimal decision head is task-dependent: kNN retrieval is significantly superior for cloud classification (0.92 vs. centroid 0.91; p<0.01, Wilcoxon), while class centroids dominate temporal change detection (0.85 vs. retrieval 0.48; p<0.01). These results show that embedding-only uplink is the key enabler--once embeddings are onboard, the system can select the best head per task at no additional uplink cost, with all telemetry under 1 KB per query.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
13 of 27 references.
References · 13
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
- 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 250
- 2020Geography-Aware Self-Supervised Learningcited by 190
- 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 178
- 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 143
- 2021Recent Advances in Domain Adaptation for the Classification of Remote Sensing Datacited by 70
1 more
Built on by
Not cited yet.