mlsanityData to 7 Oct 2026

FOOL: Addressing the Downlink Bottleneck in Satellite Computing with Neural Feature Compression

arXiv 2403.16677 ↗First posted 25 Mar 2024cs.LG cs.CV cs.DCcited by 6

Not on the map. Why?

Abstract (arXiv)

Nanosatellite constellations equipped with sensors capturing large geographic regions provide unprecedented opportunities for Earth observation. As constellation sizes increase, network contention poses a downlink bottleneck. Orbital Edge Computing (OEC) leverages limited onboard compute resources to reduce transfer costs by processing the raw captures at the source. However, current solutions have limited practicability due to reliance on crude filtering methods or over-prioritizing particular downstream tasks. This work presents FOOL, an OEC-native and task-agnostic feature compression method that preserves prediction performance. FOOL partitions high-resolution satellite imagery to maximize throughput. Further, it embeds context and leverages inter-tile dependencies to lower transfer costs with negligible overhead. While FOOL is a feature compressor, it can recover images with competitive scores on quality measures at lower bitrates. We extensively evaluate transfer cost reduction by including the peculiarity of intermittently available network connections in low earth orbit. Lastly, we test the feasibility of our system for standardized nanosatellite form factors. We demonstrate that FOOL permits downlinking over 100x the data volume without relying on prior information on the downstream tasks.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 43 of its 85 references that are in the map. First posted on arXiv 25 Mar 2024.

Builds on

43 of 85 references.

References · 43

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  8. 2022A ConvNet for the 2020scited by 3,545
  9. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  10. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  11. 2018Variational image compression with a scale hyperpriorcited by 910
  12. 2015Deep Learning and the Information Bottleneck Principlecited by 793
31 more
  1. 2016End-to-end Optimized Image Compressioncited by 673
  2. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  3. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
  4. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
  5. 2021ResNet strikes back: An improved training procedure in timmcited by 365
  6. 2020CompressAI: a PyTorch library and evaluation platform for end-to-end compression researchcited by 271
  7. 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
  8. 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 202
  9. 2020FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understandingcited by 181
  10. 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 178
  11. 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 166
  12. 2018xView: Objects in Context in Overhead Imagerycited by 145
  13. 2020Nonlinear Transform Codingcited by 132
  14. 2019Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filterscited by 117
  15. 2021Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challengescited by 114
  16. 2023Foundational Models Defining a New Era in Vision: A Survey and Outlookcited by 109
  17. 2022An Introduction to Neural Data Compressioncited by 78
  18. 2020RarePlanes: Synthetic Data Takes Flightcited by 48
  19. 2020SpaceNet 6: Multi-Sensor All Weather Mapping Datasetcited by 47
  20. 2020End-to-end Learning of Compressible Featurescited by 43
  21. 2021Supervised Compression for Resource-Constrained Edge Computing Systemscited by 31
  22. 2022AI and ML Accelerator Survey and Trendscited by 23
  23. 2020torchdistill: A Modular, Configuration-Driven Framework for Knowledge Distillationcited by 18
  24. 2022SC2 Benchmark: Supervised Compression for Split Computingcited by 14
  25. 2023FrankenSplit: Efficient Neural Feature Compression with Shallow Variational Bottleneck Injection for Mobile Edge Computingcited by 12
  26. 2019MRCNet: Crowd Counting and Density Map Estimation in Aerial and Ground Imagerycited by 10
  27. 2021The SpaceNet Multi-Temporal Urban Development Challengecited by 10
  28. 2023A Comprehensive Survey on Orbital Edge Computing: Systems, Applications, and Algorithmscited by 4
  29. 2022Low-latency Imaging and Inference from LoRa-enabled CubeSatscited by 2
  30. 2024Resource-efficient In-orbit Detection of Earth Objectscited by 2
  31. 2024TinyLIC-High efficiency lossy image compression methodcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 3.

6 papers.