mlsanityData to 7 Oct 2026

Hide and Seek: Investigating Redundancy in Earth Observation Imagery

arXiv 2603.13524 ↗First posted 13 Mar 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The growing availability of Earth Observation (EO) data and recent advances in Computer Vision have driven rapid progress in machine learning for EO, producing domain-specific models at ever-increasing scales. Yet this progress risks overlooking fundamental properties of EO data that distinguish it from other domains. We argue that EO data exhibit a multidimensional redundancy (spectral, temporal, spatial, and semantic) which has a more pronounced impact on the domain and its applications than what current literature reflects. To validate this hypothesis, we conduct a systematic domain-specific investigation examining the existence, consistency, and practical implications of this phenomenon across key dimensions of EO variability. Our findings confirm that redundancy in EO data is both substantial and pervasive: exploiting it yields comparable performance (≈98.5% of baseline) at a fraction of the computational cost (≈4× fewer GFLOPs), at both training and inference. Crucially, these gains are consistent across tasks, geospatial locations, sensors, ground sampling distances, and architectural designs; suggesting that multi-faceted redundancy is a structural property of EO data rather than an artifact of specific experimental choices. These results lay the groundwork for more efficient, scalable, and accessible large-scale EO models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 30 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

21 of 30 references.

References · 21

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
  4. 2022Token Merging: Your ViT But Fastercited by 995
  5. 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 849
  6. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
  7. 2022Not All Patches are What You Need: Expediting Vision Transformers via Token Reorganizationscited by 359
  8. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
  9. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 167
  10. 2023Lightweight, Pre-trained Transformers for Remote Sensing Timeseriescited by 102
  11. 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 76
  12. 2023Data Pruning via Moving-one-Sample-outcited by 67
9 more
  1. 2020MLRSNet: A Multi-label High Spatial Resolution Remote Sensing Dataset for Semantic Scene Understandingcited by 59
  2. 2025Towards a Unified Copernicus Foundation Model for Earth Visioncited by 52
  3. 2024reBEN: Refined BigEarthNet Dataset for Remote Sensing Image Analysiscited by 48
  4. 2023FLAIR: a Country-Scale Land Cover Semantic Segmentation Dataset From Multi-Source Optical Imagerycited by 41
  5. 2022The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancycited by 35
  6. 2023FoMo: Multi-Modal, Multi-Scale and Multi-Task Remote Sensing Foundation Models for Forest Monitoringcited by 30
  7. 2025Efficient Self-Supervised Learning for Earth Observation via Dynamic Dataset Curationcited by 7
  8. 2025RS-Prune: Training-Free Data Pruning at High Ratios for Efficient Remote Sensing Diffusion Foundation Modelscited by 4
  9. 2025On the Generalization of Representation Uncertainty in Earth Observationcited by 1

Built on by

Not cited yet.