mlsanityData to 7 Oct 2026

Increasing the Robustness of Model Predictions to Missing Sensors in Earth Observation

arXiv 2407.15512 ↗First posted 22 Jul 2024cs.LG cs.AI cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Multi-sensor ML models for EO aim to enhance prediction accuracy by integrating data from various sources. However, the presence of missing data poses a significant challenge, particularly in non-persistent sensors that can be affected by external factors. Existing literature has explored strategies like temporal dropout and sensor-invariant models to address the generalization to missing data issues. Inspired by these works, we study two novel methods tailored for multi-sensor scenarios, namely Input Sensor Dropout (ISensD) and Ensemble Sensor Invariant (ESensI). Through experimentation on three multi-sensor temporal EO datasets, we demonstrate that these methods effectively increase the robustness of model predictions to missing sensors. Particularly, we focus on how the predictive performance of models drops when sensors are missing at different levels. We observe that ensemble multi-sensor models are the most robust to the lack of sensors. In addition, the sensor dropout component in ISensD shows promising robustness results.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 22 Jul 2024.

Builds on

14 of 26 references.

References · 14

  1. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 202
  2. 2022Are Multimodal Transformers Robust to Missing Modality?cited by 183
  3. 2020More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classificationcited by 126
  4. 2023Lightweight, Pre-trained Transformers for Remote Sensing Timeseriescited by 102
  5. 2024OmniSat: Self-Supervised Modality Fusion for Earth Observationcited by 63
  6. 2021Multi-Modal Temporal Attention Models for Crop Mapping from Satellite Time Seriescited by 49
  7. 2022Self-supervised Vision Transformers for Joint SAR-optical Representation Learningcited by 40
  8. 2019Understanding urban landuse from the above and ground perspectives: a deep learning, multimodal solutioncited by 26
  9. 2024Exploring Masked Autoencoders for Sensor-Agnostic Image Retrieval in Remote Sensingcited by 12
  10. 2023Targeted Adversarial Attacks on Wind Power Forecastscited by 9
  11. 2023Predicting Crop Yield With Machine Learning: An Extensive Analysis Of Input Modalities And Models On a Field and sub-field Levelcited by 7
  12. 2024Impact Assessment of Missing Data in Model Predictions for Earth Observation Applicationscited by 3
2 more
  1. 2024In the Search for Optimal Multi-view Learning Models for Crop Classification with Global Remote Sensing Datacited by 1
  2. 2024Multi-Modal Vision Transformers for Crop Mapping from Satellite Image Time Seriescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 1.

5 papers.