mlsanityData to 14 Oct 2026

Panopticon: Advancing Any-Sensor Foundation Models for Earth Observation

arXiv 2503.10845 ↗First posted 13 Mar 2025cs.LGcited by 34

Not on the map. Why?

Abstract (arXiv)

Earth observation (EO) data features diverse sensing platforms with varying spectral bands, spatial resolutions, and sensing modalities. While most prior work has constrained inputs to fixed sensors, a new class of any-sensor foundation models able to process arbitrary sensors has recently emerged. Contributing to this line of work, we propose Panopticon, an any-sensor foundation model built on the DINOv2 framework. We extend DINOv2 by (1) treating images of the same geolocation across sensors as natural augmentations, (2) subsampling channels to diversify spectral input, and (3) adding a cross attention over channels as a flexible patch embedding mechanism. By encoding the wavelength and modes of optical and synthetic aperture radar sensors, respectively, Panopticon can effectively process any combination of arbitrary channels. In extensive evaluations, we achieve state-of-the-art performance on GEO-Bench, especially on the widely-used Sentinel-1 and Sentinel-2 sensors, while out-competing other any-sensor models, as well as domain adapted fixed-sensor models on unique sensor configurations. Panopticon enables immediate generalization to both existing and future satellite platforms, advancing sensor-agnostic EO.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 44 of its 76 references that are in the map. First posted on arXiv 13 Mar 2025.

Builds on

44 of 76 references.

References · 44

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
  7. 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
  8. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
  9. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
  10. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
  11. 2017Functional Map of the Worldcited by 338
  12. 2023ClimaX: A foundation model for weather and climatecited by 337
32 more
  1. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
  2. 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
  3. 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
  4. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
  5. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
  6. 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 149
  7. 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 124
  8. 2023Towards Geospatial Foundation Models via Continual Pretrainingcited by 109
  9. 2023Lightweight, Pre-trained Transformers for Remote Sensing Timeseriescited by 103
  10. 2022SSL4EO-S12: A Large-Scale Multi-Modal, Multi-Temporal Dataset for Self-Supervised Learning in Earth Observationcited by 84
  11. 2024Rethinking Transformers Pre-training for Multi-Spectral Satellite Imagerycited by 83
  12. 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 77
  13. 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 77
  14. 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 74
  15. 2021TorchGeo: Deep Learning With Geospatial Datacited by 73
  16. 2023SSL4EO-L: Datasets and Foundation Models for Landsat Imagerycited by 49
  17. 2023Feature Guided Masked Autoencoder for Self-supervised Learning in Remote Sensingcited by 48
  18. 2024reBEN: Refined BigEarthNet Dataset for Remote Sensing Image Analysiscited by 48
  19. 2024Bridging Remote Sensors with Multisensor Geospatial Foundation Modelscited by 46
  20. 2024SpectralEarth: Training Hyperspectral Foundation Models at Scalecited by 42
  21. 2022Self-supervised Vision Transformers for Joint SAR-optical Representation Learningcited by 40
  22. 2023Channel Vision Transformers: An Image Is Worth 1 x 16 x 16 Wordscited by 34
  23. 2024One for All: Toward Unified Foundation Models for Earth Visioncited by 34
  24. 2023USat: A Unified Self-Supervised Encoder for Multi-Sensor Satellite Imagerycited by 28
  25. 2024Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretrainingcited by 28
  26. 2022xView3-SAR: Detecting Dark Fishing Activity Using Synthetic Aperture Radar Imagerycited by 25
  27. 2024Fields of The World: A Machine Learning Benchmark Dataset For Global Agricultural Field Boundary Segmentationcited by 24
  28. 2023Extending global-local view alignment for self-supervised learning with remote sensing imagerycited by 20
  29. 2023Digital Typhoon: Long-term Satellite Image Dataset for the Spatio-Temporal Modeling of Tropical Cyclonescited by 19
  30. 2024SenPa-MAE: Sensor Parameter Aware Masked Autoencoder for Multi-Satellite Self-Supervised Pretrainingcited by 18
  31. 2024Geospatial foundation models for image analysis: evaluating and enhancing NASA-IBM Prithvi's domain adaptabilitycited by 11
  32. 2024STARS: Sensor-agnostic Transformer Architecture for Remote Sensingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 15; 2026: 19.

34 papers.

Sort:

By area:

  1. 2025Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised Learningcited by 36
  2. 2025TerraFM: A Scalable Foundation Model for Unified Multisensor Earth Observationcited by 25
  3. 2025OlmoEarth: Stable Latent Image Modeling for Multimodal Earth Observationcited by 24
  4. 2026OpenEarthAgent: A Unified Framework for Tool-Augmented Geospatial Agentscited by 15
  5. 2026No One Knows the State of the Art in Geospatial Foundation Modelscited by 12
  6. 2025Simultaneous Tactile-Visual Perception for Learning Multimodal Robot Manipulationcited by 6
  7. 2026UniverSat: Resolution- and Modality-Agnostic Transformers for Earth Observationcited by 5
  8. 2025EarthScape: A Multimodal Dataset for Surficial Geologic Mapping and Earth Surface Analysiscited by 4
  9. 2025GeoCrossBench: Cross-Band Generalization for Remote Sensingcited by 4
  10. 2025RAMEN: Resolution-Adjustable Multimodal Encoder for Earth Observationcited by 4
  11. 2025CARL: Camera-Agnostic Representation Learning for Spectral Image Analysiscited by 2
  12. 2025MAESTRO: Masked AutoEncoders for Multimodal, Multitemporal, and Multispectral Earth Observation Datacited by 2
22 more
  1. 2026Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth Observationcited by 2
  2. 2026HighFM: Towards a Foundation Model for Learning Representations from High-Frequency Earth Observation Datacited by 2
  3. 2026UNIGEOCLIP: Unified Geospatial Contrastive Learningcited by 2
  4. 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directionscited by 2
  5. 2026SpectralEarth-FM: Bringing Hyperspectral Imagery into Multimodal Earth Observation Pretrainingcited by 2
  6. 2025Benchmarking Feature Upsampling Methods for Vision Foundation Models using Interactive Segmentationcited by 1
  7. 2025HyBiomass: Global Hyperspectral Imagery Benchmark Dataset for Evaluating Geospatial Foundation Models in Forest Aboveground Biomass Estimationcited by 1
  8. 2025Assessing the value of Geo-Foundational Models for Flood Inundation Mapping: Benchmarking models for Sentinel-1, Sentinel-2, and Planetscope for end-userscited by 1
  9. 2026Prithvi-Complimentary Adaptive Fusion Encoder (CAFE): unlocking full-potential for flood inundation mappingcited by 1
  10. 2026COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Datacited by 1
  11. 2026Beyond Accuracy: Assessing Calibration of Geospatial Foundation Models and Their Sensitivity to Distribution Shiftscited by 1
  12. 2025Atmos-Bench: 3D Atmospheric Structures for Climate Insightcited by 0
  13. 2025Geospatial Machine Learning Librariescited by 0
  14. 2025EoS-FM: Can an Ensemble of Specialist Models act as a Generalist Feature Extractor?cited by 0
  15. 2026Partial recovery of meter-scale surface weathercited by 0
  16. 2026Sat-JEPA-Diff: Bridging Self-Supervised Learning and Generative Diffusion for Remote Sensingcited by 0
  17. 2026Changing Modalities: Adapting Remote Sensing Models to New Satellites and Sensorscited by 0
  18. 2026Hedgementation = Hedgerow Segmentation: A Remote Sensing Benchmarkcited by 0
  19. 2026Earth Observation Foundation Models for Terrestrial Ecohydrology: From Representation Learning to Process Inferencecited by 0
  20. 2026MethaneFuse: Learning from Multi-Sensor Satellite Observations for Methane Plume Detectioncited by 0
  21. 2026RSPDBench: Benchmarking Vision Foundation Models on Earth Observation Tasks Under Physically Grounded Remote-Sensing Product Degradationscited by 0
  22. 2026Atomizer-IO: Beyond Pixels, Patches and Gridscited by 0