Panopticon: Advancing Any-Sensor Foundation Models for Earth Observation
Not on the map. Why?
Abstract (arXiv)
Earth observation (EO) data features diverse sensing platforms with varying spectral bands, spatial resolutions, and sensing modalities. While most prior work has constrained inputs to fixed sensors, a new class of any-sensor foundation models able to process arbitrary sensors has recently emerged. Contributing to this line of work, we propose Panopticon, an any-sensor foundation model built on the DINOv2 framework. We extend DINOv2 by (1) treating images of the same geolocation across sensors as natural augmentations, (2) subsampling channels to diversify spectral input, and (3) adding a cross attention over channels as a flexible patch embedding mechanism. By encoding the wavelength and modes of optical and synthetic aperture radar sensors, respectively, Panopticon can effectively process any combination of arbitrary channels. In extensive evaluations, we achieve state-of-the-art performance on GEO-Bench, especially on the widely-used Sentinel-1 and Sentinel-2 sensors, while out-competing other any-sensor models, as well as domain adapted fixed-sensor models on unique sensor configurations. Panopticon enables immediate generalization to both existing and future satellite platforms, advancing sensor-agnostic EO.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 44 of its 76 references that are in the map. First posted on arXiv 13 Mar 2025.
Builds on
44 of 76 references.
References · 44
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2017Functional Map of the Worldcited by 338
- 2023ClimaX: A foundation model for weather and climatecited by 337
32 more
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
- 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
- 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 149
- 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 124
- 2023Towards Geospatial Foundation Models via Continual Pretrainingcited by 109
- 2023Lightweight, Pre-trained Transformers for Remote Sensing Timeseriescited by 103
- 2022SSL4EO-S12: A Large-Scale Multi-Modal, Multi-Temporal Dataset for Self-Supervised Learning in Earth Observationcited by 84
- 2024Rethinking Transformers Pre-training for Multi-Spectral Satellite Imagerycited by 83
- 2024Mission Critical -- Satellite Data is a Distinct Modality in Machine Learningcited by 77
- 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 77
- 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 74
- 2021TorchGeo: Deep Learning With Geospatial Datacited by 73
- 2023SSL4EO-L: Datasets and Foundation Models for Landsat Imagerycited by 49
- 2023Feature Guided Masked Autoencoder for Self-supervised Learning in Remote Sensingcited by 48
- 2024reBEN: Refined BigEarthNet Dataset for Remote Sensing Image Analysiscited by 48
- 2024Bridging Remote Sensors with Multisensor Geospatial Foundation Modelscited by 46
- 2024SpectralEarth: Training Hyperspectral Foundation Models at Scalecited by 42
- 2022Self-supervised Vision Transformers for Joint SAR-optical Representation Learningcited by 40
- 2023Channel Vision Transformers: An Image Is Worth 1 x 16 x 16 Wordscited by 34
- 2024One for All: Toward Unified Foundation Models for Earth Visioncited by 34
- 2023USat: A Unified Self-Supervised Encoder for Multi-Sensor Satellite Imagerycited by 28
- 2024Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretrainingcited by 28
- 2022xView3-SAR: Detecting Dark Fishing Activity Using Synthetic Aperture Radar Imagerycited by 25
- 2024Fields of The World: A Machine Learning Benchmark Dataset For Global Agricultural Field Boundary Segmentationcited by 24
- 2023Extending global-local view alignment for self-supervised learning with remote sensing imagerycited by 20
- 2023Digital Typhoon: Long-term Satellite Image Dataset for the Spatio-Temporal Modeling of Tropical Cyclonescited by 19
- 2024SenPa-MAE: Sensor Parameter Aware Masked Autoencoder for Multi-Satellite Self-Supervised Pretrainingcited by 18
- 2024Geospatial foundation models for image analysis: evaluating and enhancing NASA-IBM Prithvi's domain adaptabilitycited by 11
- 2024STARS: Sensor-agnostic Transformer Architecture for Remote Sensingcited by 1
Built on by
Citing papers per year: 2025: 15; 2026: 19.
34 papers.
Sort:
By area:
- 2025Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised Learningcited by 36
- 2025TerraFM: A Scalable Foundation Model for Unified Multisensor Earth Observationcited by 25
- 2025OlmoEarth: Stable Latent Image Modeling for Multimodal Earth Observationcited by 24
- 2026OpenEarthAgent: A Unified Framework for Tool-Augmented Geospatial Agentscited by 15
- 2026No One Knows the State of the Art in Geospatial Foundation Modelscited by 12
- 2025Simultaneous Tactile-Visual Perception for Learning Multimodal Robot Manipulationcited by 6
- 2026UniverSat: Resolution- and Modality-Agnostic Transformers for Earth Observationcited by 5
- 2025EarthScape: A Multimodal Dataset for Surficial Geologic Mapping and Earth Surface Analysiscited by 4
- 2025GeoCrossBench: Cross-Band Generalization for Remote Sensingcited by 4
- 2025RAMEN: Resolution-Adjustable Multimodal Encoder for Earth Observationcited by 4
- 2025CARL: Camera-Agnostic Representation Learning for Spectral Image Analysiscited by 2
- 2025MAESTRO: Masked AutoEncoders for Multimodal, Multitemporal, and Multispectral Earth Observation Datacited by 2
22 more
- 2026Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth Observationcited by 2
- 2026HighFM: Towards a Foundation Model for Learning Representations from High-Frequency Earth Observation Datacited by 2
- 2026UNIGEOCLIP: Unified Geospatial Contrastive Learningcited by 2
- 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directionscited by 2
- 2026SpectralEarth-FM: Bringing Hyperspectral Imagery into Multimodal Earth Observation Pretrainingcited by 2
- 2025Benchmarking Feature Upsampling Methods for Vision Foundation Models using Interactive Segmentationcited by 1
- 2025HyBiomass: Global Hyperspectral Imagery Benchmark Dataset for Evaluating Geospatial Foundation Models in Forest Aboveground Biomass Estimationcited by 1
- 2025Assessing the value of Geo-Foundational Models for Flood Inundation Mapping: Benchmarking models for Sentinel-1, Sentinel-2, and Planetscope for end-userscited by 1
- 2026Prithvi-Complimentary Adaptive Fusion Encoder (CAFE): unlocking full-potential for flood inundation mappingcited by 1
- 2026COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Datacited by 1
- 2026Beyond Accuracy: Assessing Calibration of Geospatial Foundation Models and Their Sensitivity to Distribution Shiftscited by 1
- 2025Atmos-Bench: 3D Atmospheric Structures for Climate Insightcited by 0
- 2025Geospatial Machine Learning Librariescited by 0
- 2025EoS-FM: Can an Ensemble of Specialist Models act as a Generalist Feature Extractor?cited by 0
- 2026Partial recovery of meter-scale surface weathercited by 0
- 2026Sat-JEPA-Diff: Bridging Self-Supervised Learning and Generative Diffusion for Remote Sensingcited by 0
- 2026Changing Modalities: Adapting Remote Sensing Models to New Satellites and Sensorscited by 0
- 2026Hedgementation = Hedgerow Segmentation: A Remote Sensing Benchmarkcited by 0
- 2026Earth Observation Foundation Models for Terrestrial Ecohydrology: From Representation Learning to Process Inferencecited by 0
- 2026MethaneFuse: Learning from Multi-Sensor Satellite Observations for Methane Plume Detectioncited by 0
- 2026RSPDBench: Benchmarking Vision Foundation Models on Earth Observation Tasks Under Physically Grounded Remote-Sensing Product Degradationscited by 0
- 2026Atomizer-IO: Beyond Pixels, Patches and Gridscited by 0
- 2026Atomizer-IO: Beyond Pixels, Patches and Grids30 Sep 2026
- 2026RSPDBench: Benchmarking Vision Foundation Models on Earth Observation Tasks Under Physically Grounded Remote-Sensing Product Degradations20 Sep 2026
- 2026MethaneFuse: Learning from Multi-Sensor Satellite Observations for Methane Plume Detection9 Sep 2026
- 2026Beyond Accuracy: Assessing Calibration of Geospatial Foundation Models and Their Sensitivity to Distribution Shifts17 Aug 2026
- 2026Earth Observation Foundation Models for Terrestrial Ecohydrology: From Representation Learning to Process Inference15 Aug 2026
- 2026Hedgementation = Hedgerow Segmentation: A Remote Sensing Benchmark22 Jun 2026
- 2026UniverSat: Resolution- and Modality-Agnostic Transformers for Earth Observation22 Jun 2026
- 2026Changing Modalities: Adapting Remote Sensing Models to New Satellites and Sensors22 Jun 2026
- 2026SpectralEarth-FM: Bringing Hyperspectral Imagery into Multimodal Earth Observation Pretraining20 May 2026
- 2026No One Knows the State of the Art in Geospatial Foundation Models12 May 2026
- 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directions27 Apr 2026
- 2026UNIGEOCLIP: Unified Geospatial Contrastive Learning13 Apr 2026
22 more
- 2026HighFM: Towards a Foundation Model for Learning Representations from High-Frequency Earth Observation Data5 Apr 2026
- 2026Sat-JEPA-Diff: Bridging Self-Supervised Learning and Generative Diffusion for Remote Sensing14 Mar 2026
- 2026COP-GEN: Latent Diffusion Transformer for Copernicus Earth Observation Data3 Mar 2026
- 2026Partial recovery of meter-scale surface weather26 Feb 2026
- 2026Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth Observation23 Feb 2026
- 2026OpenEarthAgent: A Unified Framework for Tool-Augmented Geospatial Agents19 Feb 2026
- 2026Prithvi-Complimentary Adaptive Fusion Encoder (CAFE): unlocking full-potential for flood inundation mapping5 Jan 2026
- 2025Simultaneous Tactile-Visual Perception for Learning Multimodal Robot Manipulation10 Dec 2025
- 2025RAMEN: Resolution-Adjustable Multimodal Encoder for Earth Observation4 Dec 2025
- 2025EoS-FM: Can an Ensemble of Specialist Models act as a Generalist Feature Extractor?26 Nov 2025
- 2025OlmoEarth: Stable Latent Image Modeling for Multimodal Earth Observation17 Nov 2025
- 2025GeoCrossBench: Cross-Band Generalization for Remote Sensing4 Nov 2025
- 2025Assessing the value of Geo-Foundational Models for Flood Inundation Mapping: Benchmarking models for Sentinel-1, Sentinel-2, and Planetscope for end-users3 Nov 2025
- 2025Geospatial Machine Learning Libraries2 Oct 2025
- 2025MAESTRO: Masked AutoEncoders for Multimodal, Multitemporal, and Multispectral Earth Observation Data14 Aug 2025
- 2025Atmos-Bench: 3D Atmospheric Structures for Climate Insight15 Jul 2025
- 2025HyBiomass: Global Hyperspectral Imagery Benchmark Dataset for Evaluating Geospatial Foundation Models in Forest Aboveground Biomass Estimation12 Jun 2025
- 2025TerraFM: A Scalable Foundation Model for Unified Multisensor Earth Observation6 Jun 2025
- 2025Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised Learning18 May 2025
- 2025Benchmarking Feature Upsampling Methods for Vision Foundation Models using Interactive Segmentation4 May 2025
- 2025CARL: Camera-Agnostic Representation Learning for Spectral Image Analysis27 Apr 2025
- 2025EarthScape: A Multimodal Dataset for Surficial Geologic Mapping and Earth Surface Analysis19 Mar 2025
- 2025Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised Learningcited by 36
- 2025TerraFM: A Scalable Foundation Model for Unified Multisensor Earth Observationcited by 25
- 2025OlmoEarth: Stable Latent Image Modeling for Multimodal Earth Observationcited by 24
- 2026No One Knows the State of the Art in Geospatial Foundation Modelscited by 12
- 2025Simultaneous Tactile-Visual Perception for Learning Multimodal Robot Manipulationcited by 6
- 2026UniverSat: Resolution- and Modality-Agnostic Transformers for Earth Observationcited by 5
- 2025EarthScape: A Multimodal Dataset for Surficial Geologic Mapping and Earth Surface Analysiscited by 4
- 2025GeoCrossBench: Cross-Band Generalization for Remote Sensingcited by 4
- 2025RAMEN: Resolution-Adjustable Multimodal Encoder for Earth Observationcited by 4
- 2025CARL: Camera-Agnostic Representation Learning for Spectral Image Analysiscited by 2
- 2025MAESTRO: Masked AutoEncoders for Multimodal, Multitemporal, and Multispectral Earth Observation Datacited by 2
- 2026Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth Observationcited by 2
12 most cited of 30 All 30 (JSON)
- 2026Atomizer-IO: Beyond Pixels, Patches and Grids30 Sep 2026
- 2026RSPDBench: Benchmarking Vision Foundation Models on Earth Observation Tasks Under Physically Grounded Remote-Sensing Product Degradations20 Sep 2026
- 2026MethaneFuse: Learning from Multi-Sensor Satellite Observations for Methane Plume Detection9 Sep 2026
- 2026Beyond Accuracy: Assessing Calibration of Geospatial Foundation Models and Their Sensitivity to Distribution Shifts17 Aug 2026
- 2026Earth Observation Foundation Models for Terrestrial Ecohydrology: From Representation Learning to Process Inference15 Aug 2026
- 2026Hedgementation = Hedgerow Segmentation: A Remote Sensing Benchmark22 Jun 2026
- 2026UniverSat: Resolution- and Modality-Agnostic Transformers for Earth Observation22 Jun 2026
- 2026Changing Modalities: Adapting Remote Sensing Models to New Satellites and Sensors22 Jun 2026
- 2026SpectralEarth-FM: Bringing Hyperspectral Imagery into Multimodal Earth Observation Pretraining20 May 2026
- 2026No One Knows the State of the Art in Geospatial Foundation Models12 May 2026
- 2026UNIGEOCLIP: Unified Geospatial Contrastive Learning13 Apr 2026
- 2026HighFM: Towards a Foundation Model for Learning Representations from High-Frequency Earth Observation Data5 Apr 2026
12 newest of 30 All 30 (JSON)