mlsanityData to 7 Oct 2026

Self-supervised Learning in Remote Sensing: A Review

arXiv 2206.13188 ↗First posted 27 Jun 2022cs.CVcited by 137

Not on the map. Why?

Abstract (arXiv)

In deep learning research, self-supervised learning (SSL) has received great attention triggering interest within both the computer vision and remote sensing communities. While there has been a big success in computer vision, most of the potential of SSL in the domain of earth observation remains locked. In this paper, we provide an introduction to, and a review of the concepts and latest developments in SSL for computer vision in the context of remote sensing. Further, we provide a preliminary benchmark of modern SSL algorithms on popular remote sensing datasets, verifying the potential of SSL in remote sensing and providing an extended study on data augmentations. Finally, we identify a list of promising directions of future research in SSL for earth observation (SSL4EO) to pave the way for fruitful interaction of both domains.

Key facts. Cited by 137 papers in the map (data through 7 Oct 2026). Builds on 126 of its 253 references that are in the map. First posted on arXiv 27 Jun 2022.

Builds on

126 of 253 references.

References · 126

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  9. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  10. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  11. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  12. 2020Exploring Simple Siamese Representation Learningcited by 2,853
38 more
  1. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  2. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  3. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  4. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  5. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
  6. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  7. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
  8. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
  9. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
  10. 2016Variational Inference: A Review for Statisticianscited by 1,466
  11. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  12. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
  13. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
  14. 2019Contrastive Multiview Codingcited by 1,297
  15. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  16. 2019A Comprehensive Survey on Transfer Learningcited by 1,154
  17. 2016Colorful Image Colorizationcited by 1,113
  18. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
  19. 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
  20. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
  21. 2020Designing Network Design Spacescited by 954
  22. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
  23. 2020What Makes for Good Views for Contrastive Learning?cited by 843
  24. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
  25. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
  26. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  27. 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 672
  28. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  29. 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
  30. 2020A Survey on Contrastive Self-supervised Learningcited by 553
  31. 2019On Variational Bounds of Mutual Informationcited by 550
  32. 2019Self-labelling via simultaneous clustering and representation learningcited by 525
  33. 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
  34. 2015Unsupervised Learning of Video Representations using LSTMscited by 434
  35. 2015Adversarial Autoencoderscited by 359
  36. 2016Adversarial Feature Learningcited by 350
  37. 2021XCiT: Cross-Covariance Image Transformerscited by 335
  38. 2019On Mutual Information Maximization for Representation Learningcited by 315

50 most cited of 126 All 126 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 37; 2024: 34; 2025: 34; 2026: 27.

137 papers.

Sort:

By area:

  1. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
  2. 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 148
  3. 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 101
  4. 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trendscited by 93
  5. 2022SSL4EO-S12: A Large-Scale Multi-Modal, Multi-Temporal Dataset for Self-Supervised Learning in Earth Observationcited by 82
  6. 2023A Billion-scale Foundation Model for Remote Sensing Imagescited by 62
  7. 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 62
  8. 2023Self-Supervised Multimodal Learning: A Surveycited by 58
  9. 2025Towards a Unified Copernicus Foundation Model for Earth Visioncited by 52
  10. 2023SSL4EO-L: Datasets and Foundation Models for Landsat Imagerycited by 49
  11. 2023CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understandingcited by 48
  12. 2023Feature Guided Masked Autoencoder for Self-supervised Learning in Remote Sensingcited by 48
38 more
  1. 2023Predicting Gradient is Better: Exploring Self-Supervised Learning for SAR ATR with a Joint-Embedding Predictive Architecturecited by 43
  2. 2024SpectralEarth: Training Hyperspectral Foundation Models at Scalecited by 42
  3. 2023Decoupling Common and Unique Representations for Multimodal Self-supervised Learningcited by 36
  4. 2024On the Foundations of Earth and Climate Foundation Modelscited by 31
  5. 2024Point-JEPA: A Joint Embedding Predictive Architecture for Self-Supervised Learning on Point Cloudcited by 29
  6. 2023USat: A Unified Self-Supervised Encoder for Multi-Sensor Satellite Imagerycited by 28
  7. 2024Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretrainingcited by 27
  8. 2024PhilEO Bench: Evaluating Geo-Spatial Foundation Modelscited by 25
  9. 2024SARATR-X: Toward Building A Foundation Model for SAR Target Recognitioncited by 25
  10. 2022Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Workscited by 24
  11. 2023Knowledge-infused Contrastive Learning for Urban Imagery-based Socioeconomic Predictioncited by 23
  12. 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
  13. 2023Extending global-local view alignment for self-supervised learning with remote sensing imagerycited by 20
  14. 2024A Closer Look at Benchmarking Self-Supervised Pre-training with Image Classificationcited by 19
  15. 2022Current Trends in Deep Learning for Earth Observation: An Open-source Benchmark Arena for Image Classificationcited by 18
  16. 2024Generic Knowledge Boosted Pre-training For Remote Sensing Imagescited by 16
  17. 2024Geolocation Representation from Large Language Models are Generic Enhancers for Spatio-Temporal Learningcited by 15
  18. 2023Learning Tri-modal Embeddings for Zero-Shot Soundscape Mappingcited by 14
  19. 2024SwiMDiff: Scene-wide Matching Contrastive Learning with Diffusion Constraint for Remote Sensing Imagecited by 14
  20. 2023FireRisk: A Remote Sensing Dataset for Fire Risk Assessment with Benchmarks Using Supervised and Self-supervised Learningcited by 13
  21. 2023When Geoscience Meets Foundation Models: Towards General Geoscience Artificial Intelligence Systemcited by 13
  22. 2024Deep Learning for Satellite Image Time Series Analysis: A Reviewcited by 13
  23. 2024A2-MAE: A spatial-temporal-spectral unified remote sensing pre-training method based on anchor-aware masked autoencodercited by 10
  24. 2025Lossy Neural Compression for Geospatial Analytics: A Reviewcited by 10
  25. 2025Can Generative Geospatial Diffusion Models Excel as Discriminative Geospatial Foundation Models?cited by 10
  26. 2025Parameter-Efficient Adaptation of Geospatial Foundation Models through Embedding Deflectioncited by 10
  27. 2022HyperNet: Self-Supervised Hyperspectral Spatial-Spectral Feature Understanding Network for Hyperspectral Change Detectioncited by 9
  28. 2023Neural Koopman prior for data assimilationcited by 9
  29. 2025Position: An Empirically Grounded Identifiability Theory Will Accelerate Self-Supervised Learning Researchcited by 9
  30. 2025SMARTIES: Spectrum-Aware Multi-Sensor Auto-Encoder for Remote Sensing Imagescited by 9
  31. 2025Harvesting AlphaEarth: Benchmarking the Geospatial Foundation Model for Agricultural Downstream Taskscited by 9
  32. 2023Sharpend Cosine Similarity based Neural Network for Hyperspectral Image Classificationcited by 7
  33. 2023Scaling Representation Learning from Ubiquitous ECG with State-Space Modelscited by 7
  34. 2023Large Scale Masked Autoencoding for Reducing Label Requirements on SAR Datacited by 7
  35. 2024CromSS: Cross-modal pre-training with noisy labels for remote sensing image segmentationcited by 7
  36. 2025NeuCo-Bench: A Novel Benchmark Framework for Neural Embeddings in Earth Observationcited by 7
  37. 2023Fewshot learning on global multimodal embeddings for earth observation taskscited by 6
  38. 2024SSLChange: A Self-supervised Change Detection Framework Based on Domain Adaptationcited by 6

50 most cited of 137 All 137 (JSON)