GenCo: An Auxiliary Generator from Contrastive Learning for Enhanced Few-Shot Learning in Remote Sensing
Not on the map. Why?
Abstract (arXiv)
Classifying and segmenting patterns from a limited number of examples is a significant challenge in remote sensing and earth observation due to the difficulty in acquiring accurately labeled data in large quantities. Previous studies have shown that meta-learning, which involves episodic training on query and support sets, is a promising approach. However, there has been little attention paid to direct fine-tuning techniques. This paper repurposes contrastive learning as a pre-training method for few-shot learning for classification and semantic segmentation tasks. Specifically, we introduce a generator-based contrastive learning framework (GenCo) that pre-trains backbones and simultaneously explores variants of feature samples. In fine-tuning, the auxiliary generator can be used to enrich limited labeled data samples in feature space. We demonstrate the effectiveness of our method in improving few-shot learning performance on two key remote sensing datasets: Agriculture-Vision and EuroSAT. Empirically, our approach outperforms purely supervised training on the nearly 95,000 images in Agriculture-Vision for both classification and semantic segmentation tasks. Similarly, the proposed few-shot method achieves better results on the land-cover classification task on EuroSAT compared to the results obtained from fully supervised model training on the dataset.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 40 of its 62 references that are in the map. First posted on arXiv 27 Jul 2023.
Builds on
40 of 62 references.
References · 40
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
28 more
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,380
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,143
- 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2017ThiNet: A Filter Level Pruning Method for Deep Neural Network Compressioncited by 442
- 2018Dynamic Few-Shot Visual Learning without Forgettingcited by 385
- 2020Frustratingly Simple Few-Shot Object Detectioncited by 282
- 2017One-Shot Visual Imitation Learning via Meta-Learningcited by 228
- 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
- 2018Low-Shot Learning from Imaginary Datacited by 181
- 2020CrossTransformers: spatially-aware few-shot transfercited by 174
- 2019Boosting Few-Shot Visual Learning with Self-Supervisioncited by 140
- 2020Adversarial Feature Hallucination Networks for Few-Shot Learningcited by 110
- 2019When Does Self-supervision Improve Few-shot Learning?cited by 78
- 2019Generating Classification Weights with GNN Denoising Autoencoders for Few-Shot Learningcited by 69
- 2020Agriculture-Vision: A Large Aerial Image Database for Agricultural Pattern Analysiscited by 61
- 2019Image Deformation Meta-Networks for One-Shot Learningcited by 56
- 2019Few-Shot Learning via Saliency-guided Hallucination of Samplescited by 49
- 2020Momentum Contrastive Learning for Few-Shot COVID-19 Diagnosis from Chest CT Imagescited by 43
- 2021Global and Local Contrastive Self-Supervised Learning for Semantic Segmentation of HR Remote Sensing Imagescited by 31
- 2020Few-shot Object Detection on Remote Sensing Imagescited by 23
- 2022Global Convergence of MAML and Theory-Inspired Neural Architecture Search for Few-Shot Learningcited by 22
- 2022Optimizing Nitrogen Management with Deep Reinforcement Learning and Crop Simulationscited by 20
- 2023Hallucination Improves the Performance of Unsupervised Visual Representation Learningcited by 16
- 2023Extended Agriculture-Vision: An Extension of a Large Aerial Image Dataset for Agricultural Pattern Analysiscited by 14
- 2022Optimizing Crop Management with Reinforcement Learning and Imitation Learningcited by 13
- 2020The 1st Agriculture-Vision Challenge: Methods and Resultscited by 10
- 2018Low-Shot Learning for the Semantic Segmentation of Remote Sensing Imagerycited by 4
Built on by
Citing papers per year: 2023: 2; 2024: 6.
8 papers.
- 2024SwitchTab: Switched Autoencoders Are Effective Tabular Learnerscited by 38
- 2023ReConTab: Regularized Contrastive Representation Learning for Tabular Datacited by 25
- 2024Residual-based Language Models are Free Boosters for Biomedical Imagingcited by 24
- 2023LEMON: Lossless model expansioncited by 23
- 2024Adaptive Ensembles of Fine-Tuned Transformers for LLM-Generated Text Detectioncited by 22
- 2024The New Agronomists: Language Models are Experts in Crop Managementcited by 13
- 2024Deep Representation Learning for Multi-functional Degradation Modeling of Community-dwelling Aging Populationcited by 1
- 2024CROPS: A Deployable Crop Management System Over All Possible State Availabilitiescited by 0
- 2024CROPS: A Deployable Crop Management System Over All Possible State Availabilities9 Nov 2024
- 2024Deep Representation Learning for Multi-functional Degradation Modeling of Community-dwelling Aging Population8 Apr 2024
- 2024The New Agronomists: Language Models are Experts in Crop Management28 Mar 2024
- 2024Residual-based Language Models are Free Boosters for Biomedical Imaging26 Mar 2024
- 2024Adaptive Ensembles of Fine-Tuned Transformers for LLM-Generated Text Detection20 Mar 2024
- 2024SwitchTab: Switched Autoencoders Are Effective Tabular Learners4 Jan 2024
- 2023ReConTab: Regularized Contrastive Representation Learning for Tabular Data28 Oct 2023
- 2023LEMON: Lossless model expansion12 Oct 2023