PhenoStitch: Training-Free Panoptic Crop Mapping from Satellite Image Time Series
Not on the map. Why?
Abstract (arXiv)
Panoptic crop mapping requires both delineating individual agricultural parcels and assigning a crop type to each parcel from satellite image time series. Existing approaches typically rely on dense parcel-level annotations and task-specific model training, which limits their applicability to new regions and growing seasons. We introduce PhenoStitch, a panoptic crop-mapping pipeline that requires no task-specific gradient-based training. A frozen Segment Anything model first oversegments each patch into class-agnostic regions. For each region, optical NDVI and Sentinel-1 backscatter series are summarized by an analytic double-harmonic phenological signature. Adjacent regions are then merged into parcels by minimizing a Potts graph energy, and each parcel is classified by nearest-prototype matching using only (k) labeled parcels per class. A final topology-closure step produces the panoptic map. Under a matched budget of (k=20) parcels per class, corresponding to less than 1% of the available labels, PhenoStitch achieves 20.0 crop mIoU, 76.2 segmentation quality, and 6.2 panoptic quality on PASTIS-R under a 5-fold, 3-seed evaluation. It outperforms the evaluated frozen foundation-model, few-shot, and matched-budget supervised baselines under the same protocol, with a consistent ranking also observed on ZueriCrop. Ablation studies show that radar observations contribute the largest performance gain, while the graph-energy merge and compact phenological signature provide further improvements. These results demonstrate the effectiveness of combining label-free parcel delineation with few-shot phenological recognition for panoptic crop mapping under limited supervision.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 44 references that are in the map. First posted on arXiv 1 Aug 2026.
Builds on
27 of 44 references.
References · 27
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
- 2018Panoptic Segmentationcited by 802
- 2019A Closer Look at Few-shot Classificationcited by 684
- 2021Extract Free Dense Labels from CLIPcited by 583
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
- 2019Panoptic-DeepLabcited by 363
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
15 more
- 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
- 2019SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learningcited by 195
- 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 181
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
- 2021Panoptic Segmentation of Satellite Image Time Series with Convolutional Temporal Attention Networkscited by 143
- 2024Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observationcited by 104
- 2018Temporal Convolutional Neural Network for the Classification of Satellite Image Time Seriescited by 76
- 2019Self-attention for raw optical Satellite Time Series Classificationcited by 75
- 2019Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attentioncited by 71
- 2018Multi-Temporal Land Cover Classification with Sequential Recurrent Encoderscited by 61
- 2021Crop mapping from image time series: deep learning with multi-scale label hierarchiescited by 42
- 2019BreizhCrops: A Time Series Dataset for Crop Type Mappingcited by 34
- 2022Realistic Evaluation of Transductive Few-Shot Learningcited by 27
- 2021TimeMatch: Unsupervised Cross-Region Adaptation by Temporal Shift Estimationcited by 21
- 2026SAM-Aug: Leveraging SAM Priors for Few-Shot Parcel Segmentation in Satellite Time Seriescited by 1
Built on by
Not cited yet.