# Fields of The World: A Machine Learning Benchmark Dataset For Global Agricultural Field Boundary Segmentation

arXiv: https://arxiv.org/abs/2409.16252 · HTML: https://mlsanity.com/paper/2409.16252/

## Key facts

- Cited by 24 papers in the map (data through 14 Oct 2026).
- Builds on 7 of its 33 references that are in the map.
- First posted on arXiv 24 Sep 2024.

## Builds on (most cited first, 7 of 7)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Mask R-CNN](https://mlsanity.com/paper/1703.06870/) (2017)
- [Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation](https://mlsanity.com/paper/1802.02611/) (2018)
- [SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery](https://mlsanity.com/paper/2207.08051/) (2022)
- [Panoptic Segmentation of Satellite Image Time Series with Convolutional Temporal Attention Networks](https://mlsanity.com/paper/2107.07933/) (2021)
- [Lightweight, Pre-trained Transformers for Remote Sensing Timeseries](https://mlsanity.com/paper/2304.14065/) (2023)
- [Multi-Modal Temporal Attention Models for Crop Mapping from Satellite Time Series](https://mlsanity.com/paper/2112.07558/) (2021)

## Built on by (most cited first, 24 of 24)

- [Panopticon: Advancing Any-Sensor Foundation Models for Earth Observation](https://mlsanity.com/paper/2503.10845/) (2025)
- [GEO-Bench-2: From Performance to Capability, Rethinking Evaluation in Geospatial AI](https://mlsanity.com/paper/2511.15658/) (2025)
- [Distribution Shifts at Scale: Out-of-distribution Detection in Earth Observation](https://mlsanity.com/paper/2412.13394/) (2024)
- [FLAIR-HUB: Large-scale Multimodal Dataset for Land Cover and Crop Mapping](https://mlsanity.com/paper/2506.07080/) (2025)
- [PRUE: A Practical Recipe for Field Boundary Segmentation at Scale](https://mlsanity.com/paper/2603.27101/) (2026)
- [A region-wide, multi-year set of crop field boundary labels for Africa](https://mlsanity.com/paper/2412.18483/) (2024)
- [Farmland Extent and Visible Boundary Mapping from 1 m NAIP Imagery Using Residual U-Net and Text-Prompted SAM 3 Refinement](https://mlsanity.com/paper/2607.21881/) (2026)
- [GTPBD: A Fine-Grained Global Terraced Parcel and Boundary Dataset](https://mlsanity.com/paper/2507.14697/) (2025)
- [A Comprehensive Review of Agricultural Parcel and Boundary Delineation from Remote Sensing Images: Recent Progress and Future Perspectives](https://mlsanity.com/paper/2508.14558/) (2025)
- [Time2Agri: Temporal Pretext Tasks for Agricultural Monitoring](https://mlsanity.com/paper/2507.04366/) (2025)
- [The first global agricultural field boundary map at 10m resolution](https://mlsanity.com/paper/2605.11055/) (2026)
- [Invariant Features for Global Crop Type Classification](https://mlsanity.com/paper/2509.03497/) (2025)
- [AgroFlux: A Spatial-Temporal Benchmark for Carbon and Nitrogen Flux Prediction in Agricultural Ecosystems](https://mlsanity.com/paper/2602.01614/) (2026)
- [Conformal Prediction Sets for Instance Segmentation](https://mlsanity.com/paper/2602.10045/) (2026)
- [Beyond Accuracy: Assessing Calibration of Geospatial Foundation Models and Their Sensitivity to Distribution Shifts](https://mlsanity.com/paper/2608.16614/) (2026)
- [A Decade of Wheat Mapping for Lebanon](https://mlsanity.com/paper/2504.11366/) (2025)
- [Farm-Level, In-Season Crop Identification for India](https://mlsanity.com/paper/2507.02972/) (2025)
- [Geospatial Machine Learning Libraries](https://mlsanity.com/paper/2510.02572/) (2025)
- [Fields of The World: A Field Guide for Extracting Agricultural Field Boundaries](https://mlsanity.com/paper/2602.08131/) (2026)
- [Fields of the Planet: Field Boundary Mapping Beyond 10m](https://mlsanity.com/paper/2607.04449/) (2026)
- [Delineate Anything v2: A Global Foundation Model for Field Delineation](https://mlsanity.com/paper/2607.19069/) (2026)
- [PolyTopoBench: A Benchmark for Complex Vector Polygon Generation from Remote Sensing Imagery](https://mlsanity.com/paper/2609.32856/) (2026)
- [Planetary Feature Fields are Scalable Earth Representations](https://mlsanity.com/paper/2609.37784/) (2026)
- [Technical Report on the Turba Fertilizer Machine Learning Stack in Morocco](https://mlsanity.com/paper/2610.05949/) (2026)

## Abstract (arXiv)

Crop field boundaries are foundational datasets for agricultural monitoring and assessments but are expensive to collect manually. Machine learning (ML) methods for automatically extracting field boundaries from remotely sensed images could help realize the demand for these datasets at a global scale. However, current ML methods for field instance segmentation lack sufficient geographic coverage, accuracy, and generalization capabilities. Further, research on improving ML methods is restricted by the lack of labeled datasets representing the diversity of global agricultural fields. We present Fields of The World (FTW) -- a novel ML benchmark dataset for agricultural field instance segmentation spanning 24 countries on four continents (Europe, Africa, Asia, and South America). FTW is an order of magnitude larger than previous datasets with 70,462 samples, each containing instance and semantic segmentation masks paired with multi-date, multi-spectral Sentinel-2 satellite images. We provide results from baseline models for the new FTW benchmark, show that models trained on FTW have better zero-shot and fine-tuning performance in held-out countries than models that aren't pre-trained with diverse datasets, and show positive qualitative zero-shot results of FTW models in a real-world scenario -- running on Sentinel-2 scenes over Ethiopia.
