# Multi-Spectral Image Synthesis for Crop/Weed Segmentation in Precision Farming

arXiv: https://arxiv.org/abs/2009.05750 · HTML: https://mlsanity.com/paper/2009.05750/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Sep 2020.

## Built on by (most cited first, 11 of 11)

- [PhenoBench -- A Large Dataset and Benchmarks for Semantic Image Interpretation in the Agricultural Domain](https://mlsanity.com/paper/2306.04557/) (2023)
- [Performance Evaluation of Deep Transfer Learning on Multiclass Identification of Common Weed Species in Cotton Production Systems](https://mlsanity.com/paper/2110.04960/) (2021)
- [AI-Generated Images as Data Source: The Dawn of Synthetic Era](https://mlsanity.com/paper/2310.01830/) (2023)
- [deepNIR: Datasets for generating synthetic NIR images and improved fruit detection system using deep learning techniques](https://mlsanity.com/paper/2203.09091/) (2022)
- [INoD: Injected Noise Discriminator for Self-Supervised Representation Learning in Agricultural Fields](https://mlsanity.com/paper/2303.18101/) (2023)
- [Generative AI in Agriculture: Creating Image Datasets Using DALL.E's Advanced Large Language Model Capabilities](https://mlsanity.com/paper/2307.08789/) (2023)
- [Generative Adversarial Networks for Image Augmentation in Agriculture: A Systematic Review](https://mlsanity.com/paper/2204.04707/) (2022)
- [Shape and Style GAN-based Multispectral Data Augmentation for Crop/Weed Segmentation in Precision Farming](https://mlsanity.com/paper/2407.14119/) (2024)
- [WasteGAN: Data Augmentation for Robotic Waste Sorting through Generative Adversarial Networks](https://mlsanity.com/paper/2409.16999/) (2024)
- [PlantPlotGAN: A Physics-Informed Generative Adversarial Network for Plant Disease Prediction](https://mlsanity.com/paper/2310.18268/) (2023)
- [CropCraft: A Procedural World Generator for Robotic Simulation of Agricultural Tasks](https://mlsanity.com/paper/2511.02417/) (2025)

## Abstract (arXiv)

An effective perception system is a fundamental component for farming robots, as it enables them to properly perceive the surrounding environment and to carry out targeted operations. The most recent methods make use of state-of-the-art machine learning techniques to learn a valid model for the target task. However, those techniques need a large amount of labeled data for training. A recent approach to deal with this issue is data augmentation through Generative Adversarial Networks (GANs), where entire synthetic scenes are added to the training data, thus enlarging and diversifying their informative content. In this work, we propose an alternative solution with respect to the common data augmentation methods, applying it to the fundamental problem of crop/weed segmentation in precision farming. Starting from real images, we create semi-artificial samples by replacing the most relevant object classes (i.e., crop and weeds) with their synthesized counterparts. To do that, we employ a conditional GAN (cGAN), where the generative model is trained by conditioning the shape of the generated object. Moreover, in addition to RGB data, we take into account also near-infrared (NIR) information, generating four channel multi-spectral synthetic images. Quantitative experiments, carried out on three publicly available datasets, show that (i) our model is capable of generating realistic multi-spectral images of plants and (ii) the usage of such synthetic images in the training process improves the segmentation performance of state-of-the-art semantic segmentation convolutional networks.
