mlsanityData to 14 Oct 2026

Leveraging Image Generators to Address Data Scarcity: The Gen4Regen Dataset for Forest Regeneration Mapping

arXiv 2605.05627 ↗First posted 7 May 2026cs.CV cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Sustainable forest management relies on precise species composition mapping, yet traditional ground surveys are labour-intensive and geographically constrained. While Uncrewed Aerial Vehicles (UAVs) offer scalable data collection, the transition to deep learning-based interpretation is bottlenecked by the severe scarcity of expert-annotated imagery, particularly in complex, visually heterogeneous regeneration zones. This paper addresses the dual challenges of data scarcity and extreme class imbalance in the fine-grained semantic segmentation of plants by providing a scalable framework that reduces reliance on manual photo-interpretation for high-resolution, millimetre-level aerial imagery. Importantly, we leverage the large-scale Nano Banana Pro model to simultaneously generate high-fidelity images and their corresponding pixel-aligned semantic masks from prompts. We introduce WilDReF-Q-V2, an expansion of a natural forest dataset with 13 977 new unlabelled and 50 hand-labelled real images, as well as the Gen4Regen dataset, featuring 2101 pairs of synthetic images and semantic masks. Our methodology integrates real-world data with AI-generated images, highlighting that AI-generated data is highly complementary to real-world data, with unified training yielding an F1 score improvement of over 15 %pt compared to purely supervised baselines. Furthermore, we demonstrate that even small quantities of prompt-generated data significantly improve performance for underrepresented classes, some of which see per-class F1 score gains of over 30 %pt. We conclude that large-scale vision models can serve as agile data generators, effectively bootstrapping perception tasks for niche AI domains where expert labels are scarce or unavailable. Our datasets, source code, and models will be available at https://norlab-ulaval.github.io/gen4regen.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 68 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

30 of 68 references.

References · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  8. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  9. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  10. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
  11. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  12. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
18 more
  1. 2021Vision Transformers for Dense Predictioncited by 1,803
  2. 2018Recognition in Terra Incognitacited by 658
  3. 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
  4. 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 310
  5. 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
  6. 2021Benchmarking Representation Learning for Natural World Image Collectionscited by 168
  7. 2019Synthetic Data for Deep Learningcited by 113
  8. 2018Modeling Visual Context is Key to Augmenting Object Detection Datasetscited by 106
  9. 2023FreeMask: Synthetic Images with Dense Annotations Make Stronger Segmentation Modelscited by 61
  10. 2026Image Generators are Generalist Vision Learnerscited by 43
  11. 2023MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentationcited by 35
  12. 2025SimGen: A Diffusion-Based Framework for Simultaneous Surgical Image and Segmentation Mask Generationcited by 5
  13. 2026SelvaMask: Segmenting Trees in Tropical Forests and Beyondcited by 5
  14. 2024DODA: Adapting Object Detectors to Dynamic Agricultural Environments in Real-Time with Diffusioncited by 4
  15. 2025Gen-n-Val: Agentic Image Data Generation and Validationcited by 3
  16. 2025MaSS13K: A Matting-level Semantic Segmentation Benchmarkcited by 2
  17. 2025Lacking Data? No worries! How synthetic images can alleviate image scarcity in wildlife surveys: a case study with muskox (Ovibos moschatus)cited by 2
  18. 2025CoSimGen: Controllable Diffusion Model for Simultaneous Image and Mask Generationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.