mlsanityData to 7 Oct 2026

Task-Relevant and Irrelevant Region-Aware Augmentation for Generalizable Vision-Based Imitation Learning in Agricultural Manipulation

arXiv 2603.04845 ↗First posted 5 Mar 2026cs.ROcited by 1

On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning

Abstract (arXiv)

Vision-based imitation learning has shown promise for robotic manipulation; however, its generalization remains limited in practical agricultural tasks. This limitation stems from scarce demonstration data and substantial visual domain gaps caused by i) crop-specific appearance diversity and ii) background variations. To address this limitation, we propose Dual-Region Augmentation for Imitation Learning (DRAIL), a region-aware augmentation framework designed for generalizable vision-based imitation learning in agricultural manipulation. DRAIL explicitly separates visual observations into task-relevant and task-irrelevant regions. The task-relevant region is augmented in a domain-knowledge-driven manner to preserve essential visual characteristics, while the task-irrelevant region is aggressively randomized to suppress spurious background correlations. By jointly handling both sources of visual variation, DRAIL promotes learning policies that rely on task-essential features rather than incidental visual cues. We evaluate DRAIL on diffusion policy-based visuomotor controllers through robot experiments on artificial vegetable harvesting and real lettuce defective leaf picking preparation tasks. The results show consistent improvements in success rates under unseen visual conditions compared to baseline methods. Further attention analysis and representation generalization metrics indicate that the learned policies rely more on task-essential visual features, resulting in enhanced robustness and generalization.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 14 of its 17 references that are in the map. First posted on arXiv 5 Mar 2026.

Builds on

14 of 17 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025RoboEngine: Plug-and-Play Robot Data Augmentation with Semantic Robot Segmentation and Background Generation24 Mar
  2. 2024Robust Imitation Learning for Mobile Manipulator Focusing on Task-Related Viewpoints and Regions2 Oct

Other references · 12

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2023Segment Anythingcited by 8,158
  4. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  5. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  6. 2018Exploration by Random Network Distillationcited by 966
  7. 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
  8. 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 175
  9. 2021PixMix: Dreamlike Pictures Comprehensively Improve Safety Measurescited by 131
  10. 2017Transferring End-to-End Visuomotor Control from Simulation to Real World for a Multi-Stage Taskcited by 66
  11. 2023XMem++: Production-level Video Segmentation From Few Annotated Framescited by 53
  12. 2024Semantically Controllable Augmentations for Generalizable Robot Learningcited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Adaptive Visual Imitation Learning for Robotic Assisted Feeding Across Varied Bowl Configurations and Food Types
  2. 2024Autonomous Robotic Pepper Harvesting: Imitation Learning in Unstructured Agricultural Environments ↗
  3. 2025Enhanced View Planning for Robotic Harvesting: Tackling Occlusions with Imitation Learning
  4. 2022CACTI: A Framework for Scalable Multi-Task Multi-Scene Visual Imitation Learning
  5. 2025VGGT-DP: Generalizable Robot Control via Vision Foundation Models
  6. 2025Zero-Shot Visual Generalization in Robot Manipulation
  7. 2026ObstaDiff: Generalizable Diffusion Policy Learning via Obstacle-aware Representations
  8. 2026Visual-Language-Guided Task Planning for Horticultural Robots ↗