# Position-Agnostic Autonomous Navigation in Vineyards with Deep Reinforcement Learning

arXiv: https://arxiv.org/abs/2206.14155 · HTML: https://mlsanity.com/paper/2206.14155/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 40 references that are in the map.
- First posted on arXiv 28 Jun 2022.

## Builds on (most cited first, 12 of 12)

- [Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor](https://mlsanity.com/paper/1801.01290/) (2018)
- [Improving Sample Efficiency in Model-Free Reinforcement Learning from Images](https://mlsanity.com/paper/1910.01741/) (2019)
- [Learning to Navigate in Complex Environments](https://mlsanity.com/paper/1611.03673/) (2016)
- [Deep learning in agriculture: A survey](https://mlsanity.com/paper/1807.11809/) (2018)
- [Socially Aware Motion Planning with Deep Reinforcement Learning](https://mlsanity.com/paper/1703.08862/) (2017)
- [Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehicles](https://mlsanity.com/paper/2001.11231/) (2020)
- [Autonomous Drone Racing with Deep Reinforcement Learning](https://mlsanity.com/paper/2103.08624/) (2021)
- [Domain-Adversarial Training of Self-Attention Based Networks for Land Cover Classification using Multi-temporal Sentinel-2 Satellite Imagery](https://mlsanity.com/paper/2104.00564/) (2021)
- [Real-Time Apple Detection System Using Embedded Systems With Hardware Accelerators: An Edge AI Application](https://mlsanity.com/paper/2004.13410/) (2020)
- [Deep Semantic Segmentation at the Edge for Autonomous Navigation in Vineyard Rows](https://mlsanity.com/paper/2107.00700/) (2021)
- [Local Motion Planner for Autonomous Navigation in Vineyards with a RGB-D Camera-Based Algorithm and Deep Learning Synergy](https://mlsanity.com/paper/2005.12815/) (2020)
- [A Deep Learning Driven Algorithmic Pipeline for Autonomous Navigation in Row-Based Crops](https://mlsanity.com/paper/2112.03816/) (2021)

## Built on by (most cited first, 11 of 11)

- [Generative Adversarial Super-Resolution at the Edge with Knowledge Distillation](https://mlsanity.com/paper/2209.03355/) (2022)
- [Domain Generalization for Crop Segmentation with Standardized Ensemble Knowledge Distillation](https://mlsanity.com/paper/2304.01029/) (2023)
- [PIC4rl-gym: a ROS2 modular framework for Robots Autonomous Navigation with Deep Reinforcement Learning](https://mlsanity.com/paper/2211.10714/) (2022)
- [Vision-based Vineyard Navigation Solution with Automatic Annotation](https://mlsanity.com/paper/2303.14347/) (2023)
- [Current applications and potential future directions of reinforcement learning-based Digital Twins in agriculture](https://mlsanity.com/paper/2406.08854/) (2024)
- [Optimizing Navigation And Chemical Application in Precision Agriculture With Deep Reinforcement Learning And Conditional Action Tree](https://mlsanity.com/paper/2503.17985/) (2025)
- [Deep Instance Segmentation and Visual Servoing to Play Jenga with a Cost-Effective Robotic System](https://mlsanity.com/paper/2211.07977/) (2022)
- [Advanced techniques and applications of LiDAR Place Recognition in Agricultural Environments: A Comprehensive Survey](https://mlsanity.com/paper/2601.22198/) (2026)
- [Online Learning of Wheel Odometry Correction for Mobile Robots with Attention-based Neural Network](https://mlsanity.com/paper/2303.11725/) (2023)
- [Enhancing Navigation Benchmarking and Perception Data Generation for Row-based Crops in Simulation](https://mlsanity.com/paper/2306.15517/) (2023)
- [Monocular Obstacle Avoidance Based on Inverse PPO for Fixed-wing UAVs](https://mlsanity.com/paper/2411.18009/) (2024)

## Abstract (arXiv)

Precision agriculture is rapidly attracting research to efficiently introduce automation and robotics solutions to support agricultural activities. Robotic navigation in vineyards and orchards offers competitive advantages in autonomously monitoring and easily accessing crops for harvesting, spraying and performing time-consuming necessary tasks. Nowadays, autonomous navigation algorithms exploit expensive sensors which also require heavy computational cost for data processing. Nonetheless, vineyard rows represent a challenging outdoor scenario where GPS and Visual Odometry techniques often struggle to provide reliable positioning information. In this work, we combine Edge AI with Deep Reinforcement Learning to propose a cutting-edge lightweight solution to tackle the problem of autonomous vineyard navigation without exploiting precise localization data and overcoming task-tailored algorithms with a flexible learning-based approach. We train an end-to-end sensorimotor agent which directly maps noisy depth images and position-agnostic robot state information to velocity commands and guides the robot to the end of a row, continuously adjusting its heading for a collision-free central trajectory. Our extensive experimentation in realistic simulated vineyards demonstrates the effectiveness of our solution and the generalization capabilities of our agent.
