HarvestFlex: Strawberry Harvesting via Vision-Language-Action Policy Adaptation in the Wild
Not on the map. Why?
Abstract (arXiv)
This work presents the first study on transferring vision-language-action (VLA) policies to real greenhouse tabletop strawberry harvesting, a long-horizon, unstructured task challenged by occlusion and specular reflections. We built an end-to-end closed-loop system on the HarvestFlex platform using three-view RGB sensing (two fixed scene views plus a wrist-mounted view) and intentionally avoided depth clouds and explicit geometric calibration. We collected 3.71 h of VR teleoperated demonstrations (227 episodes) and fine-tuned pi_0, pi_0.5, and WALL-OSS with full fine-tuning and LoRA. Under a unified 50 trials real-greenhouse protocol and metrics spanning completion, pi_0.5 with full fine-tuning achieved success rate of 74.0% with 32.6 s/pick and damage rate of 4.1%. Asynchronous inference-control decoupling further improved performance over synchronous deployment. Results showed non-trivial closed-loop picking with fewer than four hours of real data, while remaining limited by close-range observability loss and contact-dynamics mismatch. A demonstration video is available at: https://youtu.be/bN8ZowZKPMI.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 21 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
12 of 21 references.
References · 12
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 74
- 2025Igniting VLMs toward the Embodied Spacecited by 53
- 2024VLMPC: Vision-Language Model Predictive Control for Robotic Manipulationcited by 33
- 2025AgriGPT-VL: Agricultural Vision-Language Understanding Suitecited by 11
- 2023Towards Autonomous Selective Harvesting: A Review of Robot Perception, Robot Design, Motion Planning and Controlcited by 3
- 2024Design and Control of a Novel Six-Degree-of-Freedom Hybrid Robotic Armcited by 3
- 2026Vision-Based Early Fault Diagnosis and Self-Recovery for Strawberry Harvesting Robotscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026From Vision to Harvest: Benchmarking Vision-Language Models for Multi-Arm Robotic Fruit Harvesting
- 2026Robotic Strawberry Harvesting with Robust Vision and Deep Reinforcement Learning based Sim-to-Real Control ↗
- 2026Visual-Language-Guided Task Planning for Horticultural Robots ↗
- 2026Do Not Cut When Uncertain: Rejectable and Calibrated Decision Heads for VLA Policies in Robotic Harvesting
- 2026Vision-Based Obstacle Separation for Strawberry Harvesting in Clusters Using Hierarchical Reinforcement Learning ↗
- 2026Reinforcement Learning for the Full Strawberry Harvesting Process: Obstacle Separation, Detachment, and Placement
- 2025Enhanced View Planning for Robotic Harvesting: Tackling Occlusions with Imitation Learning
- 2026Using Vision Language Foundation Models to Generate Plant Simulation Configurations via In-Context Learning