Enabling 24-hour Agricultural Robotics: Unsupervised Day-to-Night Cross-Modal Image Translation for Nighttime Visual Navigation
Not on the map. Why?
Abstract (arXiv)
While visual navigation has been extensively studied in agricultural robotics, most existing systems assume daytime conditions. In fact, deploying autonomous robots at night offers significant advantages, including 24-hour crop and soil monitoring, fruit harvesting, and nocturnal pest detection. Modern vision-based systems, however, rely heavily on large-scale well-annotated image datasets, which remains challenging to obtain for nighttime operation scenarios. To address this, we propose an unsupervised image translation framework that converts daytime plant-row RGB images into near-infrared (NIR) nighttime counterparts without requiring pixel-to-pixel supervision. This enables the direct reuse of daytime semantic labels for training nighttime perception models. In particular, by incorporating a pre-trained Contrastive Language-Image Pre-training (CLIP) model, the proposed framework is designed to preserve semantic consistency during day-to-night translation. Additionally, a visibility mask is introduced to account for the limited effective range of NIR illumination in nighttime scenes. We conduct comparative evaluations with state-of-the-art image translation baselines and demonstrate higher image qualities, as supported by improved performance in downstream semantic segmentation for nighttime visual navigation. For evaluation, we utilize AgriNight--a novel dataset comprising 428 daytime and 549 nighttime images collected using night-vision-equipped mobile robots in agricultural fields and manually annotated with pixel-wise semantic labels--and introduce it as the first benchmark for nighttime agricultural visual navigation. We also perform real-time autonomous navigation experiments with a physical robot operating at night. The data and code are available at: https://github.com/mamorobel/AgriNight.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 35 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
16 of 35 references.
References · 16
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2022Generative Adversarial Networkscited by 5,603
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
- 2016Resnet in Resnet: Generalizing Residual Architecturescited by 110
- 2021GANav: Efficient Terrain Segmentation for Robot Navigation in Unstructured Outdoor Environmentscited by 51
- 2024Light the Night: A Multi-Condition Diffusion Framework for Unpaired Low-Light Enhancement in Autonomous Drivingcited by 35
- 2023Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labelscited by 30
- 2018Agricultural Robotics: The Future of Robotic Agriculturecited by 17
- 2024Pixel-aligned RGB-NIR Stereo Imaging and Dataset for Robot Visioncited by 7
- 2024M2P2: A Multi-Modal Passive Perception Dataset for Off-Road Mobility in Extreme Low-Light Conditionscited by 4
4 more
- 2022Deep learning-based Crop Row Detection for Infield Navigation of Agri-Robotscited by 3
- 2022Mask CycleGAN: Unpaired Multi-modal Domain Translation with Interpretable Latent Variablecited by 2
- 2024From Web Data to Real Fields: Low-Cost Unsupervised Domain Adaptation for Agricultural Robotscited by 2
- 2023A Vision-Based Navigation System for Arable Fieldscited by 1
Built on by
Not cited yet.