BEVNav: Robot Autonomous Navigation Via Spatial-Temporal Contrastive Learning in Bird's-Eye View
On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control
Abstract (arXiv)
Goal-driven mobile robot navigation in map-less environments requires effective state representations for reliable decision-making. Inspired by the favorable properties of Bird's-Eye View (BEV) in point clouds for visual perception, this paper introduces a novel navigation approach named BEVNav. It employs deep reinforcement learning to learn BEV representations and enhance decision-making reliability. First, we propose a self-supervised spatial-temporal contrastive learning approach to learn BEV representations. Spatially, two randomly augmented views from a point cloud predict each other, enhancing spatial features. Temporally, we combine the current observation with consecutive frames' actions to predict future features, establishing the relationship between observation transitions and actions to capture temporal cues. Then, incorporating this spatial-temporal contrastive learning in the Soft Actor-Critic reinforcement learning framework, our BEVNav offers a superior navigation policy. Extensive experiments demonstrate BEVNav's robustness in environments with dense pedestrians, outperforming state-of-the-art methods across multiple benchmarks. revThe code will be made publicly available at https://github.com/LanrenzzzZ/BEVNav.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 27 of its 37 references that are in the map. First posted on arXiv 3 Sep 2024.
Builds on
27 of 37 references.
References · 27
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2015Trust Region Policy Optimizationcited by 2,580
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2020CURL: Contrastive Unsupervised Representations for Reinforcement Learningcited by 760
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
15 more
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
- 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 122
- 2022Instruction-driven history-aware policies for robotic manipulationscited by 94
- 2023Multi-View Masked World Models for Visual Robotic Manipulationcited by 80
- 2023Bird's-Eye-View Scene Graph for Vision-Language Navigationcited by 72
- 2023DRL-VO: Learning to Navigate Through Crowded Dynamic Scenes Using Velocity Obstaclescited by 37
- 2021Goal-Driven Autonomous Exploration Through Deep Reinforcement Learningcited by 35
- 2022Is Mapping Necessary for Realistic PointGoal Navigation?cited by 35
- 2022Reinforcement Learned Distributed Multi-Robot Navigation with Reciprocal Velocity Obstacle Shaped Rewardscited by 16
- 2023Bi-Mapper: Holistic BEV Semantic Mapping for Autonomous Drivingcited by 14
- 2023On the Efficacy of 3D Point Cloud Reinforcement Learningcited by 11
- 2022Depth-CUPRL: Depth-Imaged Contrastive Unsupervised Prioritized Representations in Reinforcement Learning for Mapless Navigation of Unmanned Aerial Vehiclescited by 8
- 2020Point Cloud Based Reinforcement Learning for Sim-to-Real and Partial Observability in Visual Navigationcited by 5
- 2023BEVTrack: A Simple and Strong Baseline for 3D Single Object Tracking in Bird's-Eye Viewcited by 3
- 2021Interpretable UAV Collision Avoidance using Deep Reinforcement Learningcited by 2
Built on by
Citing papers per year: 2025: 3.
3 papers.
- 2025ROCKET-2: Steering Visuomotor Policy via Cross-View Goal Alignmentcited by 7
- 2025Oracle-Guided Masked Contrastive Reinforcement Learning for Visuomotor Policiescited by 1
- 2025ST-Booster: An Iterative SpatioTemporal Perception Booster for Vision-and-Language Navigation in Continuous Environmentscited by 0
- 2025Oracle-Guided Masked Contrastive Reinforcement Learning for Visuomotor Policies7 Oct 2025
- 2025ST-Booster: An Iterative SpatioTemporal Perception Booster for Vision-and-Language Navigation in Continuous Environments14 Apr 2025
- 2025ROCKET-2: Steering Visuomotor Policy via Cross-View Goal Alignment4 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposals
- 2025ME3-BEV: Mamba-Enhanced Deep Reinforcement Learning for End-to-End Autonomous Driving with BEV-Perception
- 2021VOILA: Visual-Observation-Only Imitation Learning for Autonomous Navigation
- 2023Bird's Eye View Based Pretrained World model for Visual Navigation
- 2025PIGEON: VLM-Driven Object Navigation via Points of Interest Selection
- 2024Transformers for Image-Goal Navigation
- 2024Hierarchical End-to-End Autonomous Driving: Integrating BEV Perception with Deep Reinforcement Learning
- 2024BehAV: Behavioral Rule Guided Autonomy Using VLMs for Robot Navigation in Outdoor Scenes