UrbanVLA: A Vision-Language-Action Model for Urban Micromobility
On the map: Vision-language-action models → VLA for autonomous driving
Abstract (arXiv)
Urban micromobility applications, such as delivery robots, demand reliable navigation across large-scale urban environments while following long-horizon route instructions. This task is particularly challenging due to the dynamic and unstructured nature of real-world city areas, yet most existing navigation methods remain tailored to short-scale and controllable scenarios. Effective urban micromobility requires two complementary levels of navigation skills: low-level capabilities such as point-goal reaching and obstacle avoidance, and high-level capabilities, such as route-visual alignment. To this end, we propose UrbanVLA, a route-conditioned Vision-Language-Action (VLA) framework designed for scalable urban navigation. Our method explicitly aligns noisy route waypoints with visual observations during execution, and subsequently plans trajectories to drive the robot. To enable UrbanVLA to master both levels of navigation, we employ a two-stage training pipeline. The process begins with Supervised Fine-Tuning (SFT) using simulated environments and trajectories parsed from web videos. This is followed by Reinforcement Fine-Tuning (RFT) on a mixture of simulation and real-world data, which enhances the model's safety and adaptability in real-world settings. Experiments demonstrate that UrbanVLA surpasses strong baselines by more than 55% in the SocialNav task on MetaUrban. Furthermore, UrbanVLA achieves reliable real-world navigation, showcasing both scalability to large-scale urban environments and robustness against real-world uncertainties.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 47 of its 62 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
47 of 62 references.
References · 47
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023Visual Instruction Tuningcited by 7,792
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024Qwen2 Technical Reportcited by 2,076
- 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,245
- 2021A Minimalist Approach to Offline Reinforcement Learningcited by 882
35 more
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
- 2023LLaMA-VID: An Image is Worth 2 Tokens in Large Language Modelscited by 539
- 2018On Evaluation of Embodied Navigation Agentscited by 526
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
- 2021MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learningcited by 281
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
- 2025ConRFT: A Reinforced Fine-tuning Method for VLA Models via Consistency Policycited by 139
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
- 2025What Can RL Bring to VLA Generalization? An Empirical Studycited by 102
- 2025Embodied Navigation Foundation Modelcited by 65
- 2025Sekai: A Video Dataset towards World Explorationcited by 64
- 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 61
- 2024Open-Nav: Exploring Zero-Shot Vision-and-Language Navigation in Continuous Environment with Open-Source LLMscited by 60
- 2022Retrospectives on the Embodied AI Workshopcited by 46
- 20223D-Aware Object Goal Navigation via Simultaneous Exploration and Identificationcited by 46
- 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 46
- 2025TrackVLA: Embodied Visual Tracking in the Wildcited by 46
- 2023ViPlanner: Visual Semantic Imperative Learning for Local Navigationcited by 40
- 2024CityWalker: Learning Embodied Urban Navigation from Web-Scale Videoscited by 40
- 2025CO-RFT: Efficient Fine-Tuning of Vision-Language-Action Models through Chunked Offline Reinforcement Learningcited by 34
- 2025OmniVLA: An Omni-Modal Vision-Language-Action Model for Robot Navigationcited by 34
- 2025OctoNav: Towards Generalist Embodied Navigationcited by 33
- 2023iPlanner: Imperative Path Planningcited by 32
- 2024CogNav: Cognitive Process Modeling for Object Goal Navigation with LLMscited by 32
- 2024MetaUrban: An Embodied AI Simulation Platform for Urban Micromobilitycited by 19
- 2025Towards Autonomous Micromobility through Scalable Urban Simulationcited by 16
- 2025Balancing Signal and Variance: Adaptive Offline RL Post-Training for VLA Flow Modelscited by 14
- 2021Safe Exploration by Solving Early Terminated MDPcited by 13
- 2025LOVON: Legged Open-Vocabulary Object Navigatorcited by 11
- 2025From Seeing to Experiencing: Scaling Navigation Foundation Models with Reinforcement Learningcited by 11
- 2025CREStE: Scalable Mapless Navigation with Internet Scale Priors and Counterfactual Guidancecited by 9
- 2023What Matters to Enhance Traffic Rule Compliance of Imitation Learning for End-to-End Autonomous Drivingcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025UrbanNav: Learning Language-Guided Urban Navigation from Web-Scale Human Trajectories
- 2025City Navigation in the Wild: Exploring Emergent Navigation from Web-Scale Knowledge in MLLMs
- 2026APPLV: Adaptive Planner Parameter Learning from Vision-Language-Action Model
- 2024Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphs
- 2025VAMOS: A Hierarchical Vision-Language-Action Model for Capability-Modulated and Steerable Navigation
- 2026CapNav: Benchmarking Vision Language Models on Capability-conditioned Indoor Navigation
- 2025Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigation
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning