APPLV: Adaptive Planner Parameter Learning from Vision-Language-Action Model
On the map: Vision-language-action models → Reinforcement learning and post-training
Abstract (arXiv)
Autonomous navigation in highly constrained environments remains challenging for mobile robots. Classical navigation approaches offer safety assurances but require environment-specific parameter tuning; end-to-end learning bypasses parameter tuning but struggles with precise control in constrained spaces. To this end, recent robot learning approaches automate parameter tuning while retaining classical systems' safety, yet still face challenges in generalizing to unseen environments. Recently, Vision-Language-Action (VLA) models have shown promise by leveraging foundation models' scene understanding capabilities, but still struggle with precise control and inference latency in navigation tasks. In this paper, we propose Adaptive Planner Parameter Learning from Vision-Language-Action Model (textscapplv). Unlike traditional VLA models that directly output actions, textscapplv leverages pre-trained vision-language models with a regression head to predict planner parameters that configure classical planners. We develop two training strategies: supervised learning fine-tuning from collected navigation trajectories and reinforcement learning fine-tuning to further optimize navigation performance. We evaluate textscapplv across multiple motion planners on the simulated Benchmark Autonomous Robot Navigation (BARN) dataset and in physical robot experiments. Results demonstrate that textscapplv outperforms existing methods in both navigation performance and generalization to unseen environments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 30 of its 47 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
30 of 47 references.
References · 30
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 435
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
18 more
- 2017PRM-RL: Long-range Robotic Navigation Tasks by Combining Reinforcement Learning and Sampling-based Planningcited by 64
- 2023QUAR-VLA: Vision-Language-Action Model for Quadruped Robotscited by 55
- 2025OmniVLA: An Omni-Modal Vision-Language-Action Model for Robot Navigationcited by 34
- 2022Learning Model Predictive Controllers with Real-Time Attention for Real-World Navigationcited by 27
- 2020APPLD: Adaptive Planner Parameter Learning from Demonstrationcited by 17
- 2020Benchmarking Metric Ground Navigationcited by 17
- 2020APPLI: Adaptive Planner Parameter Learning From Interventionscited by 16
- 2021APPL: Adaptive Planner Parameter Learningcited by 15
- 2021APPLE: Adaptive Planner Parameter Learning from Evaluative Feedbackcited by 13
- 2020APPLR: Adaptive Planner Parameter Learning from Reinforcementcited by 11
- 2017ROS Navigation Tuning Guidecited by 7
- 2023Motion Memory: Leveraging Past Experiences to Accelerate Future Motion Planningcited by 5
- 2024Reinforcement Learning for Wheeled Mobility on Vertically Challenging Terraincited by 5
- 2025Verti-Bench: A General and Scalable Off-Road Mobility Benchmark for Vertically Challenging Terraincited by 4
- 2025Reward Training Wheels: Adaptive Auxiliary Rewards for Robotics Reinforcement Learningcited by 3
- 2025Decremental Dynamics Planning for Robot Navigationcited by 2
- 2025Adaptive Dynamics Planning for Robot Navigationcited by 2
- 2024Multi-Goal Motion Memorycited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025FiLM-Nav: Efficient and Generalizable Navigation via VLM Fine-tuning
- 2026"Dear LLaVA, Please Drive": A Depth-Aware Vision-Language Agent for Closed-Loop Robotic Control
- 2025UrbanVLA: A Vision-Language-Action Model for Urban Micromobility
- 2026GemNav: Discrete-Token Visual Robot Navigation using a Multimodal Large Language Model
- 2025Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigation
- 2025VENTURA: Adapting Image Diffusion Models for Unified Task Conditioned Navigation
- 2025FlexVLN: Flexible Adaptation for Diverse Vision-and-Language Navigation Tasks
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning