Large Language Model-assisted Autonomous Vehicle Recovery from Immobilization
On the map: End-to-end autonomous driving → Reasoning VLA and VLM driving policies
Abstract (arXiv)
Despite significant advancements in recent decades, autonomous vehicles (AVs) continue to face challenges in navigating certain traffic scenarios where human drivers excel. In such situations, AVs often become immobilized, disrupting overall traffic flow. Current recovery solutions, such as remote intervention (which is costly and inefficient) and manual takeover (which excludes non-drivers and limits AV accessibility), are inadequate. This paper introduces StuckSolver, a novel Large Language Model (LLM) driven recovery framework that enables AVs to resolve immobilization scenarios through self-reasoning and/or passenger-guided decision-making. StuckSolver is designed as a plug-in add-on module that operates on top of the AV's existing perception-planning-control stack, requiring no modification to its internal architecture. Instead, it interfaces with standard sensor data streams to detect immobilization states, interpret environmental context, and generate high-level recovery commands that can be executed by the AV's native planner. We evaluate StuckSolver on the Bench2Drive benchmark and in custom-designed uncertainty scenarios. Results show that StuckSolver achieves near-state-of-the-art performance through autonomous self-reasoning alone and exhibits further improvements when passenger guidance is incorporated.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Reasoning VLA and VLM driving policies, one of 9 directions in End-to-end autonomous driving. Builds on 31 of its 40 references that are in the map. First posted on arXiv 29 Oct 2025.
Builds on
31 of 40 references.
References · 31
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2021Image Segmentation Using Text and Image Promptscited by 509
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
- 2023GPT-Driver: Learning to Drive with GPTcited by 344
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 250
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
19 more
- 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
- 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 204
- 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 190
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 188
- 2023A Language Agent for Autonomous Drivingcited by 161
- 2023Language Prompt for Autonomous Drivingcited by 110
- 2023Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehiclescited by 100
- 2023Receive, Reason, and React: Drive as You Say with Large Language Models in Autonomous Vehiclescited by 72
- 2025Raw2Drive: Reinforcement Learning with Aligned World Models for End-to-End Autonomous Driving (in CARLA v2)cited by 45
- 2019Towards Corner Case Detection for Autonomous Drivingcited by 39
- 2021Description of Corner Cases in Automated Driving: Goals and Challengescited by 35
- 2023Empowering Autonomous Driving with Large Language Models: A Safety Perspectivecited by 34
- 2024Divide-or-Conquer? Which Part Should You Distill Your LLM?cited by 17
- 2024Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-Making Frameworkcited by 16
- 2024On-Board Vision-Language Models for Personalized Autonomous Vehicle Motion Control: System Design and Real-World Validationcited by 15
- 2023When to Replan? An Adaptive Replanning Strategy for Autonomous Navigation using Deep Reinforcement Learningcited by 5
- 2024Don't Get Stuck: A Deadlock Recovery Approachcited by 3
- 2023Efficient Path Planning in Large Unknown Environments with Switchable System Models for Automated Vehiclescited by 2
- 2023Large Language Models Are Also Good Prototypical Commonsense Reasonerscited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025MTRDrive: Memory-Tool Synergistic Reasoning for Robust Autonomous Driving in Corner Cases
- 2024Leveraging Large Language Models for Enhancing Autonomous Vehicle Perception
- 2025V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Driving
- 2026NaviDriveVLM: Decoupling High-Level Reasoning and Motion Planning for Autonomous Driving
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directions
- 2025LightEMMA: A Longitudinal Evaluation of Vision-Language Models for Autonomous Driving
- 2025Foundation Models for Trajectory Planning in Autonomous Driving: A Review of Progress and Open Challenges
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Models