mlsanityData to 7 Oct 2026

LLM-Driven Scenario-Aware Planning for Autonomous Driving

arXiv 2601.21876 ↗First posted 29 Jan 2026cs.ROcited by 0

On the map: End-to-end autonomous driving → Large language models for driving

Abstract (arXiv)

Hybrid planner switching framework (HPSF) for autonomous driving needs to reconcile high-speed driving efficiency with safe maneuvering in dense traffic. Existing HPSF methods often fail to make reliable mode transitions or sustain efficient driving in congested environments, owing to heuristic scene recognition and low-frequency control updates. To address the limitation, this paper proposes LAP, a large language model (LLM) driven, adaptive planning method, which switches between high-speed driving in low-complexity scenes and precise driving in high-complexity scenes, enabling high qualities of trajectory generation through confined gaps. This is achieved by leveraging LLM for scene understanding and integrating its inference into the joint optimization of mode configuration and motion planning. The joint optimization is solved using tree-search model predictive control and alternating minimization. We implement LAP by Python in Robot Operating System (ROS). High-fidelity simulation results show that the proposed LAP outperforms other benchmarks in terms of both driving time and success rate.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Large language models for driving, one of 9 directions in End-to-end autonomous driving. Builds on 12 of its 22 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

12 of 22 references.

References · 12

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2021Convex optimizationcited by 2,479
  6. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  7. 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 633
  8. 2017Optimization-Based Collision Avoidancecited by 28
  9. 2020Multilayer Graph-Based Trajectory Planning for Race Vehicles in Dynamic Scenarioscited by 14
  10. 2022RDA: An Accelerated Collision Free Motion Planner for Autonomous Navigation in Cluttered Environmentscited by 13
  11. 2022Model- and Acceleration-based Pursuit Controller for High-Performance Autonomous Racingcited by 11
  12. 2022A Generalized Continuous Collision Detection Framework of Polynomial Trajectory for Mobile Robots in Cluttered Environmentscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023LLM-Assist: Enhancing Closed-Loop Planning with Language-Based Reasoning
  2. 2024Asynchronous Large Language Model Enhanced Planner for Autonomous Driving
  3. 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving
  4. 2025LiloDriver: A Lifelong Learning Framework for Closed-loop Motion Planning in Long-tail Autonomous Driving Scenarios
  5. 2025LeAD: The LLM Enhanced Planning System Converged with End-to-end Autonomous Driving
  6. 2025HCRMP: A LLM-Hinted Contextual Reinforcement Learning Framework for Autonomous Driving
  7. 2025AdaDrive: Self-Adaptive Slow-Fast System for Language-Grounded Autonomous Driving
  8. 2024Driving Everywhere with Large Language Model Policy Adaptation