mlsanityData to 14 Oct 2026

LiloDriver: A Lifelong Learning Framework for Closed-loop Motion Planning in Long-tail Autonomous Driving Scenarios

arXiv 2505.17209 ↗First posted 22 May 2025cs.RO cs.AIcited by 7

On the map: End-to-end autonomous driving → Large language models for driving

Abstract (arXiv)

Recent advances in autonomous driving research towards motion planners that are robust, safe, and adaptive. However, existing rule-based and data-driven planners lack adaptability to long-tail scenarios, while knowledge-driven methods offer strong reasoning but face challenges in representation, control, and real-world evaluation. To address these challenges, we present LiloDriver, a lifelong learning framework for closed-loop motion planning in long-tail autonomous driving scenarios. By integrating large language models (LLMs) with a memory-augmented planner generation system, LiloDriver continuously adapts to new scenarios without retraining. It features a four-stage architecture including perception, scene encoding, memory-based strategy refinement, and LLM-guided reasoning. Evaluated on the nuPlan benchmark, LiloDriver achieves superior performance in both common and rare driving scenarios, outperforming static rule-based and learning-based planners. Our results highlight the effectiveness of combining structured memory and LLM reasoning to enable scalable, human-like motion planning in real-world autonomous driving. Our code is available at https://github.com/Hyan-Yao/LiloDriver.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Large language models for driving, one of 9 directions in End-to-end autonomous driving. Builds on 27 of its 30 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

27 of 30 references.

Closest ancestors · 6

Same direction, newest first

  1. 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving14 Dec
  2. 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Models12 Dec
  3. 2023A Survey on Multimodal Large Language Models for Autonomous Driving21 Nov
  4. 2023LLM4Drive: A Survey of Large Language Models for Autonomous Driving2 Nov
  5. 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving4 Oct
  6. 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Models28 Sep

Other references · 21

  1. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 493
  2. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
  3. 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 242
  4. 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenescited by 191
  5. 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Drivingcited by 141
  6. 2023Vision Language Models in Autonomous Driving: A Survey and Outlookcited by 126
  7. 2021Urban Driver: Learning to Drive from Real-world Demonstrations Using Policy Gradientscited by 122
  8. 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectivescited by 114
  9. 2018Baidu Apollo EM Motion Plannercited by 100
  10. 2023LLM-Assist: Enhancing Closed-Loop Planning with Language-Based Reasoningcited by 59
  11. 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Drivingcited by 46
  12. 2023From Prediction to Planning With Goal Conditioned Lane Graph Traversalscited by 45
9 more
  1. 2024Can Vehicle Motion Planning Generalize to Realistic Long-tail Scenarios?cited by 38
  2. 2024PlanAgent: A Multi-modal Large Language Agent for Closed-loop Vehicle Motion Planningcited by 38
  3. 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
  4. 2023Rethinking Imitation-based Planner for Autonomous Drivingcited by 25
  5. 2023SurrealDriver: Designing LLM-powered Generative Driver Agent Framework based on Human Drivers' Driving-thinking Datacited by 24
  6. 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunitiescited by 24
  7. 2024CoMAL: Collaborative Multi-Agent Large Language Models for Mixed-Autonomy Trafficcited by 22
  8. 2024LMM-enhanced Safety-Critical Scenario Generation for Autonomous Driving System Testing From Non-Accident Traffic Videoscited by 9
  9. 2025Generative AI in Transportation Planning: A Surveycited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 4.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Asynchronous Large Language Model Enhanced Planner for Autonomous Driving
  2. 2025LLaViDA: A Large Language Vision Driving Assistant for Explicit Reasoning and Enhanced Trajectory Planning
  3. 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Driving
  4. 2026MomADv2: Reliable Temporal Memory for End-to-End Autonomous Driving
  5. 2024Tokenize the World into Object-level Knowledge to Address Long-tail Events in Autonomous Driving
  6. 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
  7. 2024PLUTO: Pushing the Limit of Imitation Learning-based Planning for Autonomous Driving
  8. 2025LeAD: The LLM Enhanced Planning System Converged with End-to-end Autonomous Driving