LiloDriver: A Lifelong Learning Framework for Closed-loop Motion Planning in Long-tail Autonomous Driving Scenarios
On the map: End-to-end autonomous driving → Large language models for driving
Abstract (arXiv)
Recent advances in autonomous driving research towards motion planners that are robust, safe, and adaptive. However, existing rule-based and data-driven planners lack adaptability to long-tail scenarios, while knowledge-driven methods offer strong reasoning but face challenges in representation, control, and real-world evaluation. To address these challenges, we present LiloDriver, a lifelong learning framework for closed-loop motion planning in long-tail autonomous driving scenarios. By integrating large language models (LLMs) with a memory-augmented planner generation system, LiloDriver continuously adapts to new scenarios without retraining. It features a four-stage architecture including perception, scene encoding, memory-based strategy refinement, and LLM-guided reasoning. Evaluated on the nuPlan benchmark, LiloDriver achieves superior performance in both common and rare driving scenarios, outperforming static rule-based and learning-based planners. Our results highlight the effectiveness of combining structured memory and LLM reasoning to enable scalable, human-like motion planning in real-world autonomous driving. Our code is available at https://github.com/Hyan-Yao/LiloDriver.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Large language models for driving, one of 9 directions in End-to-end autonomous driving. Builds on 27 of its 30 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
27 of 30 references.
Closest ancestors · 6
Same direction, newest first
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving14 Dec
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Models12 Dec
- 2023A Survey on Multimodal Large Language Models for Autonomous Driving21 Nov
- 2023LLM4Drive: A Survey of Large Language Models for Autonomous Driving2 Nov
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving4 Oct
- 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Models28 Sep
Other references · 21
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 493
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 242
- 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenescited by 191
- 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Drivingcited by 141
- 2023Vision Language Models in Autonomous Driving: A Survey and Outlookcited by 126
- 2021Urban Driver: Learning to Drive from Real-world Demonstrations Using Policy Gradientscited by 122
- 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectivescited by 114
- 2018Baidu Apollo EM Motion Plannercited by 100
- 2023LLM-Assist: Enhancing Closed-Loop Planning with Language-Based Reasoningcited by 59
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Drivingcited by 46
- 2023From Prediction to Planning With Goal Conditioned Lane Graph Traversalscited by 45
9 more
- 2024Can Vehicle Motion Planning Generalize to Realistic Long-tail Scenarios?cited by 38
- 2024PlanAgent: A Multi-modal Large Language Agent for Closed-loop Vehicle Motion Planningcited by 38
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2023Rethinking Imitation-based Planner for Autonomous Drivingcited by 25
- 2023SurrealDriver: Designing LLM-powered Generative Driver Agent Framework based on Human Drivers' Driving-thinking Datacited by 24
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunitiescited by 24
- 2024CoMAL: Collaborative Multi-Agent Large Language Models for Mixed-Autonomy Trafficcited by 22
- 2024LMM-enhanced Safety-Critical Scenario Generation for Autonomous Driving System Testing From Non-Accident Traffic Videoscited by 9
- 2025Generative AI in Transportation Planning: A Surveycited by 8
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 33
- 2025SEAL: Vision-Language Model-Based Safe End-to-End Cooperative Autonomous Driving with Adaptive Long-Tail Modelingcited by 3
- 2025Instructional Agents: Reducing Teaching Faculty Workload through Multi-Agent Instructional Designcited by 3
- 2026Deconfounded Lifelong Learning for Autonomous Driving via Dynamic Knowledge Spacescited by 2
- 2026MASkills: Continual Skills Optimization for Multi-Agent LLM Systemscited by 1
- 2026Information-Directed Offline-to-Online Reinforcement Learningcited by 0
- 2026Vision-Language-Action Autonomous Driving Agent with Language-based Memorycited by 0
- 2026Vision-Language-Action Autonomous Driving Agent with Language-based Memory29 Sep 2026
- 2026MASkills: Continual Skills Optimization for Multi-Agent LLM Systems2 Sep 2026
- 2026Information-Directed Offline-to-Online Reinforcement Learning28 May 2026
- 2026Deconfounded Lifelong Learning for Autonomous Driving via Dynamic Knowledge Spaces15 Mar 2026
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future18 Dec 2025
- 2025Instructional Agents: Reducing Teaching Faculty Workload through Multi-Agent Instructional Design27 Aug 2025
- 2025SEAL: Vision-Language Model-Based Safe End-to-End Cooperative Autonomous Driving with Adaptive Long-Tail Modeling26 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2024Asynchronous Large Language Model Enhanced Planner for Autonomous Driving
- 2025LLaViDA: A Large Language Vision Driving Assistant for Explicit Reasoning and Enhanced Trajectory Planning
- 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Driving
- 2026MomADv2: Reliable Temporal Memory for End-to-End Autonomous Driving
- 2024Tokenize the World into Object-level Knowledge to Address Long-tail Events in Autonomous Driving
- 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
- 2024PLUTO: Pushing the Limit of Imitation Learning-based Planning for Autonomous Driving
- 2025LeAD: The LLM Enhanced Planning System Converged with End-to-end Autonomous Driving