Query-Efficient Imitation Learning for End-to-End Autonomous Driving
Not on the map. Why?
Cited by 49 in Offline RL and imitation learning from data, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
One way to approach end-to-end autonomous driving is to learn a policy function that maps from a sensory input, such as an image frame from a front-facing camera, to a driving action, by imitating an expert driver, or a reference policy. This can be done by supervised learning, where a policy function is tuned to minimize the difference between the predicted and ground-truth actions. A policy function trained in this way however is known to suffer from unexpected behaviours due to the mismatch between the states reachable by the reference policy and trained policy functions. More advanced algorithms for imitation learning, such as DAgger, addresses this issue by iteratively collecting training examples from both reference and trained policies. These algorithms often requires a large number of queries to a reference policy, which is undesirable as the reference policy is often expensive. In this paper, we propose an extension of the DAgger, called SafeDAgger, that is query-efficient and more suitable for end-to-end autonomous driving. We evaluate the proposed SafeDAgger in a car racing simulator and show that it indeed requires less queries to a reference policy. We observe a significant speed up in convergence, which we conjecture to be due to the effect of automated curriculum learning.
Key facts. Cited by 84 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 May 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 3; 2019: 3; 2020: 1; 2021: 16; 2022: 13; 2023: 14; 2024: 10; 2025: 16; 2026: 8.
84 papers.
Sort:
By area:
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2018HG-DAgger: Interactive Imitation Learning with Human Expertscited by 266
- 2022VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priorscited by 136
- 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectivescited by 114
- 2021ThriftyDAgger: Budget-Aware Novelty and Risk Gating for Interactive Imitation Learningcited by 108
- 2018EnsembleDAgger: A Bayesian Approach to Safe Imitation Learningcited by 100
- 2020Autoregressive Knowledge Distillation through Imitation Learningcited by 74
- 2023Imitating Task and Motion Planning with Visuomotor Transformerscited by 66
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 61
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correctioncited by 59
- 2023Benchmarks and Algorithms for Offline Preference-Based Reward Learningcited by 56
- 2021LazyDAgger: Reducing Context Switching in Interactive Imitation Learningcited by 51
38 more
- 2022Efficient Learning of Safe Driving Policy via Human-AI Copilot Optimizationcited by 49
- 2024Closed-Loop Supervised Fine-Tuning of Tokenized Traffic Modelscited by 40
- 2021Safe Driving via Expert Guided Policy Optimizationcited by 31
- 2022Fleet-DAgger: Interactive Robot Fleet Learning with Scalable Human Supervisioncited by 30
- 2023Human-in-the-Loop Task and Motion Planning for Imitation Learningcited by 29
- 2025RoboCopilot: Human-in-the-loop Interactive Imitation Learning for Robot Manipulationcited by 26
- 2022Eliciting Compatible Demonstrations for Multi-Human Imitation Learningcited by 23
- 2022Play it by Ear: Learning Skills amidst Occlusion through Audio-Visual Imitation Learningcited by 22
- 2022When to Ask for Help: Proactive Interventions in Autonomous Reinforcement Learningcited by 21
- 2019Uncertainty-Aware Data Aggregation for Deep Imitation Learningcited by 20
- 2022PATO: Policy Assisted TeleOperation for Scalable Robot Data Collectioncited by 19
- 2023MEGA-DAgger: Imitation Learning with Multiple Imperfect Expertscited by 18
- 2021Offline Preference-Based Apprenticeship Learningcited by 17
- 2024SAFE-GIL: SAFEty Guided Imitation Learning for Robotic Systemscited by 14
- 2022Optimizing Crop Management with Reinforcement Learning and Imitation Learningcited by 13
- 2022A Benchmark Comparison of Imitation Learning-based Control Policies for Autonomous Racingcited by 12
- 2018OIL: Observational Imitation Learningcited by 11
- 2021Policy Gradient Bayesian Robust Optimization for Imitation Learningcited by 11
- 2021Demonstration-Efficient Guided Policy Search via Imitation of Robust Tube MPCcited by 11
- 2024Conformalized Interactive Imitation Learning: Handling Expert Shift and Intermittent Feedbackcited by 11
- 2026OVD: On-policy Verbal Distillationcited by 11
- 2019Gaze Training by Modulated Dropout Improves Imitation Learningcited by 10
- 2019Simitate: A Hybrid Imitation Learning Benchmarkcited by 10
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehiclescited by 10
- 2025Robot-Gated Interactive Imitation Learning with Adaptive Intervention Mechanismcited by 9
- 2021Multi-Task Learning with Sequence-Conditioned Transporter Networkscited by 8
- 2023How To Guide Your Learner: Imitation Learning with Active Adaptive Expert Involvementcited by 8
- 2024A Comparison of Imitation Learning Algorithms for Bimanual Manipulationcited by 8
- 2025Genie Centurion: Accelerating Scalable Real-World Robot Training with Human Rewind-and-Refine Guidancecited by 7
- 2025RoaD: Rollouts as Demonstrations for Closed-Loop Supervised Fine-Tuning of Autonomous Driving Policiescited by 6
- 2023IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisorscited by 4
- 2024Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Drivingcited by 4
- 2026RoboPocket: Improve Robot Policies Instantly with Your Phonecited by 4
- 2026Scaling Self-Play for End-to-End Drivingcited by 4
- 2022Constrained Imitation Learning for a Flapping Wing Unmanned Aerial Vehiclecited by 3
- 2022A Joint Imitation-Reinforcement Learning Framework for Reduced Baseline Regretcited by 3
- 2021Affordance-based Reinforcement Learning for Urban Drivingcited by 2
- 2023Learning Complicated Manipulation Skills via Deterministic Policy with Limited Demonstrationscited by 2
50 most cited of 84 All 84 (JSON)
- 2026VH-GPO: Verified Handoff for LLM Agent Reinforcement Learning27 Sep 2026
- 2026When and What to Teach: Budget-Aware Online Adaptation for Web Agents31 Aug 2026
- 2026Learning from Mistakes: Rollout-Retrieval Lifelong Policy Learning for Autonomous Driving29 Jun 2026
- 2026Scaling Self-Play for End-to-End Driving17 Jun 2026
- 2026Oracle-Guided Soft Shielding for Safe Move Prediction in Chess9 Mar 2026
- 2026RoboPocket: Improve Robot Policies Instantly with Your Phone5 Mar 2026
- 2026OVD: On-policy Verbal Distillation29 Jan 2026
- 2026Imitation Learning for Combinatorial Optimisation under Uncertainty8 Jan 2026
- 2025Distributionally Robust Imitation Learning: Layered Control Architecture for Certifiable Autonomy19 Dec 2025
- 2025A Review of Learning-Based Motion Planning: Toward a Data-Driven Optimal Control Approach12 Dec 2025
- 2025RoaD: Rollouts as Demonstrations for Closed-Loop Supervised Fine-Tuning of Autonomous Driving Policies1 Dec 2025
- 2025Sample-Efficient Expert Query Control in Active Imitation Learning via Conformal Prediction29 Nov 2025
38 more
- 2025CGoT: A Novel Inference Mechanism for Embodied Multi-Agent Systems Using Composable Graphs of Thoughts25 Oct 2025
- 2025From Learning to Mastery: Achieving Safe and Efficient Real-World Autonomous Driving with Human-In-The-Loop Reinforcement Learning7 Oct 2025
- 2025Data-Efficient Multitask DAgger29 Sep 2025
- 2025Robot-Gated Interactive Imitation Learning with Adaptive Intervention Mechanism10 Jun 2025
- 2025Confidence-Guided Human-AI Collaboration: Reinforcement Learning with Distributional Proxy Value Propagation for Autonomous Driving4 Jun 2025
- 2025Grower-in-the-Loop Interactive Reinforcement Learning for Greenhouse Climate Control29 May 2025
- 2025Genie Centurion: Accelerating Scalable Real-World Robot Training with Human Rewind-and-Refine Guidance24 May 2025
- 2025Robot Policy Transfer with Online Demonstrations: An Active Reinforcement Learning Approach17 Mar 2025
- 2025RoboCopilot: Human-in-the-loop Interactive Imitation Learning for Robot Manipulation10 Mar 2025
- 2025A Simple Approach to Constraint-Aware Imitation Learning with Application to Autonomous Racing10 Mar 2025
- 2025CAPS: Context-Aware Priority Sampling for Enhanced Imitation Learning in Autonomous Driving3 Mar 2025
- 2025End-to-End Imitation Learning for Optimal Asteroid Proximity Operations3 Feb 2025
- 2024Interactive and Hybrid Imitation Learning: Provably Beating Behavior Cloning9 Dec 2024
- 2024Closed-Loop Supervised Fine-Tuning of Tokenized Traffic Models5 Dec 2024
- 2024SIL-RRT*: Learning Sampling Distribution through Self Imitation Learning26 Nov 2024
- 2024Conformalized Interactive Imitation Learning: Handling Expert Shift and Intermittent Feedback11 Oct 2024
- 2024Fine-Tuning Hybrid Physics-Informed Neural Networks for Vehicle Dynamics Model Estimation29 Sep 2024
- 2024A Comparison of Imitation Learning Algorithms for Bimanual Manipulation13 Aug 2024
- 2024MEReQ: Max-Ent Residual-Q Inverse RL for Sample-Efficient Alignment from Intervention24 Jun 2024
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correction16 May 2024
- 2024SAFE-GIL: SAFEty Guided Imitation Learning for Robotic Systems8 Apr 2024
- 2024Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Driving27 Mar 2024
- 2023Agnostic Interactive Imitation Learning: New Theory and Practical Algorithms28 Dec 2023
- 2023Toward a Surgeon-in-the-Loop Ophthalmic Robotic Apprentice using Reinforcement and Imitation Learning29 Nov 2023
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations26 Oct 2023
- 2023Human-in-the-Loop Task and Motion Planning for Imitation Learning24 Oct 2023
- 2023Progressively Efficient Learning13 Oct 2023
- 2023Symbolic Imitation Learning: From Black-Box to Explainable Driving Policies27 Sep 2023
- 2023IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisors27 Jun 2023
- 2023Imitating Task and Motion Planning with Visuomotor Transformers25 May 2023
- 2023Learning Complicated Manipulation Skills via Deterministic Policy with Limited Demonstrations29 Mar 2023
- 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectives17 Mar 2023
- 2023How To Guide Your Learner: Imitation Learning with Active Adaptive Expert Involvement3 Mar 2023
- 2023MEGA-DAgger: Imitation Learning with Multiple Imperfect Experts1 Mar 2023
- 2023Benchmarks and Algorithms for Offline Preference-Based Reward Learning3 Jan 2023
- 2023DADAgger: Disagreement-Augmented Dataset Aggregation3 Jan 2023
- 2022PATO: Policy Assisted TeleOperation for Scalable Robot Data Collection9 Dec 2022
- 2022Learning Visualization Policies of Augmented Reality for Human-Robot Collaboration13 Nov 2022
50 newest of 84 All 84 (JSON)
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2018HG-DAgger: Interactive Imitation Learning with Human Expertscited by 266
- 2022VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priorscited by 136
- 2021ThriftyDAgger: Budget-Aware Novelty and Risk Gating for Interactive Imitation Learningcited by 108
- 2018EnsembleDAgger: A Bayesian Approach to Safe Imitation Learningcited by 100
- 2020Autoregressive Knowledge Distillation through Imitation Learningcited by 74
- 2023Imitating Task and Motion Planning with Visuomotor Transformerscited by 66
- 2021LazyDAgger: Reducing Context Switching in Interactive Imitation Learningcited by 51
- 2023Human-in-the-Loop Task and Motion Planning for Imitation Learningcited by 29
- 2025RoboCopilot: Human-in-the-loop Interactive Imitation Learning for Robot Manipulationcited by 26
- 2022Eliciting Compatible Demonstrations for Multi-Human Imitation Learningcited by 23
- 2022Play it by Ear: Learning Skills amidst Occlusion through Audio-Visual Imitation Learningcited by 22
12 most cited of 41 All 41 (JSON)
- 2026Oracle-Guided Soft Shielding for Safe Move Prediction in Chess9 Mar 2026
- 2026RoboPocket: Improve Robot Policies Instantly with Your Phone5 Mar 2026
- 2026Imitation Learning for Combinatorial Optimisation under Uncertainty8 Jan 2026
- 2025Distributionally Robust Imitation Learning: Layered Control Architecture for Certifiable Autonomy19 Dec 2025
- 2025Sample-Efficient Expert Query Control in Active Imitation Learning via Conformal Prediction29 Nov 2025
- 2025Robot-Gated Interactive Imitation Learning with Adaptive Intervention Mechanism10 Jun 2025
- 2025RoboCopilot: Human-in-the-loop Interactive Imitation Learning for Robot Manipulation10 Mar 2025
- 2025A Simple Approach to Constraint-Aware Imitation Learning with Application to Autonomous Racing10 Mar 2025
- 2024Interactive and Hybrid Imitation Learning: Provably Beating Behavior Cloning9 Dec 2024
- 2024SIL-RRT*: Learning Sampling Distribution through Self Imitation Learning26 Nov 2024
- 2024A Comparison of Imitation Learning Algorithms for Bimanual Manipulation13 Aug 2024
- 2024SAFE-GIL: SAFEty Guided Imitation Learning for Robotic Systems8 Apr 2024
12 newest of 41 All 41 (JSON)
- 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectivescited by 114
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 61
- 2022Efficient Learning of Safe Driving Policy via Human-AI Copilot Optimizationcited by 49
- 2021Safe Driving via Expert Guided Policy Optimizationcited by 31
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehiclescited by 10
- 2025RoaD: Rollouts as Demonstrations for Closed-Loop Supervised Fine-Tuning of Autonomous Driving Policiescited by 6
- 2024Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Drivingcited by 4
- 2026Scaling Self-Play for End-to-End Drivingcited by 4
- 2021Affordance-based Reinforcement Learning for Urban Drivingcited by 2
- 2025From Learning to Mastery: Achieving Safe and Efficient Real-World Autonomous Driving with Human-In-The-Loop Reinforcement Learningcited by 2
- 2021Weakly Supervised Reinforcement Learning for Autonomous Highway Driving via Virtual Safety Cagescited by 1
- 2021Iterative Imitation Policy Improvement for Interactive Autonomous Drivingcited by 1
12 most cited of 18 All 18 (JSON)
- 2026Learning from Mistakes: Rollout-Retrieval Lifelong Policy Learning for Autonomous Driving29 Jun 2026
- 2026Scaling Self-Play for End-to-End Driving17 Jun 2026
- 2025RoaD: Rollouts as Demonstrations for Closed-Loop Supervised Fine-Tuning of Autonomous Driving Policies1 Dec 2025
- 2025From Learning to Mastery: Achieving Safe and Efficient Real-World Autonomous Driving with Human-In-The-Loop Reinforcement Learning7 Oct 2025
- 2025Confidence-Guided Human-AI Collaboration: Reinforcement Learning with Distributional Proxy Value Propagation for Autonomous Driving4 Jun 2025
- 2025CAPS: Context-Aware Priority Sampling for Enhanced Imitation Learning in Autonomous Driving3 Mar 2025
- 2024Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Driving27 Mar 2024
- 2023Symbolic Imitation Learning: From Black-Box to Explainable Driving Policies27 Sep 2023
- 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectives17 Mar 2023
- 2022Bridging Sim2Real Gap Using Image Gradients for the Task of End-to-End Autonomous Driving16 May 2022
- 2022Efficient Learning of Safe Driving Policy via Human-AI Copilot Optimization17 Feb 2022
- 2021Integrating Imitation Learning with Human Driving Data into Reinforcement Learning to Improve Training Efficiency for Autonomous Driving23 Nov 2021
12 newest of 18 All 18 (JSON)
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correctioncited by 59
- 2024Closed-Loop Supervised Fine-Tuning of Tokenized Traffic Modelscited by 40
- 2022Fleet-DAgger: Interactive Robot Fleet Learning with Scalable Human Supervisioncited by 30
- 2022When to Ask for Help: Proactive Interventions in Autonomous Reinforcement Learningcited by 21
- 2022PATO: Policy Assisted TeleOperation for Scalable Robot Data Collectioncited by 19
- 2021Multi-Task Learning with Sequence-Conditioned Transporter Networkscited by 8
- 2022A Joint Imitation-Reinforcement Learning Framework for Reduced Baseline Regretcited by 3
- 2023Learning Complicated Manipulation Skills via Deterministic Policy with Limited Demonstrationscited by 2
- 2023DADAgger: Disagreement-Augmented Dataset Aggregationcited by 1
- 2024Fine-Tuning Hybrid Physics-Informed Neural Networks for Vehicle Dynamics Model Estimationcited by 1
- 2025End-to-End Imitation Learning for Optimal Asteroid Proximity Operationscited by 1
- 2025Data-Efficient Multitask DAggercited by 1
12 most cited of 15 All 15 (JSON)
- 2025A Review of Learning-Based Motion Planning: Toward a Data-Driven Optimal Control Approach12 Dec 2025
- 2025Data-Efficient Multitask DAgger29 Sep 2025
- 2025End-to-End Imitation Learning for Optimal Asteroid Proximity Operations3 Feb 2025
- 2024Closed-Loop Supervised Fine-Tuning of Tokenized Traffic Models5 Dec 2024
- 2024Fine-Tuning Hybrid Physics-Informed Neural Networks for Vehicle Dynamics Model Estimation29 Sep 2024
- 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correction16 May 2024
- 2023Learning Complicated Manipulation Skills via Deterministic Policy with Limited Demonstrations29 Mar 2023
- 2023DADAgger: Disagreement-Augmented Dataset Aggregation3 Jan 2023
- 2022PATO: Policy Assisted TeleOperation for Scalable Robot Data Collection9 Dec 2022
- 2022Learning Visualization Policies of Augmented Reality for Human-Robot Collaboration13 Nov 2022
- 2022When to Ask for Help: Proactive Interventions in Autonomous Reinforcement Learning19 Oct 2022
- 2022A Joint Imitation-Reinforcement Learning Framework for Reduced Baseline Regret20 Sep 2022
12 newest of 15 All 15 (JSON)