Hydra-NeXt: Robust Closed-Loop Driving with Open-Loop Training
On the map: End-to-end autonomous driving → End-to-end system architecture
Abstract (arXiv)
End-to-end autonomous driving research currently faces a critical challenge in bridging the gap between open-loop training and closed-loop deployment. Current approaches are trained to predict trajectories in an open-loop environment, which struggle with quick reactions to other agents in closed-loop environments and risk generating kinematically infeasible plans due to the gap between open-loop training and closed-loop driving. In this paper, we introduce Hydra-NeXt, a novel multi-branch planning framework that unifies trajectory prediction, control prediction, and a trajectory refinement network in one model. Unlike current open-loop trajectory prediction models that only handle general-case planning, Hydra-NeXt further utilizes a control decoder to focus on short-term actions, which enables faster responses to dynamic situations and reactive agents. Moreover, we propose the Trajectory Refinement module to augment and refine the planning decisions by effectively adhering to kinematic constraints in closed-loop environments. This unified approach bridges the gap between open-loop training and closed-loop driving, demonstrating superior performance of 65.89 Driving Score (DS) and 48.20% Success Rate (SR) on the Bench2Drive dataset without relying on external experts for data collection. Hydra-NeXt surpasses the previous state-of-the-art by 22.98 DS and 17.49 SR, marking a significant advancement in autonomous driving. Code will be available at https://github.com/woxihuanjiangguo/Hydra-NeXt.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 41 of its 56 references that are in the map. First posted on arXiv 15 Mar 2025.
Builds on
41 of 56 references.
Closest ancestors · 11
Same direction, newest first
- 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mamba7 Aug
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking21 Jun
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Driving6 Jun
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?5 Dec
- 2023DriveAdapter: Breaking the Coupling Barrier of Perception and Planning in End-to-End Autonomous Driving1 Aug
- 2023Hidden Biases of End-to-End Driving Models13 Jun
- 2023Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Driving10 May
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning15 Jul
- 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline16 Jun
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving31 May
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
Other references · 30
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
18 more
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
- 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 210
- 2021End-to-End Urban Driving by Imitating a Reinforcement Learning Coachcited by 191
- 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimizationcited by 72
- 2024CarLLaVA: Vision language models for camera-only closed-loop drivingcited by 57
- 2023How Simulation Helps Autonomous Driving:A Survey of Sim2real, Digital Twins, and Parallel Intelligencecited by 55
- 2024Think2Drive: Efficient Reinforcement Learning by Thinking in Latent World Model for Quasi-Realistic Autonomous Driving (in CARLA-v2)cited by 51
- 2024Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Followingcited by 41
- 2023SceneDM: Scene-level Multi-agent Trajectory Generation with Consistent Diffusion Modelscited by 24
- 2024Diffusion-Based Environment-Aware Trajectory Predictioncited by 14
- 2024CarDreamer: Open-Source Learning Platform for World Model based Autonomous Drivingcited by 13
Built on by
Citing papers per year: 2025: 15; 2026: 24.
39 papers.
Sort:
By area:
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 145
- 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
- 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 57
- 2025SimScale: Learning to Drive via Real-World Simulation at Scalecited by 34
- 2025SpaceDrive: Infusing Spatial Awareness into VLM-based Autonomous Drivingcited by 28
- 2026SparseDriveV2: Scoring is All You Need for End-to-End Autonomous Drivingcited by 21
- 2025Scaling Laws of Motion Forecasting and Planning -- Technical Reportcited by 19
- 2025Reinforced Refinement with Self-Aware Expansion for End-to-End Autonomous Drivingcited by 19
- 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failurescited by 17
- 2025Zero-Human Demonstration End-to-end Autonomous Driving with Trajectory Scorercited by 16
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoningcited by 12
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation Systemcited by 10
27 more
- 2025TrajDiff: End-to-end Autonomous Driving without Perception Annotationcited by 8
- 2026Learning from Mistakes: Post-Training for Driving VLA with Takeover Datacited by 8
- 2026Do Open-Loop Metrics Predict Closed-Loop Driving? A Cross-Benchmark Correlation Study of NAVSIM and Bench2Drivecited by 6
- 2026Beyond Imitation: Learning Safe End-to-End Autonomous Driving from Hard Negativescited by 6
- 2026What Matters for Scalable and Robust Learning in End-to-End Driving Planners?cited by 5
- 2025TransDiffuser: Diverse Trajectory Generation with Decorrelated Multi-modal Representation for End-to-end Autonomous Drivingcited by 4
- 2026HAD: Combining Hierarchical Diffusion with Metric-Decoupled RL for End-to-End Drivingcited by 4
- 2025DriveCritic: Towards Context-Aware, Human-Aligned Evaluation for Autonomous Driving with Vision-Language Modelscited by 3
- 2025ExpertAD: Enhancing Autonomous Driving Systems with Mixture of Expertscited by 3
- 2026Bench2Drive-Robust: Benchmarking Closed-Loop Autonomous Driving under Deployment Perturbationscited by 3
- 2025DeMo++: Motion Decoupling for Autonomous Drivingcited by 1
- 2025Closing the Navigation Compliance Gap in End-to-end Autonomous Drivingcited by 1
- 2026AlignDrive: Aligned Lateral-Longitudinal Planning for End-to-End Autonomous Drivingcited by 1
- 2026MTDrive: Multi-turn Interactive Reinforcement Learning for Autonomous Drivingcited by 1
- 2026Risk-Aware World Model Predictive Control for Generalizable End-to-End Autonomous Drivingcited by 1
- 2026PerlAD: Towards Enhanced Closed-loop End-to-end Autonomous Driving with Pseudo-simulation-based Reinforcement Learningcited by 1
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modelingcited by 1
- 2026SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representationcited by 1
- 2026DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Drivingcited by 1
- 2026BLUE: Toward Better Language Use in Efficient Vision-Language-Action Models for Autonomous Drivingcited by 1
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Drivingcited by 1
- 2026Large Discrete Policy: Advancing Explicit Behavior Modeling with Stochastic Iterative Scoringcited by 1
- 2025UniPlanner: A Unified Motion Planning Framework for Autonomous Vehicle Decision-Making Systems via Multi-Dataset Integrationcited by 0
- 2026AD2: Analysis and Detection of Adversarial Threats in Visual Perception for End-to-End Autonomous Driving Systemscited by 0
- 2026Multimodal Action Diffusion for Robust End-to-End Autonomous Drivingcited by 0
- 2026Guiding End-to-End Driving Models with Endpoint-Constrained Trajectory Optimizationcited by 0
- 2026Closed-Loop Refinement and Execution for Learned Driving Plannerscited by 0
- 2026Closed-Loop Refinement and Execution for Learned Driving Planners1 Oct 2026
- 2026Guiding End-to-End Driving Models with Endpoint-Constrained Trajectory Optimization25 Sep 2026
- 2026Large Discrete Policy: Advancing Explicit Behavior Modeling with Stochastic Iterative Scoring7 Sep 2026
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Driving1 Jul 2026
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System16 Jun 2026
- 2026BLUE: Toward Better Language Use in Efficient Vision-Language-Action Models for Autonomous Driving7 Jun 2026
- 2026DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Driving7 Jun 2026
- 2026Multimodal Action Diffusion for Robust End-to-End Autonomous Driving1 Jun 2026
- 2026SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representation23 May 2026
- 2026Beyond Imitation: Learning Safe End-to-End Autonomous Driving from Hard Negatives19 May 2026
- 2026Bench2Drive-Robust: Benchmarking Closed-Loop Autonomous Driving under Deployment Perturbations18 May 2026
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoning14 May 2026
27 more
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modeling13 May 2026
- 2026Do Open-Loop Metrics Predict Closed-Loop Driving? A Cross-Benchmark Correlation Study of NAVSIM and Bench2Drive30 Apr 2026
- 2026HAD: Combining Hierarchical Diffusion with Metric-Decoupled RL for End-to-End Driving4 Apr 2026
- 2026SparseDriveV2: Scoring is All You Need for End-to-End Autonomous Driving31 Mar 2026
- 2026What Matters for Scalable and Robust Learning in End-to-End Driving Planners?16 Mar 2026
- 2026Learning from Mistakes: Post-Training for Driving VLA with Takeover Data16 Mar 2026
- 2026PerlAD: Towards Enhanced Closed-loop End-to-end Autonomous Driving with Pseudo-simulation-based Reinforcement Learning16 Mar 2026
- 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failures1 Mar 2026
- 2026Risk-Aware World Model Predictive Control for Generalizable End-to-End Autonomous Driving26 Feb 2026
- 2026AD2: Analysis and Detection of Adversarial Threats in Visual Perception for End-to-End Autonomous Driving Systems10 Feb 2026
- 2026MTDrive: Multi-turn Interactive Reinforcement Learning for Autonomous Driving30 Jan 2026
- 2026AlignDrive: Aligned Lateral-Longitudinal Planning for End-to-End Autonomous Driving5 Jan 2026
- 2025SpaceDrive: Infusing Spatial Awareness into VLM-based Autonomous Driving11 Dec 2025
- 2025Closing the Navigation Compliance Gap in End-to-end Autonomous Driving11 Dec 2025
- 2025TrajDiff: End-to-end Autonomous Driving without Perception Annotation30 Nov 2025
- 2025SimScale: Learning to Drive via Real-World Simulation at Scale28 Nov 2025
- 2025ExpertAD: Enhancing Autonomous Driving Systems with Mixture of Experts13 Nov 2025
- 2025UniPlanner: A Unified Motion Planning Framework for Autonomous Vehicle Decision-Making Systems via Multi-Dataset Integration28 Oct 2025
- 2025Zero-Human Demonstration End-to-end Autonomous Driving with Trajectory Scorer28 Oct 2025
- 2025DriveCritic: Towards Context-Aware, Human-Aligned Evaluation for Autonomous Driving with Vision-Language Models15 Oct 2025
- 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Driving17 Sep 2025
- 2025DeMo++: Motion Decoupling for Autonomous Driving23 Jul 2025
- 2025Reinforced Refinement with Self-Aware Expansion for End-to-End Autonomous Driving11 Jun 2025
- 2025Scaling Laws of Motion Forecasting and Planning -- Technical Report9 Jun 2025
- 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planning7 Jun 2025
- 2025TransDiffuser: Diverse Trajectory Generation with Decorrelated Multi-modal Representation for End-to-end Autonomous Driving14 May 2025
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr 2025
- 2026SparseDriveV2: Scoring is All You Need for End-to-End Autonomous Drivingcited by 21
- 2025Reinforced Refinement with Self-Aware Expansion for End-to-End Autonomous Drivingcited by 19
- 2025Zero-Human Demonstration End-to-end Autonomous Driving with Trajectory Scorercited by 16
- 2025TrajDiff: End-to-end Autonomous Driving without Perception Annotationcited by 8
- 2026Learning from Mistakes: Post-Training for Driving VLA with Takeover Datacited by 8
- 2026Do Open-Loop Metrics Predict Closed-Loop Driving? A Cross-Benchmark Correlation Study of NAVSIM and Bench2Drivecited by 6
- 2026Beyond Imitation: Learning Safe End-to-End Autonomous Driving from Hard Negativescited by 6
- 2026What Matters for Scalable and Robust Learning in End-to-End Driving Planners?cited by 5
- 2026HAD: Combining Hierarchical Diffusion with Metric-Decoupled RL for End-to-End Drivingcited by 4
- 2025ExpertAD: Enhancing Autonomous Driving Systems with Mixture of Expertscited by 3
- 2026Bench2Drive-Robust: Benchmarking Closed-Loop Autonomous Driving under Deployment Perturbationscited by 3
- 2025DeMo++: Motion Decoupling for Autonomous Drivingcited by 1
12 most cited of 22 All 22 (JSON)
- 2026Closed-Loop Refinement and Execution for Learned Driving Planners1 Oct 2026
- 2026Guiding End-to-End Driving Models with Endpoint-Constrained Trajectory Optimization25 Sep 2026
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Driving1 Jul 2026
- 2026DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Driving7 Jun 2026
- 2026Beyond Imitation: Learning Safe End-to-End Autonomous Driving from Hard Negatives19 May 2026
- 2026Bench2Drive-Robust: Benchmarking Closed-Loop Autonomous Driving under Deployment Perturbations18 May 2026
- 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modeling13 May 2026
- 2026Do Open-Loop Metrics Predict Closed-Loop Driving? A Cross-Benchmark Correlation Study of NAVSIM and Bench2Drive30 Apr 2026
- 2026HAD: Combining Hierarchical Diffusion with Metric-Decoupled RL for End-to-End Driving4 Apr 2026
- 2026SparseDriveV2: Scoring is All You Need for End-to-End Autonomous Driving31 Mar 2026
- 2026What Matters for Scalable and Robust Learning in End-to-End Driving Planners?16 Mar 2026
- 2026Learning from Mistakes: Post-Training for Driving VLA with Takeover Data16 Mar 2026
12 newest of 22 All 22 (JSON)
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 145
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoningcited by 12
- 2026Risk-Aware World Model Predictive Control for Generalizable End-to-End Autonomous Drivingcited by 1
- 2026SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representationcited by 1
- 2026SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representation23 May 2026
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoning14 May 2026
- 2026Risk-Aware World Model Predictive Control for Generalizable End-to-End Autonomous Driving26 Feb 2026
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr 2025
- 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
- 2025SimScale: Learning to Drive via Real-World Simulation at Scalecited by 34
- 2025Scaling Laws of Motion Forecasting and Planning -- Technical Reportcited by 19
- 2026Large Discrete Policy: Advancing Explicit Behavior Modeling with Stochastic Iterative Scoringcited by 1
- 2025UniPlanner: A Unified Motion Planning Framework for Autonomous Vehicle Decision-Making Systems via Multi-Dataset Integrationcited by 0
- 2026Large Discrete Policy: Advancing Explicit Behavior Modeling with Stochastic Iterative Scoring7 Sep 2026
- 2025SimScale: Learning to Drive via Real-World Simulation at Scale28 Nov 2025
- 2025UniPlanner: A Unified Motion Planning Framework for Autonomous Vehicle Decision-Making Systems via Multi-Dataset Integration28 Oct 2025
- 2025Scaling Laws of Motion Forecasting and Planning -- Technical Report9 Jun 2025
- 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planning7 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2023Rethinking Closed-loop Training for Autonomous Driving
- 2025Closing the Loop: Motion Prediction Models beyond Open-Loop Benchmarks
- 2026BridgeSim: Unveiling the OL-CL Gap in End-to-End Autonomous Driving
- 2024Integrating Decision-Making Into Differentiable Optimization Guided Learning for End-to-End Planning of Autonomous Vehicles
- 2026Post-Training in End-to-End Autonomous Driving
- 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms
- 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillation
- 2025Drive in Corridors: Enhancing the Safety of End-to-end Autonomous Driving via Corridor Learning and Planning