Driving on Registers
On the map: End-to-end autonomous driving → End-to-end system architecture
Abstract (arXiv)
We present DrivoR, a simple and efficient transformer-based architecture for end-to-end autonomous driving. Our approach builds on pretrained Vision Transformers (ViTs) and introduces camera-aware register tokens that compress multi-camera features into a compact scene representation, significantly reducing downstream computation without sacrificing accuracy. These tokens drive two lightweight transformer decoders that generate and then score candidate trajectories. The scoring decoder learns to mimic an oracle and predicts interpretable sub-scores representing aspects such as safety, comfort, and efficiency, enabling behavior-conditioned driving at inference. Despite its minimal design, DrivoR outperforms or matches strong contemporary baselines across NAVSIM-v1, NAVSIM-v2, and the photorealistic closed-loop HUGSIM benchmark. Our results show that a pure-transformer architecture, combined with targeted token compression, is sufficient for accurate, efficient, and adaptive end-to-end driving. Code and checkpoints will be made available via the project page.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 55 of its 62 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
55 of 62 references.
Closest ancestors · 13
Same direction, newest first
- 2025ResAD: Normalized Residual Trajectory Modeling for End-to-End Autonomous Driving9 Oct
- 2025DistillDrive: End-to-End Multi-Mode Autonomous Driving Distillation by Isomorphic Hetero-Source Planning Model7 Aug
- 2025PRIX: Learning to Plan from Raw Pixels for End-to-End Autonomous Driving23 Jul
- 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model1 Jul
- 2025iPad: Iterative Proposal-centric End-to-End Autonomous Driving21 May
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
- 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillation17 Mar
- 2025Centaur: Robust End-to-End Autonomous Driving with Test-Time Training14 Mar
- 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Driving7 Mar
- 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mamba7 Aug
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarking21 Jun
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving31 May
Other references · 42
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2022Token Merging: Your ViT But Fastercited by 995
- 2023Vision Transformers Need Registerscited by 844
- 2019Big Transfer (BiT): General Visual Representation Learningcited by 766
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
30 more
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 295
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 186
- 2019An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detectioncited by 163
- 2025Pseudo-Simulation for Autonomous Drivingcited by 141
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
- 2025Unified Vision-Language-Action Modelcited by 128
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Drivingcited by 127
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
- 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformerscited by 96
- 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Drivingcited by 84
- 2025Generalized Trajectory Scoring for End-to-end Multimodal Planningcited by 63
- 2025RAP: 3D Rasterization Augmented End-to-End Planningcited by 39
- 2025SimScale: Learning to Drive via Real-World Simulation at Scalecited by 34
- 2024CtRL-Sim: Reactive and Controllable Driving Agents with Offline Reinforcement Learningcited by 26
- 2025Future-Aware End-to-End Driving: Bidirectional Modeling of Trajectory Planning and Scene Evolutioncited by 22
- 2025DriveX: Omni Scene Modeling for Learning Generalizable World Knowledge in Autonomous Drivingcited by 20
- 2025Learning Personalized Driving Styles via Reinforcement Learning from Human Feedbackcited by 16
- 2025Zero-Human Demonstration End-to-end Autonomous Driving with Trajectory Scorercited by 16
- 2024Robust Bird's Eye View Segmentation by Adapting DINOv2cited by 6
- 2025Efficient Multi-Camera Tokenization with Triplanes for End-to-End Drivingcited by 6
- 2024SCaRL- A Synthetic Multi-Modal Dataset for Autonomous Drivingcited by 4
Built on by
Citing papers per year: 2026: 38.
38 papers.
Sort:
By area:
- 2026Drive-JEPA: Video JEPA Meets Multimodal Trajectory Distillation for End-to-End Drivingcited by 26
- 2026DriveFine: Refining-Augmented Masked Diffusion VLA for Precise and Robust Drivingcited by 18
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 15
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoningcited by 12
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigationcited by 10
- 2026BridgeSim: Unveiling the OL-CL Gap in End-to-End Autonomous Drivingcited by 9
- 2026CLOVER: Closed-Loop Value Estimation and Ranking for End-to-End Autonomous Driving Planningcited by 9
- 2026Test-Time Trajectory Optimization for Autonomous Drivingcited by 7
- 2026MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systemscited by 4
- 2026Scaling Self-Play for End-to-End Drivingcited by 4
- 2026ChainFlow-VLA: Causal Flow Planning with Vision-Language Modelscited by 3
- 2026DA-WAM: Decision-Aligned Future Latents for Driving World Modelscited by 3
26 more
- 2026CLEAR: Cognition and Latent Evaluation for Adaptive Routing in End-to-End Autonomous Drivingcited by 2
- 2026Pictura: Perspective-View Self-Play at Scale for Drivingcited by 2
- 2026From Representational Complementarity to Dual Systems: Synergizing VLM and Vision-Only Backbones for End-to-End Drivingcited by 1
- 2026NTR: Neural Token Reconstruction for Scene Token Bottleneck in End-to-End Drivingcited by 1
- 2026DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Drivingcited by 1
- 2026FlowR2A: Learning Reward-to-Action Distribution for Multimodal Driving Planningcited by 1
- 2026PriorEye: Geospatial Visual Priors for End-to-End Autonomous Drivingcited by 1
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Drivingcited by 1
- 2026Teaching Vision-Language-Action Models What to See and Where to Lookcited by 1
- 2026Large Discrete Policy: Advancing Explicit Behavior Modeling with Stochastic Iterative Scoringcited by 1
- 2026Threat-guided Policy-aware Scene Perturbation for Safe Autonomous Driving with Online Reinforcement Learningcited by 0
- 2026Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Drivingcited by 0
- 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigmscited by 0
- 2026SkyDrive: Learning to Drive in a New City from Aerial Traffic Monitoringcited by 0
- 2026Driving on Memorycited by 0
- 2026Designing Versatile Samples for Learned Trajectory Scoringcited by 0
- 2026DriveZero: End-to-End Driving Beyond Human Demonstrationscited by 0
- 2026Risk-Aware Occupancy for Safety-Oriented End-to-End Autonomous Drivingcited by 0
- 2026NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environmentscited by 0
- 2026DreamStream: Towards Policy-Oriented Generative Simulation for End-to-End Drivingcited by 0
- 2026Evaluation Is All You Need for Multi-Modal Autonomous Drivingcited by 0
- 2026Guiding End-to-End Driving Models with Endpoint-Constrained Trajectory Optimizationcited by 0
- 2026Progressive Risk Estimation for Accident Anticipationcited by 0
- 2026AD-E2E-JEPA: A Joint-Embedding Predictive Architecture For End-to-End Autonomous Drivingcited by 0
- 2026World4Scorer: Outcome-Grounded World Modeling for Autonomous Drivingcited by 0
- 2026ExceptionDrive: A Planning-Oriented Counterfactual Corner-Case Benchmark for Autonomous Drivingcited by 0
- 2026ExceptionDrive: A Planning-Oriented Counterfactual Corner-Case Benchmark for Autonomous Driving29 Sep 2026
- 2026World4Scorer: Outcome-Grounded World Modeling for Autonomous Driving29 Sep 2026
- 2026AD-E2E-JEPA: A Joint-Embedding Predictive Architecture For End-to-End Autonomous Driving28 Sep 2026
- 2026Progressive Risk Estimation for Accident Anticipation26 Sep 2026
- 2026Guiding End-to-End Driving Models with Endpoint-Constrained Trajectory Optimization25 Sep 2026
- 2026Evaluation Is All You Need for Multi-Modal Autonomous Driving25 Sep 2026
- 2026DreamStream: Towards Policy-Oriented Generative Simulation for End-to-End Driving22 Sep 2026
- 2026NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environments22 Sep 2026
- 2026Risk-Aware Occupancy for Safety-Oriented End-to-End Autonomous Driving18 Sep 2026
- 2026Large Discrete Policy: Advancing Explicit Behavior Modeling with Stochastic Iterative Scoring7 Sep 2026
- 2026DriveZero: End-to-End Driving Beyond Human Demonstrations5 Sep 2026
- 2026Designing Versatile Samples for Learned Trajectory Scoring1 Sep 2026
26 more
- 2026Driving on Memory31 Aug 2026
- 2026SkyDrive: Learning to Drive in a New City from Aerial Traffic Monitoring25 Aug 2026
- 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms20 Aug 2026
- 2026DA-WAM: Decision-Aligned Future Latents for Driving World Models19 Aug 2026
- 2026Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Driving18 Aug 2026
- 2026Threat-guided Policy-aware Scene Perturbation for Safe Autonomous Driving with Online Reinforcement Learning11 Aug 2026
- 2026Pictura: Perspective-View Self-Play at Scale for Driving28 Jul 2026
- 2026Teaching Vision-Language-Action Models What to See and Where to Look2 Jul 2026
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Driving1 Jul 2026
- 2026PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving30 Jun 2026
- 2026FlowR2A: Learning Reward-to-Action Distribution for Multimodal Driving Planning23 Jun 2026
- 2026Scaling Self-Play for End-to-End Driving17 Jun 2026
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation14 Jun 2026
- 2026DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Driving7 Jun 2026
- 2026Test-Time Trajectory Optimization for Autonomous Driving5 Jun 2026
- 2026CLEAR: Cognition and Latent Evaluation for Adaptive Routing in End-to-End Autonomous Driving4 Jun 2026
- 2026NTR: Neural Token Reconstruction for Scene Token Bottleneck in End-to-End Driving29 May 2026
- 2026ChainFlow-VLA: Causal Flow Planning with Vision-Language Models22 May 2026
- 2026CLOVER: Closed-Loop Value Estimation and Ranking for End-to-End Autonomous Driving Planning14 May 2026
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoning14 May 2026
- 2026MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems11 May 2026
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving10 May 2026
- 2026BridgeSim: Unveiling the OL-CL Gap in End-to-End Autonomous Driving12 Apr 2026
- 2026DriveFine: Refining-Augmented Masked Diffusion VLA for Precise and Robust Driving16 Feb 2026
- 2026From Representational Complementarity to Dual Systems: Synergizing VLM and Vision-Only Backbones for End-to-End Driving11 Feb 2026
- 2026Drive-JEPA: Video JEPA Meets Multimodal Trajectory Distillation for End-to-End Driving29 Jan 2026
- 2026Drive-JEPA: Video JEPA Meets Multimodal Trajectory Distillation for End-to-End Drivingcited by 26
- 2026BridgeSim: Unveiling the OL-CL Gap in End-to-End Autonomous Drivingcited by 9
- 2026CLOVER: Closed-Loop Value Estimation and Ranking for End-to-End Autonomous Driving Planningcited by 9
- 2026Test-Time Trajectory Optimization for Autonomous Drivingcited by 7
- 2026MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systemscited by 4
- 2026Scaling Self-Play for End-to-End Drivingcited by 4
- 2026CLEAR: Cognition and Latent Evaluation for Adaptive Routing in End-to-End Autonomous Drivingcited by 2
- 2026Pictura: Perspective-View Self-Play at Scale for Drivingcited by 2
- 2026NTR: Neural Token Reconstruction for Scene Token Bottleneck in End-to-End Drivingcited by 1
- 2026DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Drivingcited by 1
- 2026PriorEye: Geospatial Visual Priors for End-to-End Autonomous Drivingcited by 1
- 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Drivingcited by 1
12 most cited of 23 All 23 (JSON)
- 2026ExceptionDrive: A Planning-Oriented Counterfactual Corner-Case Benchmark for Autonomous Driving29 Sep 2026
- 2026Guiding End-to-End Driving Models with Endpoint-Constrained Trajectory Optimization25 Sep 2026
- 2026Evaluation Is All You Need for Multi-Modal Autonomous Driving25 Sep 2026
- 2026DreamStream: Towards Policy-Oriented Generative Simulation for End-to-End Driving22 Sep 2026
- 2026NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environments22 Sep 2026
- 2026Risk-Aware Occupancy for Safety-Oriented End-to-End Autonomous Driving18 Sep 2026
- 2026DriveZero: End-to-End Driving Beyond Human Demonstrations5 Sep 2026
- 2026Designing Versatile Samples for Learned Trajectory Scoring1 Sep 2026
- 2026Driving on Memory31 Aug 2026
- 2026Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Driving18 Aug 2026
- 2026Threat-guided Policy-aware Scene Perturbation for Safe Autonomous Driving with Online Reinforcement Learning11 Aug 2026
- 2026Pictura: Perspective-View Self-Play at Scale for Driving28 Jul 2026
12 newest of 23 All 23 (JSON)
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 15
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoningcited by 12
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigationcited by 10
- 2026DA-WAM: Decision-Aligned Future Latents for Driving World Modelscited by 3
- 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigmscited by 0
- 2026AD-E2E-JEPA: A Joint-Embedding Predictive Architecture For End-to-End Autonomous Drivingcited by 0
- 2026World4Scorer: Outcome-Grounded World Modeling for Autonomous Drivingcited by 0
- 2026World4Scorer: Outcome-Grounded World Modeling for Autonomous Driving29 Sep 2026
- 2026AD-E2E-JEPA: A Joint-Embedding Predictive Architecture For End-to-End Autonomous Driving28 Sep 2026
- 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms20 Aug 2026
- 2026DA-WAM: Decision-Aligned Future Latents for Driving World Models19 Aug 2026
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation14 Jun 2026
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoning14 May 2026
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving10 May 2026
- 2026FlowR2A: Learning Reward-to-Action Distribution for Multimodal Driving Planningcited by 1
- 2026Large Discrete Policy: Advancing Explicit Behavior Modeling with Stochastic Iterative Scoringcited by 1
- 2026SkyDrive: Learning to Drive in a New City from Aerial Traffic Monitoringcited by 0
- 2026Progressive Risk Estimation for Accident Anticipationcited by 0
- 2026Progressive Risk Estimation for Accident Anticipation26 Sep 2026
- 2026Large Discrete Policy: Advancing Explicit Behavior Modeling with Stochastic Iterative Scoring7 Sep 2026
- 2026SkyDrive: Learning to Drive in a New City from Aerial Traffic Monitoring25 Aug 2026
- 2026FlowR2A: Learning Reward-to-Action Distribution for Multimodal Driving Planning23 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026FROST-Drive: Scalable and Efficient End-to-End Driving with a Frozen Vision Encoder
- 2026FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving
- 2026FIVE-VLA: Fast and EffectIVE Autonomous Driving with Recurrent Action Memory
- 2023Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Driving
- 2026Fast-dDrive: Efficient Block-Diffusion VLM for Autonomous Driving
- 2023LeTFuser: Light-weight End-to-end Transformer-Based Sensor Fusion for Autonomous Driving with Multi-Task Learning
- 2026Reasoning-aware Speculative Decoding for Efficient Vision-Language-Action Models in Autonomous Driving
- 2026DriveMamba: Task-Centric Scalable State Space Model for Efficient End-to-End Autonomous Driving