Pioneering SE(2)-Equivariant Trajectory Planning for Automated Driving
On the map: End-to-end autonomous driving → End-to-end system architecture
Abstract (arXiv)
Planning the trajectory of the controlled ego vehicle is a key challenge in automated driving. As for human drivers, predicting the motions of surrounding vehicles is important to plan the own actions. Recent motion prediction methods utilize equivariant neural networks to exploit geometric symmetries in the scene. However, no existing method combines motion prediction and trajectory planning in a joint step while guaranteeing equivariance under roto-translations of the input space. We address this gap by proposing a lightweight equivariant planning model that generates multi-modal joint predictions for all vehicles and selects one mode as the ego plan. The equivariant network design improves sample efficiency, guarantees output stability, and reduces model parameters. We further propose equivariant route attraction to guide the ego vehicle along a high-level route provided by an off-the-shelf GPS navigation system. This module creates a momentum from embedded vehicle positions toward the route in latent space while keeping the equivariance property. Route attraction enables goal-oriented behavior without forcing the vehicle to stick to the exact route. We conduct experiments on the challenging nuScenes dataset to investigate the capability of our planner. The results show that the planned trajectory is stable under roto-translations of the input scene which demonstrates the equivariance of our model. Despite using only a small split of the dataset for training, our method improves L2 distance at 3 s by 20.6 % and surpasses the state of the art.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 47 of its 51 references that are in the map. First posted on arXiv 17 Mar 2024.
Builds on
47 of 51 references.
Closest ancestors · 6
Same direction, newest first
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?5 Dec
- 2023FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Driving2 Aug
- 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenes17 May
- 2022Safe Real-World Autonomous Driving by Learning to Predict and Plan with a Mixture of Experts3 Nov
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning15 Jul
- 2021End-to-end Interpretable Neural Motion Planner17 Jan
Other references · 41
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2021E(n) Equivariant Graph Neural Networkscited by 951
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2019General E(2)-Equivariant Steerable CNNscited by 441
29 more
- 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 348
- 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 308
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 293
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
- 2017Learning Steerable Filters for Rotation Equivariant CNNscited by 193
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
- 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Drivingcited by 141
- 2020Incorporating Symmetry into Deep Dynamics Models for Improved Generalizationcited by 123
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2016Rotation equivariant vector field networkscited by 98
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
- 2022Differentiable Raycasting for Self-supervised Occupancy Forecastingcited by 83
- 2017Polar Transformer Networkscited by 81
- 2020PiP: Planning-informed Trajectory Prediction for Autonomous Drivingcited by 80
- 2022Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Drivingcited by 71
- 2022GoRela: Go Relative for Viewpoint-Invariant Motion Forecastingcited by 68
- 2023From Prediction to Planning With Goal Conditioned Lane Graph Traversalscited by 45
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2020Trajectory Prediction using Equivariant Continuous Convolutioncited by 26
- 2021Roto-translated Local Coordinate Frames For Interacting Dynamical Systemscited by 24
- 2023Tree-structured Policy Planning with Learned Behavior Modelscited by 24
- 2022StopNet: Scalable Trajectory and Occupancy Prediction for Urban Autonomous Drivingcited by 14
- 2021StarNet: Joint Action-Space Prediction with Star Graphs and Implicit Global Frame Self-Attentioncited by 12
- 2023Stay on Track: A Frenet Wrapper to Overcome Off-road Trajectories in Vehicle Motion Predictioncited by 10
- 2022Improving the Sample-Complexity of Deep Classification Networks with Invariant Integrationcited by 7
- 2023EqDrive: Efficient Equivariant Motion Forecasting with Multi-Modality for Autonomous Drivingcited by 7
Built on by
Citing papers per year: 2024: 1; 2025: 3.
4 papers.
- 2024LaneCPP: Continuous 3D Lane Detection using Physical Priorscited by 17
- 2025When Planners Meet Reality: How Learned, Reactive Traffic Agents Shift nuPlan Benchmarkscited by 7
- 2025Learning Through Retrospection: Improving Trajectory Prediction for Automated Driving with Error Feedbackcited by 3
- 2025Dynamic Intent Queries for Motion Transformer-based Trajectory Predictioncited by 2
- 2025When Planners Meet Reality: How Learned, Reactive Traffic Agents Shift nuPlan Benchmarks16 Oct 2025
- 2025Dynamic Intent Queries for Motion Transformer-based Trajectory Prediction22 Apr 2025
- 2025Learning Through Retrospection: Improving Trajectory Prediction for Automated Driving with Error Feedback18 Apr 2025
- 2024LaneCPP: Continuous 3D Lane Detection using Physical Priors12 Jun 2024
Similar, not cited
Close in wording, no citation either way
- 2023EquiDiff: A Conditional Equivariant Diffusion Model For Trajectory Prediction
- 2025SE(3)-Equivariant Robot Learning and Control: A Tutorial Survey
- 2025Predictive Planner for Autonomous Driving with Consistency Models
- 2025Other Vehicle Trajectories Are Also Needed: A Driving World Model Unifies Ego-Other Vehicle Trajectories in Video Latent Space
- 2026Efficient Multi-Modal Planning with Reward-Guided Preference Optimization for Autonomous Driving
- 2023Interaction-Aware Trajectory Planning for Autonomous Vehicles with Analytic Integration of Neural Networks into Model Predictive Control
- 2025Fully Unified Motion Planning for End-to-End Autonomous Driving
- 2024Tractable Joint Prediction and Planning over Discrete Behavior Modes for Urban Driving