mlsanityData to 7 Oct 2026

Pioneering SE(2)-Equivariant Trajectory Planning for Automated Driving

arXiv 2403.11304 ↗First posted 17 Mar 2024cs.RO cs.AI cs.MAcited by 4

On the map: End-to-end autonomous driving → End-to-end system architecture

Abstract (arXiv)

Planning the trajectory of the controlled ego vehicle is a key challenge in automated driving. As for human drivers, predicting the motions of surrounding vehicles is important to plan the own actions. Recent motion prediction methods utilize equivariant neural networks to exploit geometric symmetries in the scene. However, no existing method combines motion prediction and trajectory planning in a joint step while guaranteeing equivariance under roto-translations of the input space. We address this gap by proposing a lightweight equivariant planning model that generates multi-modal joint predictions for all vehicles and selects one mode as the ego plan. The equivariant network design improves sample efficiency, guarantees output stability, and reduces model parameters. We further propose equivariant route attraction to guide the ego vehicle along a high-level route provided by an off-the-shelf GPS navigation system. This module creates a momentum from embedded vehicle positions toward the route in latent space while keeping the equivariance property. Route attraction enables goal-oriented behavior without forcing the vehicle to stick to the exact route. We conduct experiments on the challenging nuScenes dataset to investigate the capability of our planner. The results show that the planned trajectory is stable under roto-translations of the input scene which demonstrates the equivariance of our model. Despite using only a small split of the dataset for training, our method improves L2 distance at 3 s by 20.6 % and surpasses the state of the art.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 47 of its 51 references that are in the map. First posted on arXiv 17 Mar 2024.

Builds on

47 of 51 references.

Closest ancestors · 6

Same direction, newest first

  1. 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?5 Dec
  2. 2023FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Driving2 Aug
  3. 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenes17 May
  4. 2022Safe Real-World Autonomous Driving by Learning to Predict and Plan with a Mixture of Experts3 Nov
  5. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning15 Jul
  6. 2021End-to-end Interpretable Neural Motion Planner17 Jan

Other references · 41

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2016Group Equivariant Convolutional Networkscited by 1,154
  5. 2022Planning-oriented Autonomous Drivingcited by 1,068
  6. 2021E(n) Equivariant Graph Neural Networkscited by 951
  7. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  8. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
  9. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  10. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  11. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
  12. 2019General E(2)-Equivariant Steerable CNNscited by 441
29 more
  1. 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 348
  2. 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 308
  3. 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
  4. 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 293
  5. 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
  6. 2023Parting with Misconceptions about Learning-based Vehicle Motion Planningcited by 238
  7. 2017Learning Steerable Filters for Rotation Equivariant CNNscited by 193
  8. 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
  9. 2023GameFormer: Game-theoretic Modeling and Learning of Transformer-based Interactive Prediction and Planning for Autonomous Drivingcited by 141
  10. 2020Incorporating Symmetry into Deep Dynamics Models for Improved Generalizationcited by 123
  11. 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
  12. 2016Rotation equivariant vector field networkscited by 98
  13. 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
  14. 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
  15. 2022Differentiable Raycasting for Self-supervised Occupancy Forecastingcited by 83
  16. 2017Polar Transformer Networkscited by 81
  17. 2020PiP: Planning-informed Trajectory Prediction for Autonomous Drivingcited by 80
  18. 2022Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Drivingcited by 71
  19. 2022GoRela: Go Relative for Viewpoint-Invariant Motion Forecastingcited by 68
  20. 2023From Prediction to Planning With Goal Conditioned Lane Graph Traversalscited by 45
  21. 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
  22. 2020Trajectory Prediction using Equivariant Continuous Convolutioncited by 26
  23. 2021Roto-translated Local Coordinate Frames For Interacting Dynamical Systemscited by 24
  24. 2023Tree-structured Policy Planning with Learned Behavior Modelscited by 24
  25. 2022StopNet: Scalable Trajectory and Occupancy Prediction for Urban Autonomous Drivingcited by 14
  26. 2021StarNet: Joint Action-Space Prediction with Star Graphs and Implicit Global Frame Self-Attentioncited by 12
  27. 2023Stay on Track: A Frenet Wrapper to Overcome Off-road Trajectories in Vehicle Motion Predictioncited by 10
  28. 2022Improving the Sample-Complexity of Deep Classification Networks with Invariant Integrationcited by 7
  29. 2023EqDrive: Efficient Equivariant Motion Forecasting with Multi-Modality for Autonomous Drivingcited by 7

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023EquiDiff: A Conditional Equivariant Diffusion Model For Trajectory Prediction
  2. 2025SE(3)-Equivariant Robot Learning and Control: A Tutorial Survey
  3. 2025Predictive Planner for Autonomous Driving with Consistency Models
  4. 2025Other Vehicle Trajectories Are Also Needed: A Driving World Model Unifies Ego-Other Vehicle Trajectories in Video Latent Space
  5. 2026Efficient Multi-Modal Planning with Reward-Guided Preference Optimization for Autonomous Driving
  6. 2023Interaction-Aware Trajectory Planning for Autonomous Vehicles with Analytic Integration of Neural Networks into Model Predictive Control
  7. 2025Fully Unified Motion Planning for End-to-End Autonomous Driving
  8. 2024Tractable Joint Prediction and Planning over Discrete Behavior Modes for Urban Driving