mlsanityData to 7 Oct 2026

Divide-and-Conquer for Lane-Aware Diverse Trajectory Prediction

arXiv 2104.08277 ↗First posted 16 Apr 2021cs.CVcited by 37

Not on the map. Why?

Abstract (arXiv)

Trajectory prediction is a safety-critical tool for autonomous vehicles to plan and execute actions. Our work addresses two key challenges in trajectory prediction, learning multimodal outputs, and better predictions by imposing constraints using driving knowledge. Recent methods have achieved strong performances using Multi-Choice Learning objectives like winner-takes-all (WTA) or best-of-many. But the impact of those methods in learning diverse hypotheses is under-studied as such objectives highly depend on their initialization for diversity. As our first contribution, we propose a novel Divide-And-Conquer (DAC) approach that acts as a better initialization technique to WTA objective, resulting in diverse outputs without any spurious modes. Our second contribution is a novel trajectory prediction framework called ALAN that uses existing lane centerlines as anchors to provide trajectories constrained to the input lanes. Our framework provides multi-agent trajectory outputs in a forward pass by capturing interactions through hypercolumn descriptors and incorporating scene information in the form of rasterized images and per-agent lane anchors. Experiments on synthetic and real data show that the proposed DAC captures the data distribution better compare to other WTA family of objectives. Further, we show that our ALAN approach provides on par or better performance with SOTA methods evaluated on Nuscenes urban driving benchmark.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 16 Apr 2021.

Builds on

36 of 53 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  5. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  6. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
  7. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  8. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
  9. 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
  10. 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
  11. 2020TNT: Target-driveN Trajectory Predictioncited by 345
  12. 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
24 more
  1. 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
  2. 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
  3. 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
  4. 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
  5. 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
  6. 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
  7. 2019Multi-Agent Tensor Fusion for Contextual Trajectory Predictioncited by 131
  8. 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
  9. 2020Implicit Latent Variable Model for Scene-Consistent Motion Forecastingcited by 116
  10. 2016Learning in an Uncertain World: Representing Ambiguity Through Multiple Hypothesescited by 96
  11. 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
  12. 2019Diverse Trajectory Forecasting with Determinantal Point Processescited by 80
  13. 2020What-If Motion Prediction for Autonomous Drivingcited by 80
  14. 2016Stochastic Multiple Choice Learning for Training Diverse Deep Ensemblescited by 77
  15. 2020MANTRA: Memory Augmented Networks for Multiple Trajectory Predictioncited by 69
  16. 2020DSDNet: Deep Structured self-Driving Networkcited by 61
  17. 2018Accurate and Diverse Sampling of Sequences based on a "Best of Many" Sample Objectivecited by 56
  18. 2019DiversityGAN: Diversity-Aware Vehicle Motion Prediction via Latent Semantic Samplingcited by 40
  19. 2017CAR-Net: Clairvoyant Attentive Recurrent Networkcited by 34
  20. 2020The Importance of Prior Knowledge in Precise Multimodal Predictioncited by 25
  21. 2020SMART: Simultaneous Multi-Agent Recurrent Trajectory Predictioncited by 15
  22. 2019INFER: INtermediate representations for FuturE pRedictioncited by 12
  23. 2016PixelNet: Towards a General Pixel-level Architecturecited by 9
  24. 2019A Hierarchical Network for Diverse Trajectory Proposalscited by 2

Built on by

Cited by year

Citing papers per year: 2021: 5; 2022: 15; 2023: 5; 2024: 8; 2025: 4.

37 papers.

Sort:

By area:

  1. 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
  2. 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 116
  3. 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
  4. 2022On Adversarial Robustness of Trajectory Prediction for Autonomous Vehiclescited by 89
  5. 2023LAformer: Trajectory Prediction for Autonomous Driving with Lane-Aware Scene Constraintscited by 50
  6. 2022FJMP: Factorized Joint Multi-Agent Motion Prediction over Learned Directed Acyclic Interaction Graphscited by 41
  7. 2023FEND: A Future Enhanced Distribution-Aware Contrastive Learning Framework for Long-tail Trajectory Predictioncited by 31
  8. 2021Autonomy 2.0: Why is self-driving always 5 years away?cited by 30
  9. 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
  10. 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
  11. 2022TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Drivingcited by 23
  12. 2022Bootstrap Motion Forecasting With Self-Consistent Constraintscited by 23
25 more
  1. 2022LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Predictioncited by 19
  2. 2022Hierarchical Latent Structure for Multi-Modal Vehicle Trajectory Forecastingcited by 14
  3. 2022Uncertainty estimation for Cross-dataset performance in Trajectory predictioncited by 13
  4. 2022Collaborative Uncertainty Benefits Multi-Agent Multi-Modal Trajectory Forecastingcited by 13
  5. 2021HYPER: Learned Hybrid Trajectory Prediction via Factored Inference and Adaptive Samplingcited by 12
  6. 2022Diverse Multiple Trajectory Prediction Using a Two-stage Prediction Network Trained with Lane Losscited by 12
  7. 2022RAP: Risk-Aware Prediction for Robust Planningcited by 12
  8. 2024Annealed Multiple Choice Learning: Overcoming limitations of Winner-takes-all with annealingcited by 12
  9. 2024Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagationcited by 12
  10. 2022Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learningcited by 11
  11. 2022Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encodingcited by 8
  12. 2022Under the Hood of Transformer Networks for Trajectory Forecastingcited by 8
  13. 2023Conditional Unscented Autoencoders for Trajectory Predictioncited by 7
  14. 2024MVPbev: Multi-view Perspective Image Generation from BEV with Test-time Controllability and Generalizabilitycited by 7
  15. 2023PBP: Path-based Trajectory Prediction for Autonomous Drivingcited by 6
  16. 2024Winner-takes-all learners are geometry-aware conditional density estimatorscited by 6
  17. 2024Annealed Winner-Takes-All for Motion Forecastingcited by 4
  18. 2021Predicting Physical World Destinations for Commands Given to Self-Driving Carscited by 3
  19. 2024DECODE: Domain-aware Continual Domain Expansion for Motion Predictioncited by 2
  20. 2025Autoregressive Meta-Actions for Unified Controllable Trajectory Generationcited by 2
  21. 2025Multiple Choice Learning of Low-Rank Adapters for Language Modelingcited by 2
  22. 2025A New Perspective On AI Safety Through Control Theory Methodologiescited by 1
  23. 2024Tractable Joint Prediction and Planning over Discrete Behavior Modes for Urban Drivingcited by 0
  24. 2024Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Modelscited by 0
  25. 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictionscited by 0