mlsanityData to 14 Oct 2026

BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposals

arXiv 2509.10080 ↗First posted 12 Sep 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In autonomous driving, trajectory prediction is essential for safe and efficient navigation. While recent methods often rely on high-definition (HD) maps to provide structured environmental priors, such maps are costly to maintain, geographically limited, and unreliable in dynamic or unmapped scenarios. Directly leveraging raw sensor data in Bird's-Eye View (BEV) space offers greater flexibility, but BEV features are dense and unstructured, making agent-centric spatial reasoning challenging and computationally inefficient. To address this, we propose Bird's-Eye View Trajectory Prediction (BEVTraj), a map-free framework that employs deformable attention to adaptively aggregate task-relevant context from sparse locations in dense BEV features. We further introduce a Sparse Goal Candidate Proposal (SGCP) module that predicts a small set of realistic goals, enabling fully end-to-end multimodal forecasting without heuristic post-processing. Extensive experiments show that BEVTraj achieves performance comparable to state-of-the-art HD map-based methods while providing greater robustness and flexibility without relying on pre-built maps. The source code is available at https://github.com/Kongminsang/bevtraj.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 64 of its 82 references that are in the map. First posted on arXiv 12 Sep 2025.

Builds on

64 of 82 references.

References · 64

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  5. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  6. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  7. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  8. 2022Planning-oriented Autonomous Drivingcited by 1,087
  9. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  10. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
  11. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
  12. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
38 more
  1. 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 573
  2. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
  3. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
  4. 2021Conditional DETR for Fast Training Convergencecited by 424
  5. 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
  6. 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
  7. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
  8. 2020TNT: Target-driveN Trajectory Predictioncited by 347
  9. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 331
  10. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
  11. 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
  12. 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
  13. 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
  14. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
  15. 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
  16. 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 280
  17. 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 270
  18. 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
  19. 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
  20. 2019Human Motion Trajectory Prediction: A Surveycited by 232
  21. 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
  22. 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 212
  23. 2022BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Drivingcited by 191
  24. 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 185
  25. 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
  26. 2020Keep your Eyes on the Lane: Real-time Attention-guided Lane Detectioncited by 138
  27. 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
  28. 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
  29. 2019Spatially-Aware Graph Neural Networks for Relational Behavior Forecasting from Sensor Datacited by 104
  30. 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
  31. 2018Uncertainty-aware Short-term Motion Prediction of Traffic Actors for Autonomous Drivingcited by 90
  32. 2024RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detectioncited by 82
  33. 2020MANTRA: Memory Augmented Networks for Multiple Trajectory Predictioncited by 69
  34. 2023FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Drivingcited by 67
  35. 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Predictioncited by 52
  36. 2022StretchBEV: Stretching Future Instance Prediction Spatially and Temporallycited by 47
  37. 2022Learning Ego 3D Representation as Ray Tracingcited by 43
  38. 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40

50 most cited of 64 All 64 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025BEV-VLM: Trajectory Planning via Unified BEV Abstraction
  2. 2024BEVWorld: A Multimodal World Simulator for Autonomous Driving via Scene-Level BEV Latents
  3. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers
  4. 2024BEVNav: Robot Autonomous Navigation Via Spatial-Temporal Contrastive Learning in Bird's-Eye View
  5. 2026Closed-Loop Evaluation of Bird's-Eye-View Maps from Cross-View Transformers as Inputs to Behavior-Cloning Policies
  6. 2026TGRIP: A Text-Guided Approach to Vehicle Instance Prediction in Autonomous Driving
  7. 2026SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representation
  8. 2025Future-Aware End-to-End Driving: Bidirectional Modeling of Trajectory Planning and Scene Evolution