LAformer: Trajectory Prediction for Autonomous Driving with Lane-Aware Scene Constraints
Not on the map. Why?
Abstract (arXiv)
Trajectory prediction for autonomous driving must continuously reason the motion stochasticity of road agents and comply with scene constraints. Existing methods typically rely on one-stage trajectory prediction models, which condition future trajectories on observed trajectories combined with fused scene information. However, they often struggle with complex scene constraints, such as those encountered at intersections. To this end, we present a novel method, called LAformer. It uses a temporally dense lane-aware estimation module to select only the top highly potential lane segments in an HD map, which effectively and continuously aligns motion dynamics with scene information, reducing the representation requirements for the subsequent attention-based decoder by filtering out irrelevant lane segments. Additionally, unlike one-stage prediction models, LAformer utilizes predictions from the first stage as anchor trajectories and adds a second-stage motion refinement module to further explore temporal consistency across the complete time horizon. Extensive experiments on Argoverse 1 and nuScenes demonstrate that LAformer achieves excellent performance for multimodal trajectory prediction.
Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 45 of its 61 references that are in the map. First posted on arXiv 27 Feb 2023.
Builds on
45 of 61 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2022Generative Adversarial Networkscited by 5,627
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
- 2014Semi-Supervised Learning with Deep Generative Modelscited by 496
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
33 more
- 2020TNT: Target-driveN Trajectory Predictioncited by 347
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 331
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 298
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 208
- 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 179
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 113
- 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 113
- 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2020PiP: Planning-informed Trajectory Prediction for Autonomous Drivingcited by 80
- 2020What-If Motion Prediction for Autonomous Drivingcited by 80
- 2021Multi-modal Motion Prediction with Transformer-based Neural Network for Autonomous Drivingcited by 73
- 2020Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Planscited by 72
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agentscited by 64
- 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 64
- 2018On GANs and GMMscited by 62
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2021Divide-and-Conquer for Lane-Aware Diverse Trajectory Predictioncited by 37
- 2020Probabilistic Multi-modal Trajectory Prediction with Lane Attention for Autonomous Vehiclescited by 28
- 2023The OpenCDA Open-source Ecosystem for Cooperative Driving Automation Researchcited by 27
- 2022Hierarchical Latent Structure for Multi-Modal Vehicle Trajectory Forecastingcited by 14
- 2020Trajectory Prediction for Autonomous Driving based on Multi-Head Attention with Joint Agent-Map Representationcited by 12
- 2022Aware of the History: Trajectory Forecasting with the Local Behavior Datacited by 9
Built on by
Citing papers per year: 2023: 6; 2024: 16; 2025: 19; 2026: 12.
53 papers.
Sort:
By area:
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2025MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learningcited by 25
- 2026DriveVA: Video Action Models are Zero-Shot Driverscited by 23
- 2024VisionTrap: Vision-Augmented Trajectory Prediction Guided by Textual Descriptionscited by 19
- 2025Trajectory Mamba: Efficient Attention-Mamba Forecasting Model Based on Selective SSMcited by 18
- 2024NEST: A Neuromodulated Small-world Hypergraph Trajectory Prediction Model for Autonomous Drivingcited by 12
- 2024SemanticFormer: Holistic and Semantic Traffic Scene Representation for Trajectory Prediction using Knowledge Graphscited by 11
- 2025Multi-modal Knowledge Distillation-based Human Trajectory Forecastingcited by 10
- 2023nuScenes Knowledge Graph -- A comprehensive semantic representation of traffic scenes for trajectory predictioncited by 7
- 2023Mind the map! Accounting for existing map information when estimating online HDMaps from sensorcited by 6
- 2024Reviving Life on the Edge: Joint Score-Based Graph Generation of Rich Edge Attributescited by 6
- 2024Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Networkcited by 6
38 more
- 2024SocialFormer: Social Interaction Modeling with Edge-enhanced Heterogeneous Graph Transformers for Trajectory Predictioncited by 5
- 2024Stochasticity in Motion: An Information-Theoretic Approach to Trajectory Predictioncited by 5
- 20254DSTR: Advancing Generative 4D Gaussians with Spatial-Temporal Rectification for High-Quality and Consistent 4D Generationcited by 5
- 2024Motion Forecasting via Model-Based Risk Minimizationcited by 4
- 2025Learning Through Retrospection: Improving Trajectory Prediction for Automated Driving with Error Feedbackcited by 4
- 2025Beyond Patterns: Harnessing Causal Logic for Autonomous Driving Trajectory Predictioncited by 4
- 2025AMD: Adaptive Momentum and Decoupled Contrastive Learning Framework for Robust Long-Tail Trajectory Predictioncited by 4
- 2023Enhancing Mapless Trajectory Prediction through Knowledge Distillationcited by 3
- 2024Controllable Diverse Sampling for Diffusion Based Motion Behavior Forecastingcited by 3
- 2024Multi-scale Temporal Fusion Transformer for Incomplete Vehicle Trajectory Predictioncited by 3
- 2024Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehiclescited by 3
- 2024CASPFormer: Trajectory Prediction from BEV Images with Deformable Attentioncited by 3
- 2023SIMMF: Semantics-aware Interactive Multiagent Motion Forecasting for Autonomous Vehicle Drivingcited by 2
- 2023An End-to-End Framework of Road User Detection, Tracking, and Prediction from Monocular Imagescited by 2
- 2024A Structure-Aware Lane Graph Transformer Model for Vehicle Trajectory Predictioncited by 2
- 2025DiffSemanticFusion: Semantic Raster BEV Fusion for Autonomous Driving via Online HD Map Diffusioncited by 2
- 2024Interpretable Interaction Modeling for Trajectory Prediction via Agent Selection and Physical Coefficientcited by 1
- 2024Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encodingcited by 1
- 2025Post-interactive Multimodal Trajectory Prediction for Autonomous Drivingcited by 1
- 2025Learning Velocity and Acceleration: Self-Supervised Motion Consistency for Pedestrian Trajectory Predictioncited by 1
- 2025LMFormer: Lane based Motion Prediction Transformercited by 1
- 2025CaTFormer: Causal Temporal Transformer with Dynamic Contextual Fusion for Driving Intention Predictioncited by 1
- 2025Addressing Corner Cases in Autonomous Driving: A World Model-based Approach with Mixture of Experts and LLMscited by 1
- 2025Driving is a Game: Combining Planning and Prediction with Bayesian Iterative Best Responsecited by 1
- 2026HiMAP: History-aware Map-occupancy Prediction with Fallbackcited by 1
- 2024Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Modelscited by 0
- 2025GC-GAT: Multimodal Vehicular Trajectory Prediction using Graph Goal Conditioning and Cross-context Attentioncited by 0
- 2025LTMSformer: A Local Trend-Aware Attention and Motion State Encoding Transformer for Multi-Agent Trajectory Predictioncited by 0
- 2025From Marginal to Joint Predictions: Evaluating Scene-Consistent Trajectory Prediction Approaches for Automated Drivingcited by 0
- 2025ILNet: Trajectory Prediction with Inverse Learning Attention for Enhancing Intention Capturecited by 0
- 2025Ensemble of Pre-Trained Models for Long-Tailed Trajectory Predictioncited by 0
- 2026SHARP: Short-Window Streaming for Accurate and Robust Prediction in Motion Forecastingcited by 0
- 2026Super Agents and Confounders: Influence of surrounding agents on vehicle trajectory predictioncited by 0
- 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehiclescited by 0
- 2026Chatting about Conditional Trajectory Predictioncited by 0
- 2026A Dynamic Scene Interaction Reasoning Framework for Scene-level Lane-Change Intention and Trajectory Prediction of Multiple Interacting Vehiclescited by 0
- 2026Pivot-Centric Trajectory Prediction: Bridging Long Horizons via Dynamical Guidancecited by 0
- 2026INTERACT: Interactive Planning for Autonomous Driving via Anchor-Conditioned Prediction and Trust-Region Refinementcited by 0
50 most cited of 53 All 53 (JSON)
- 2026Trajectory Prediction for Autonomous Driving in Road Construction Zones Using Human-in-the-Loop Driving Data8 Oct 2026
- 2026MemReg: Streaming Outdoor LiDAR Point Cloud Registration with Hybrid Memory Buffers8 Oct 2026
- 2026MoCAR: Motion-code Coordinate-aware AutoRegression for Continuous Trajectory Forecasting5 Oct 2026
- 2026INTERACT: Interactive Planning for Autonomous Driving via Anchor-Conditioned Prediction and Trust-Region Refinement25 Sep 2026
- 2026Pivot-Centric Trajectory Prediction: Bridging Long Horizons via Dynamical Guidance4 Aug 2026
- 2026A Dynamic Scene Interaction Reasoning Framework for Scene-level Lane-Change Intention and Trajectory Prediction of Multiple Interacting Vehicles2 Jul 2026
- 2026Chatting about Conditional Trajectory Prediction20 Apr 2026
- 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehicles6 Apr 2026
- 2026DriveVA: Video Action Models are Zero-Shot Drivers5 Apr 2026
- 2026Super Agents and Confounders: Influence of surrounding agents on vehicle trajectory prediction3 Apr 2026
- 2026SHARP: Short-Window Streaming for Accurate and Robust Prediction in Motion Forecasting30 Mar 2026
- 2026HiMAP: History-aware Map-occupancy Prediction with Fallback19 Feb 2026
38 more
- 2025MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learning15 Dec 2025
- 2025Driving is a Game: Combining Planning and Prediction with Bayesian Iterative Best Response3 Dec 2025
- 20254DSTR: Advancing Generative 4D Gaussians with Spatial-Temporal Rectification for High-Quality and Consistent 4D Generation10 Nov 2025
- 2025Addressing Corner Cases in Autonomous Driving: A World Model-based Approach with Mixture of Experts and LLMs23 Oct 2025
- 2025Ensemble of Pre-Trained Models for Long-Tailed Trajectory Prediction17 Sep 2025
- 2025DiffSemanticFusion: Semantic Raster BEV Fusion for Autonomous Driving via Online HD Map Diffusion3 Aug 2025
- 2025CaTFormer: Causal Temporal Transformer with Dynamic Contextual Fusion for Driving Intention Prediction17 Jul 2025
- 2025ILNet: Trajectory Prediction with Inverse Learning Attention for Enhancing Intention Capture9 Jul 2025
- 2025From Marginal to Joint Predictions: Evaluating Scene-Consistent Trajectory Prediction Approaches for Automated Driving7 Jul 2025
- 2025LTMSformer: A Local Trend-Aware Attention and Motion State Encoding Transformer for Multi-Agent Trajectory Prediction7 Jul 2025
- 2025AMD: Adaptive Momentum and Decoupled Contrastive Learning Framework for Robust Long-Tail Trajectory Prediction2 Jul 2025
- 2025Beyond Patterns: Harnessing Causal Logic for Autonomous Driving Trajectory Prediction11 May 2025
- 2025Learning Through Retrospection: Improving Trajectory Prediction for Automated Driving with Error Feedback18 Apr 2025
- 2025GC-GAT: Multimodal Vehicular Trajectory Prediction using Graph Goal Conditioning and Cross-context Attention15 Apr 2025
- 2025LMFormer: Lane based Motion Prediction Transformer14 Apr 2025
- 2025Learning Velocity and Acceleration: Self-Supervised Motion Consistency for Pedestrian Trajectory Prediction31 Mar 2025
- 2025Multi-modal Knowledge Distillation-based Human Trajectory Forecasting28 Mar 2025
- 2025Trajectory Mamba: Efficient Attention-Mamba Forecasting Model Based on Selective SSM13 Mar 2025
- 2025Post-interactive Multimodal Trajectory Prediction for Autonomous Driving12 Mar 2025
- 2024NEST: A Neuromodulated Small-world Hypergraph Trajectory Prediction Model for Autonomous Driving16 Dec 2024
- 2024Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encoding17 Nov 2024
- 2024Stochasticity in Motion: An Information-Theoretic Approach to Trajectory Prediction2 Oct 2024
- 2024CASPFormer: Trajectory Prediction from BEV Images with Deformable Attention26 Sep 2024
- 2024Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehicles25 Sep 2024
- 2024Motion Forecasting via Model-Based Risk Minimization16 Sep 2024
- 2024Multi-scale Temporal Fusion Transformer for Incomplete Vehicle Trajectory Prediction2 Sep 2024
- 2024Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Network26 Jul 2024
- 2024VisionTrap: Vision-Augmented Trajectory Prediction Guided by Textual Descriptions17 Jul 2024
- 2024A Structure-Aware Lane Graph Transformer Model for Vehicle Trajectory Prediction30 May 2024
- 2024Interpretable Interaction Modeling for Trajectory Prediction via Agent Selection and Physical Coefficient21 May 2024
- 2024Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Models8 May 2024
- 2024SocialFormer: Social Interaction Modeling with Edge-enhanced Heterogeneous Graph Transformers for Trajectory Prediction6 May 2024
- 2024SemanticFormer: Holistic and Semantic Traffic Scene Representation for Trajectory Prediction using Knowledge Graphs30 Apr 2024
- 2024Reviving Life on the Edge: Joint Score-Based Graph Generation of Rich Edge Attributes6 Feb 2024
- 2024Controllable Diverse Sampling for Diffusion Based Motion Behavior Forecasting6 Feb 2024
- 2023nuScenes Knowledge Graph -- A comprehensive semantic representation of traffic scenes for trajectory prediction15 Dec 2023
- 2023Mind the map! Accounting for existing map information when estimating online HDMaps from sensor17 Nov 2023
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Review10 Aug 2023
50 newest of 53 All 53 (JSON)
- 2025Learning Through Retrospection: Improving Trajectory Prediction for Automated Driving with Error Feedbackcited by 4
- 2025DiffSemanticFusion: Semantic Raster BEV Fusion for Autonomous Driving via Online HD Map Diffusioncited by 2
- 2025Driving is a Game: Combining Planning and Prediction with Bayesian Iterative Best Responsecited by 1
- 2026INTERACT: Interactive Planning for Autonomous Driving via Anchor-Conditioned Prediction and Trust-Region Refinementcited by 0
- 2026INTERACT: Interactive Planning for Autonomous Driving via Anchor-Conditioned Prediction and Trust-Region Refinement25 Sep 2026
- 2025Driving is a Game: Combining Planning and Prediction with Bayesian Iterative Best Response3 Dec 2025
- 2025DiffSemanticFusion: Semantic Raster BEV Fusion for Autonomous Driving via Online HD Map Diffusion3 Aug 2025
- 2025Learning Through Retrospection: Improving Trajectory Prediction for Automated Driving with Error Feedback18 Apr 2025
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2024VisionTrap: Vision-Augmented Trajectory Prediction Guided by Textual Descriptionscited by 19
- 2024NEST: A Neuromodulated Small-world Hypergraph Trajectory Prediction Model for Autonomous Drivingcited by 12
- 2024SemanticFormer: Holistic and Semantic Traffic Scene Representation for Trajectory Prediction using Knowledge Graphscited by 11
- 2023nuScenes Knowledge Graph -- A comprehensive semantic representation of traffic scenes for trajectory predictioncited by 7
- 2023Mind the map! Accounting for existing map information when estimating online HDMaps from sensorcited by 6
- 2024Reviving Life on the Edge: Joint Score-Based Graph Generation of Rich Edge Attributescited by 6
- 2024Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Networkcited by 6
- 2024SocialFormer: Social Interaction Modeling with Edge-enhanced Heterogeneous Graph Transformers for Trajectory Predictioncited by 5
- 2024Stochasticity in Motion: An Information-Theoretic Approach to Trajectory Predictioncited by 5
- 20254DSTR: Advancing Generative 4D Gaussians with Spatial-Temporal Rectification for High-Quality and Consistent 4D Generationcited by 5
- 2024Motion Forecasting via Model-Based Risk Minimizationcited by 4
12 most cited of 43 All 43 (JSON)
- 2026Trajectory Prediction for Autonomous Driving in Road Construction Zones Using Human-in-the-Loop Driving Data8 Oct 2026
- 2026MemReg: Streaming Outdoor LiDAR Point Cloud Registration with Hybrid Memory Buffers8 Oct 2026
- 2026MoCAR: Motion-code Coordinate-aware AutoRegression for Continuous Trajectory Forecasting5 Oct 2026
- 2026Pivot-Centric Trajectory Prediction: Bridging Long Horizons via Dynamical Guidance4 Aug 2026
- 2026A Dynamic Scene Interaction Reasoning Framework for Scene-level Lane-Change Intention and Trajectory Prediction of Multiple Interacting Vehicles2 Jul 2026
- 2026Chatting about Conditional Trajectory Prediction20 Apr 2026
- 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehicles6 Apr 2026
- 2026Super Agents and Confounders: Influence of surrounding agents on vehicle trajectory prediction3 Apr 2026
- 2026SHARP: Short-Window Streaming for Accurate and Robust Prediction in Motion Forecasting30 Mar 2026
- 2026HiMAP: History-aware Map-occupancy Prediction with Fallback19 Feb 2026
- 20254DSTR: Advancing Generative 4D Gaussians with Spatial-Temporal Rectification for High-Quality and Consistent 4D Generation10 Nov 2025
- 2025Ensemble of Pre-Trained Models for Long-Tailed Trajectory Prediction17 Sep 2025
12 newest of 43 All 43 (JSON)