Foresight in Motion: Reinforcing Trajectory Prediction with Reward Heuristics
Not on the map. Why?
Abstract (arXiv)
Motion forecasting for on-road traffic agents presents both a significant challenge and a critical necessity for ensuring safety in autonomous driving systems. In contrast to most existing data-driven approaches that directly predict future trajectories, we rethink this task from a planning perspective, advocating a "First Reasoning, Then Forecasting" strategy that explicitly incorporates behavior intentions as spatial guidance for trajectory prediction. To achieve this, we introduce an interpretable, reward-driven intention reasoner grounded in a novel query-centric Inverse Reinforcement Learning (IRL) scheme. Our method first encodes traffic agents and scene elements into a unified vectorized representation, then aggregates contextual features through a query-centric paradigm. This enables the derivation of a reward distribution, a compact yet informative representation of the target agent's behavior within the given scene context via IRL. Guided by this reward heuristic, we perform policy rollouts to reason about multiple plausible intentions, providing valuable priors for subsequent trajectory generation. Finally, we develop a hierarchical DETR-like decoder integrated with bidirectional selective state space models to produce accurate future trajectories along with their associated probabilities. Extensive experiments on the large-scale Argoverse and nuScenes motion forecasting datasets demonstrate that our approach significantly enhances trajectory prediction confidence, achieving highly competitive performance relative to state-of-the-art methods.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 36 of its 55 references that are in the map. First posted on arXiv 16 Jul 2025.
Builds on
36 of 55 references.
References · 36
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
24 more
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 280
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 270
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
- 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 113
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2020PiP: Planning-informed Trajectory Prediction for Autonomous Drivingcited by 80
- 2020Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Planscited by 72
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Predictioncited by 52
- 2024HPNet: Dynamic Trajectory Forecasting with Historical Prediction Attentioncited by 38
- 2020Efficient Sampling-Based Maximum Entropy Inverse Reinforcement Learning with Application to Autonomous Drivingcited by 34
- 2022Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Drivingcited by 34
- 2023MacFormer: Map-Agent Coupled Transformer for Real-time and Robust Trajectory Predictioncited by 32
- 2024SIMPL: A Simple and Efficient Multi-agent Motion Prediction Baseline for Autonomous Drivingcited by 27
- 2019Scene Compliant Trajectory Forecast with Agent-Centric Spatio-Temporal Gridscited by 24
- 2021Trajectory Prediction with Graph-based Dual-scale Context Fusioncited by 19
- 2024DeMo: Decoupling Motion Forecasting into Directional Intentions and Dynamic Statescited by 17
- 2022KEMP: Keyframe-Based Hierarchical End-to-End Deep Model for Long-Term Trajectory Predictioncited by 11
- 2025SEPT: Standard-Definition Map Enhanced Scene Perception and Topology Reasoning for Autonomous Drivingcited by 9
- 2018Integrating kinematics and environment context into deep inverse reinforcement learning for predicting off-road vehicle trajectoriescited by 7
- 2025GoIRL: Graph-Oriented Inverse Reinforcement Learning for Multimodal Trajectory Predictioncited by 7
Built on by
Citing papers per year: 2025: 4; 2026: 2.
6 papers.
- 2025Advancing Multi-agent Traffic Simulation via R1-Style Reinforcement Fine-Tuningcited by 14
- 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Drivingcited by 11
- 2025ST-GS: Vision-Based 3D Semantic Occupancy Prediction with Spatial-Temporal Gaussian Splattingcited by 4
- 2026Unified Prediction and Planning via Conflict-Aware Disjoint Parameter Trainingcited by 1
- 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposalscited by 0
- 2026A Unified Framework for Trajectory Prediction with Explicit Planning and Reaction Decompositioncited by 0
- 2026A Unified Framework for Trajectory Prediction with Explicit Planning and Reaction Decomposition6 Aug 2026
- 2026Unified Prediction and Planning via Conflict-Aware Disjoint Parameter Training22 Jul 2026
- 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving28 Dec 2025
- 2025Advancing Multi-agent Traffic Simulation via R1-Style Reinforcement Fine-Tuning28 Sep 2025
- 2025ST-GS: Vision-Based 3D Semantic Occupancy Prediction with Spatial-Temporal Gaussian Splatting20 Sep 2025
- 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposals12 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2020Planning on the fast lane: Learning to interact using attention mechanisms in path integral inverse reinforcement learning
- 2025Generalizable Trajectory Prediction via Inverse Reinforcement Learning with Mamba-Graph Architecture
- 2023Human-Like Implicit Intention Expression for Autonomous Driving Motion Planning: A Method Based on Learning Human Intention Priors
- 2019Driving with Style: Inverse Reinforcement Learning in General-Purpose Planning for Automated Driving
- 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Driving
- 2025Toward Efficient and Robust Behavior Models for Multi-Agent Driving Simulation
- 2026INTERACT: Interactive Planning for Autonomous Driving via Anchor-Conditioned Prediction and Trust-Region Refinement
- 2026DA-WAM: Decision-Aligned Future Latents for Driving World Models