TNT: Target-driveN Trajectory Prediction
Not on the map. Why?
Cited by 42 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Predicting the future behavior of moving agents is essential for real world applications. It is challenging as the intent of the agent and the corresponding behavior is unknown and intrinsically multimodal. Our key insight is that for prediction within a moderate time horizon, the future modes can be effectively captured by a set of target states. This leads to our target-driven trajectory prediction (TNT) framework. TNT has three stages which are trained end-to-end. It first predicts an agent's potential target states T steps into the future, by encoding its interactions with the environment and the other agents. TNT then generates trajectory state sequences conditioned on targets. A final stage estimates trajectory likelihoods and a final compact set of trajectory predictions is selected. This is in contrast to previous work which models agent intents as latent variables, and relies on test-time sampling to generate diverse trajectories. We benchmark TNT on trajectory prediction of vehicles and pedestrians, where we outperform state-of-the-art on Argoverse Forecasting, INTERACTION, Stanford Drone and an in-house Pedestrian-at-Intersection dataset.
Key facts. Cited by 345 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 43; 2022: 71; 2023: 76; 2024: 73; 2025: 53; 2026: 29.
345 papers.
Sort:
By area:
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2022BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Drivingcited by 191
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
38 more
- 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
- 2022Model-Based Imitation Learning for Urban Drivingcited by 149
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
- 2022Learning from All Vehiclescited by 135
- 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
- 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 116
- 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecastingcited by 114
- 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
- 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 112
- 2022HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encodingcited by 109
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2022BITS: Bi-level Imitation for Traffic Simulationcited by 80
- 2023Forecast-MAE: Self-supervised Pre-training for Motion Forecasting with Masked Autoencoderscited by 72
- 2021SafetyNet: Safe planning for real-world self-driving vehicles using machine-learned policiescited by 68
- 2022GoRela: Go Relative for Viewpoint-Invariant Motion Forecastingcited by 68
- 2023FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Drivingcited by 67
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agentscited by 64
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2022MUSE-VAE: Multi-Scale VAE for Environment-Aware Long Term Trajectory Predictioncited by 59
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2023TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Predictioncited by 56
- 2023LAformer: Trajectory Prediction for Autonomous Driving with Lane-Aware Scene Constraintscited by 50
- 2022GANet: Goal Area Network for Motion Forecastingcited by 49
- 2022StretchBEV: Stretching Future Instance Prediction Spatially and Temporallycited by 47
- 2023ProphNet: Efficient Agent-Centric Motion Forecasting with Anchor-Informed Proposalscited by 47
- 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Predictioncited by 47
- 2022Non-Probability Sampling Network for Stochastic Human Trajectory Predictioncited by 46
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Drivingcited by 46
- 2023Traj-MAE: Masked Autoencoders for Trajectory Predictioncited by 42
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
50 most cited of 345 All 345 (JSON)
- 2026Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generation6 Sep 2026
- 2026Active Client Selection in Federated Trajectory Prediction with Uncertainty-Awareness and Heterogeneous Complexity27 Aug 2026
- 2026Pivot-Centric Trajectory Prediction: Bridging Long Horizons via Dynamical Guidance4 Aug 2026
- 2026NaviAIS: A Scenario-Level Vessel Trajectory Prediction Dataset withVectorized Lane Priors and the NaviLane Forecasting Framework21 Jul 2026
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026IMR: Iterative Mode-World Weighted Regression for Multi-Agent Trajectory Prediction6 Jul 2026
- 2026SD-RouteFusion: Ego-Trajectory Prediction with SD-Map Route Conditioning1 Jul 2026
- 2026LAMP: Lane-Aligned Motion Primitives for Feasible Trajectory Prediction25 Jun 2026
- 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning23 Jun 2026
- 2026Bridging Predictive Uncertainty and Safe Action: Sample-Conditioned Differentiable Planning for Autonomous Driving2 Jun 2026
- 2026From Cues to Horizons: Dynamic Risk Horizon Profiling for Trajectory Prediction30 May 2026
- 2026DriveAnchor: Progressive Anchor-based Flow Learning for Autonomous Driving Planning30 May 2026
38 more
- 2026BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices28 May 2026
- 2026RECTOR: Priority-Aware Rule-Based Reranking for Compliance-Aware Autonomous Driving Trajectory Selection24 May 2026
- 2026Mode-as-Sequence: Translating Multimodal Motion Prediction into Unified Sequential Mode Modeling21 May 2026
- 2026RLFTSim: Realistic and Controllable Multi-Agent Traffic Simulation via Reinforcement Learning Fine-Tuning18 May 2026
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modeling11 May 2026
- 2026Recall to Predict: Grounding Motion Forecasting in Interpretable Motion Bank2 May 2026
- 2026EdgeVTP: Exploration of Latency-efficient Trajectory Prediction for Edge-based Embedded Vision Applications18 Apr 2026
- 2026Artificial Intelligence for Modeling and Simulation of Mixed Automated and Human Traffic14 Apr 2026
- 2026Envisioning the Future, One Step at a Time10 Apr 2026
- 2026Online Intention Prediction via Control-Informed Learning10 Apr 2026
- 2026Uncertainty-Aware Trajectory Prediction: A Unified Framework Harnessing Positional and Semantic Uncertainties31 Mar 2026
- 2026PanguMotion: Continuous Driving Motion Forecasting with Pangu Transformers17 Mar 2026
- 2026Recover to Predict: Progressive Retrospective Learning for Variable-Length Trajectory Prediction11 Mar 2026
- 2026TaPD: Temporal-adaptive Progressive Distillation for Observation-Adaptive Trajectory Forecasting in Autonomous Driving6 Mar 2026
- 2026PlanTRansformer: Unified Prediction and Planning with Goal-conditioned Transformer3 Feb 2026
- 2026HERMES: A Holistic End-to-End Risk-Aware Multimodal Embodied System with Vision-Language Models for Long-Tail Autonomous Driving1 Feb 2026
- 2026Towards Efficient 3D Object Detection for Vehicle-Infrastructure Collaboration via Risk-Intent Selection6 Jan 2026
- 2025Beyond Endpoints: Path-Centric Reasoning for Vectorized Off-Road Network Extraction11 Dec 2025
- 2025V2X-RECT: An Efficient V2X Trajectory Prediction Framework via Redundant Interaction Filtering and Tracking Error Correction22 Nov 2025
- 2025Lane-Frame Quantum Multimodal Driving Forecasts for the Trajectory of Autonomous Vehicles21 Nov 2025
- 2025SOTFormer: A Minimal Transformer for Unified Object Tracking and Trajectory Prediction14 Nov 2025
- 2025Reverberation: Learning the Latencies Before Forecasting Trajectories14 Nov 2025
- 2025Controllable Collision Scenario Generation via Collision Pattern Prediction14 Oct 2025
- 2025VFSI: Validity First Spatial Intelligence for Constraint-Guided Traffic Diffusion28 Sep 2025
- 2025CoPAD : Multi-source Trajectory Fusion and Cooperative Trajectory Prediction with Anchor-oriented Decoder in V2X Scenarios19 Sep 2025
- 2025KoopCast: Trajectory Forecasting via Koopman Operators19 Sep 2025
- 2025Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Driving16 Sep 2025
- 2025Beyond Frame-wise Tracking: A Trajectory-based Paradigm for Efficient Point Cloud Tracking14 Sep 2025
- 2025BEVTraj: Map-Free End-to-End Trajectory Prediction in Bird's-Eye View with Deformable Attention and Sparse Goal Proposals12 Sep 2025
- 2025Adaptive Output Steps: FlexiSteps Network for Dynamic Trajectory Prediction25 Aug 2025
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Prediction10 Aug 2025
- 2025Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Prediction6 Aug 2025
- 2025MambaMap: Online Vectorized HD Map Construction using State Space Model27 Jul 2025
- 2025Moving Out: Physically-grounded Human-AI Collaboration24 Jul 2025
- 2025Delving into Mapping Uncertainty for Mapless Trajectory Prediction24 Jul 2025
- 2025Goal-based Trajectory Prediction for improved Cross-Dataset Generalization24 Jul 2025
- 2025STRAP: Spatial-Temporal Risk-Attentive Vehicle Trajectory Prediction for Autonomous Driving11 Jul 2025
- 2025ILNet: Trajectory Prediction with Inverse Learning Attention for Enhancing Intention Capture9 Jul 2025
50 newest of 345 All 345 (JSON)
- 2022Model-Based Imitation Learning for Urban Drivingcited by 149
- 2022Learning from All Vehiclescited by 135
- 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
- 2021SafetyNet: Safe planning for real-world self-driving vehicles using machine-learned policiescited by 68
- 2023FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Drivingcited by 67
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Drivingcited by 46
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40
- 2022TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Drivingcited by 23
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2022Long-Tail Prediction Uncertainty Aware Trajectory Planning for Self-driving Vehiclescited by 22
- 2024Generalizing Motion Planners with Mixture of Experts for Autonomous Drivingcited by 22
- 2025Learning Personalized Driving Styles via Reinforcement Learning from Human Feedbackcited by 16
12 most cited of 34 All 34 (JSON)
- 2026Bridging Predictive Uncertainty and Safe Action: Sample-Conditioned Differentiable Planning for Autonomous Driving2 Jun 2026
- 2026PanguMotion: Continuous Driving Motion Forecasting with Pangu Transformers17 Mar 2026
- 2025Goal-conditioned Hierarchical Reinforcement Learning for Sample-efficient and Safe Autonomous Driving at Intersections19 Jun 2025
- 2025CooperRisk: A Driving Risk Quantification Pipeline with Multi-Agent Cooperative Perception and Prediction18 Jun 2025
- 2025Learning Through Retrospection: Improving Trajectory Prediction for Automated Driving with Error Feedback18 Apr 2025
- 2025Data Scaling Laws for End-to-End Autonomous Driving6 Apr 2025
- 2025Learning Personalized Driving Styles via Reinforcement Learning from Human Feedback13 Mar 2025
- 2025CAPS: Context-Aware Priority Sampling for Enhanced Imitation Learning in Autonomous Driving3 Mar 2025
- 2024LHPF: Look back the History and Plan for the Future in Autonomous Driving26 Nov 2024
- 2024PlanScope: Learning to Plan Within Decision Scope for Urban Autonomous Driving1 Nov 2024
- 2024Generalizing Motion Planners with Mixture of Experts for Autonomous Driving21 Oct 2024
- 2024Conformal Trajectory Prediction with Multi-View Data Integration in Cooperative Driving1 Aug 2024
12 newest of 34 All 34 (JSON)
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
- 2023DICE: Diverse Diffusion Model with Scoring for Trajectory Predictioncited by 18
- 2024Optimizing Diffusion Models for Joint Trajectory Prediction and Controllable Generationcited by 18
- 2023A Diffusion-Model of Joint Interactive Navigationcited by 16
- 2024Intention-aware Denoising Diffusion Model for Trajectory Predictioncited by 11
- 2024ComDrive: Comfort-Oriented End-to-End Autonomous Drivingcited by 11
- 2025TrajFlow: Multi-modal Motion Prediction via Flow Matchingcited by 7
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modelingcited by 3
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Predictioncited by 2
- 2025Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Predictioncited by 1
- 2025VFSI: Validity First Spatial Intelligence for Constraint-Guided Traffic Diffusioncited by 1
- 2026DriveAnchor: Progressive Anchor-based Flow Learning for Autonomous Driving Planningcited by 1
12 most cited of 13 All 13 (JSON)
- 2026DriveAnchor: Progressive Anchor-based Flow Learning for Autonomous Driving Planning30 May 2026
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modeling11 May 2026
- 2025VFSI: Validity First Spatial Intelligence for Constraint-Guided Traffic Diffusion28 Sep 2025
- 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Prediction10 Aug 2025
- 2025Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Prediction6 Aug 2025
- 2025TrajFlow: Multi-modal Motion Prediction via Flow Matching10 Jun 2025
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictions18 May 2025
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Driving7 Mar 2025
- 2024ComDrive: Comfort-Oriented End-to-End Autonomous Driving7 Oct 2024
- 2024Optimizing Diffusion Models for Joint Trajectory Prediction and Controllable Generation1 Aug 2024
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction14 Mar 2024
- 2023DICE: Diverse Diffusion Model with Scoring for Trajectory Prediction23 Oct 2023
12 newest of 13 All 13 (JSON)
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
- 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
- 2023TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Predictioncited by 56
- 2023Real-Time Motion Prediction via Heterogeneous Polyline Transformer with Relative Pose Encodingcited by 32
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectivescited by 5
- 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planningcited by 4
- 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning23 Jun 2026
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectives14 May 2025
- 2023Real-Time Motion Prediction via Heterogeneous Polyline Transformer with Relative Pose Encoding19 Oct 2023
- 2023TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Prediction7 Mar 2023
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinement27 Sep 2022
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networks12 Jul 2022
- 2021Scene Transformer: A unified architecture for predicting multiple agent trajectories15 Jun 2021
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2022Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformercited by 211
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
- 2022BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Drivingcited by 191
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
- 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
12 most cited of 284 All 284 (JSON)
- 2026Collision Snapshot Guided Time-Reversed Safety-Critical Scenario Generation6 Sep 2026
- 2026Active Client Selection in Federated Trajectory Prediction with Uncertainty-Awareness and Heterogeneous Complexity27 Aug 2026
- 2026Pivot-Centric Trajectory Prediction: Bridging Long Horizons via Dynamical Guidance4 Aug 2026
- 2026NaviAIS: A Scenario-Level Vessel Trajectory Prediction Dataset withVectorized Lane Priors and the NaviLane Forecasting Framework21 Jul 2026
- 2026TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction11 Jul 2026
- 2026IMR: Iterative Mode-World Weighted Regression for Multi-Agent Trajectory Prediction6 Jul 2026
- 2026SD-RouteFusion: Ego-Trajectory Prediction with SD-Map Route Conditioning1 Jul 2026
- 2026LAMP: Lane-Aligned Motion Primitives for Feasible Trajectory Prediction25 Jun 2026
- 2026From Cues to Horizons: Dynamic Risk Horizon Profiling for Trajectory Prediction30 May 2026
- 2026BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices28 May 2026
- 2026RECTOR: Priority-Aware Rule-Based Reranking for Compliance-Aware Autonomous Driving Trajectory Selection24 May 2026
- 2026Mode-as-Sequence: Translating Multimodal Motion Prediction into Unified Sequential Mode Modeling21 May 2026
12 newest of 284 All 284 (JSON)