FEND: A Future Enhanced Distribution-Aware Contrastive Learning Framework for Long-tail Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
Predicting the future trajectories of the traffic agents is a gordian technique in autonomous driving. However, trajectory prediction suffers from data imbalance in the prevalent datasets, and the tailed data is often more complicated and safety-critical. In this paper, we focus on dealing with the long-tail phenomenon in trajectory prediction. Previous methods dealing with long-tail data did not take into account the variety of motion patterns in the tailed data. In this paper, we put forward a future enhanced contrastive learning framework to recognize tail trajectory patterns and form a feature space with separate pattern clusters. Furthermore, a distribution aware hyper predictor is brought up to better utilize the shaped feature space. Our method is a model-agnostic framework and can be plugged into many well-known baselines. Experimental results show that our framework outperforms the state-of-the-art long-tail prediction method on tailed samples by 9.5% on ADE and 8.5% on FDE, while maintaining or slightly improving the averaged performance. Our method also surpasses many long-tail techniques on trajectory prediction task.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 39 of its 51 references that are in the map. First posted on arXiv 29 Mar 2023.
Builds on
39 of 51 references.
References · 39
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2020Supervised Contrastive Learningcited by 2,803
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,239
- 2016HyperNetworkscited by 1,003
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 987
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
- 2020Long-tail learning via logit adjustmentcited by 605
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
- 2020Hard Negative Mixing for Contrastive Learningcited by 399
27 more
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 166
- 2021Delving into Deep Imbalanced Regressioncited by 157
- 2021Targeted Supervised Contrastive Learning for Long-Tailed Recognitioncited by 132
- 2020Human Trajectory Forecasting in Crowds: A Deep Learning Perspectivecited by 128
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2015Relay Backpropagation for Effective Learning of Deep Convolutional Neural Networkscited by 115
- 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
- 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2021Distributional Robustness Loss for Long-tail Learningcited by 84
- 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
- 2022MUSE-VAE: Multi-Scale VAE for Environment-Aware Long Term Trajectory Predictioncited by 59
- 2020Social NCE: Contrastive Learning of Socially-aware Motion Representationscited by 58
- 2018Accurate and Diverse Sampling of Sequences based on a "Best of Many" Sample Objectivecited by 56
- 2021On Exposing the Challenging Long Tail in Future Prediction of Traffic Actorscited by 48
- 2021Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesiscited by 46
- 2021Divide-and-Conquer for Lane-Aware Diverse Trajectory Predictioncited by 37
- 2018PORCA: Modeling and Planning for Autonomous Driving among Many Pedestrianscited by 36
- 2021Personalized Trajectory Prediction via Distribution Discriminationcited by 30
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluationcited by 21
- 2022Action-based Contrastive Learning for Trajectory Predictioncited by 15
Built on by
Citing papers per year: 2023: 2; 2024: 13; 2025: 11; 2026: 5.
31 papers.
Sort:
By area:
- 2024PLUTO: Pushing the Limit of Imitation Learning-based Planning for Autonomous Drivingcited by 84
- 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Predictioncited by 51
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2024On the Role of Long-tail Knowledge in Retrieval Augmented Large Language Modelscited by 10
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Predictioncited by 9
- 2024Recurrent Aligned Network for Generalized Pedestrian Trajectory Predictioncited by 8
- 2025Motion Forecasting for Autonomous Vehicles: A Surveycited by 8
- 2024TrACT: A Training Dynamics Aware Contrastive Learning Framework for Long-tail Trajectory Predictioncited by 7
- 2025Continuous Locomotive Crowd Behavior Generationcited by 7
- 2024Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Networkcited by 6
- 2025Generative Active Learning for Long-tail Trajectory Prediction via Controllable Diffusion Modelcited by 6
19 more
- 2024AMEND: A Mixture of Experts Framework for Long-tailed Trajectory Predictioncited by 4
- 2025RIFT: Group-Relative RL Fine-Tuning for Realistic and Controllable Traffic Simulationcited by 4
- 2025AMD: Adaptive Momentum and Decoupled Contrastive Learning Framework for Robust Long-Tail Trajectory Predictioncited by 4
- 2023Enhancing Mapless Trajectory Prediction through Knowledge Distillationcited by 3
- 2024Den-TP: A Density-Balanced Data Curation and Evaluation Framework for Trajectory Predictioncited by 3
- 2024MetaTra: Meta-Learning for Generalized Trajectory Prediction in Unseen Domaincited by 2
- 2023Enhancing Trajectory Prediction through Self-Supervised Waypoint Noise Predictioncited by 1
- 2024Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encodingcited by 1
- 2025Risk-Informed Diffusion Transformer for Long-Tail Trajectory Prediction in the Crash Scenariocited by 1
- 2025Addressing Corner Cases in Autonomous Driving: A World Model-based Approach with Mixture of Experts and LLMscited by 1
- 2024C2INet: Realizing Incremental Trajectory Prediction with Prior-Aware Continual Causal Interventioncited by 0
- 2025Ensemble of Pre-Trained Models for Long-Tailed Trajectory Predictioncited by 0
- 2025AdaSports-Traj: Role- and Domain-Aware Adaptation for Multi-Agent Trajectory Modeling in Sportscited by 0
- 2025A Trajectory Generator for High-Density Traffic and Diverse Agent-Interaction Scenarioscited by 0
- 2026MetaDAT: Generalizable Trajectory Prediction via Meta Pre-training and Data-Adaptive Test-Time Updatingcited by 0
- 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehiclescited by 0
- 2026JACoP: Joint Alignment for Compliant Multi-Agent Predictioncited by 0
- 2026Driving, Fast or Slow? Neuro-Symbolic Guidance for Motion Prediction in Multi-Modal Ground Mobilitycited by 0
- 2026Schr"odinger's Cat: Probabilistic Representation and Prediction of Potential Scene Kinematicscited by 0
- 2026Schr"odinger's Cat: Probabilistic Representation and Prediction of Potential Scene Kinematics28 Jul 2026
- 2026Driving, Fast or Slow? Neuro-Symbolic Guidance for Motion Prediction in Multi-Modal Ground Mobility13 Jun 2026
- 2026JACoP: Joint Alignment for Compliant Multi-Agent Prediction12 May 2026
- 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehicles6 Apr 2026
- 2026MetaDAT: Generalizable Trajectory Prediction via Meta Pre-training and Data-Adaptive Test-Time Updating10 Mar 2026
- 2025Addressing Corner Cases in Autonomous Driving: A World Model-based Approach with Mixture of Experts and LLMs23 Oct 2025
- 2025A Trajectory Generator for High-Density Traffic and Diverse Agent-Interaction Scenarios3 Oct 2025
- 2025AdaSports-Traj: Role- and Domain-Aware Adaptation for Multi-Agent Trajectory Modeling in Sports19 Sep 2025
- 2025Ensemble of Pre-Trained Models for Long-Tailed Trajectory Prediction17 Sep 2025
- 2025Generative Active Learning for Long-tail Trajectory Prediction via Controllable Diffusion Model30 Jul 2025
- 2025AMD: Adaptive Momentum and Decoupled Contrastive Learning Framework for Robust Long-Tail Trajectory Prediction2 Jul 2025
- 2025RIFT: Group-Relative RL Fine-Tuning for Realistic and Controllable Traffic Simulation6 May 2025
19 more
- 2025Continuous Locomotive Crowd Behavior Generation7 Apr 2025
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Prediction20 Feb 2025
- 2025Motion Forecasting for Autonomous Vehicles: A Survey10 Feb 2025
- 2025Risk-Informed Diffusion Transformer for Long-Tail Trajectory Prediction in the Crash Scenario18 Jan 2025
- 2024C2INet: Realizing Incremental Trajectory Prediction with Prior-Aware Continual Causal Intervention19 Nov 2024
- 2024Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encoding17 Nov 2024
- 2024Den-TP: A Density-Balanced Data Curation and Evaluation Framework for Trajectory Prediction25 Sep 2024
- 2024Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Network26 Jul 2024
- 2024On the Role of Long-tail Knowledge in Retrieval Augmented Large Language Models24 Jun 2024
- 2024PLUTO: Pushing the Limit of Imitation Learning-based Planning for Autonomous Driving22 Apr 2024
- 2024TrACT: A Training Dynamics Aware Contrastive Learning Framework for Long-tail Trajectory Prediction18 Apr 2024
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model27 Mar 2024
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Prediction27 Mar 2024
- 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Prediction22 Mar 2024
- 2024Recurrent Aligned Network for Generalized Pedestrian Trajectory Prediction9 Mar 2024
- 2024AMEND: A Mixture of Experts Framework for Long-tailed Trajectory Prediction13 Feb 2024
- 2024MetaTra: Meta-Learning for Generalized Trajectory Prediction in Unseen Domain13 Feb 2024
- 2023Enhancing Trajectory Prediction through Self-Supervised Waypoint Noise Prediction26 Nov 2023
- 2023Enhancing Mapless Trajectory Prediction through Knowledge Distillation25 Jun 2023
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2025Generative Active Learning for Long-tail Trajectory Prediction via Controllable Diffusion Modelcited by 6
- 2025Risk-Informed Diffusion Transformer for Long-Tail Trajectory Prediction in the Crash Scenariocited by 1
- 2025Generative Active Learning for Long-tail Trajectory Prediction via Controllable Diffusion Model30 Jul 2025
- 2025Risk-Informed Diffusion Transformer for Long-Tail Trajectory Prediction in the Crash Scenario18 Jan 2025
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model27 Mar 2024
- 2024UniTraj: A Unified Framework for Scalable Vehicle Trajectory Predictioncited by 51
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Predictioncited by 9
- 2024Recurrent Aligned Network for Generalized Pedestrian Trajectory Predictioncited by 8
- 2025Motion Forecasting for Autonomous Vehicles: A Surveycited by 8
- 2024TrACT: A Training Dynamics Aware Contrastive Learning Framework for Long-tail Trajectory Predictioncited by 7
- 2025Continuous Locomotive Crowd Behavior Generationcited by 7
- 2024Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Networkcited by 6
- 2025RIFT: Group-Relative RL Fine-Tuning for Realistic and Controllable Traffic Simulationcited by 4
- 2025AMD: Adaptive Momentum and Decoupled Contrastive Learning Framework for Robust Long-Tail Trajectory Predictioncited by 4
- 2023Enhancing Mapless Trajectory Prediction through Knowledge Distillationcited by 3
- 2024Den-TP: A Density-Balanced Data Curation and Evaluation Framework for Trajectory Predictioncited by 3
12 most cited of 24 All 24 (JSON)
- 2026Schr"odinger's Cat: Probabilistic Representation and Prediction of Potential Scene Kinematics28 Jul 2026
- 2026Driving, Fast or Slow? Neuro-Symbolic Guidance for Motion Prediction in Multi-Modal Ground Mobility13 Jun 2026
- 2026JACoP: Joint Alignment for Compliant Multi-Agent Prediction12 May 2026
- 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehicles6 Apr 2026
- 2026MetaDAT: Generalizable Trajectory Prediction via Meta Pre-training and Data-Adaptive Test-Time Updating10 Mar 2026
- 2025A Trajectory Generator for High-Density Traffic and Diverse Agent-Interaction Scenarios3 Oct 2025
- 2025AdaSports-Traj: Role- and Domain-Aware Adaptation for Multi-Agent Trajectory Modeling in Sports19 Sep 2025
- 2025Ensemble of Pre-Trained Models for Long-Tailed Trajectory Prediction17 Sep 2025
- 2025AMD: Adaptive Momentum and Decoupled Contrastive Learning Framework for Robust Long-Tail Trajectory Prediction2 Jul 2025
- 2025RIFT: Group-Relative RL Fine-Tuning for Realistic and Controllable Traffic Simulation6 May 2025
- 2025Continuous Locomotive Crowd Behavior Generation7 Apr 2025
- 2025BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Prediction20 Feb 2025
12 newest of 24 All 24 (JSON)