HYPER: Learned Hybrid Trajectory Prediction via Factored Inference and Adaptive Sampling
Not on the map. Why?
Abstract (arXiv)
Modeling multi-modal high-level intent is important for ensuring diversity in trajectory prediction. Existing approaches explore the discrete nature of human intent before predicting continuous trajectories, to improve accuracy and support explainability. However, these approaches often assume the intent to remain fixed over the prediction horizon, which is problematic in practice, especially over longer horizons. To overcome this limitation, we introduce HYPER, a general and expressive hybrid prediction framework that models evolving human intent. By modeling traffic agents as a hybrid discrete-continuous system, our approach is capable of predicting discrete intent changes over time. We learn the probabilistic hybrid model via a maximum likelihood estimation problem and leverage neural proposal distributions to sample adaptively from the exponentially growing discrete space. The overall approach affords a better trade-off between accuracy and coverage. We train and validate our model on the Argoverse dataset, and demonstrate its effectiveness through comprehensive ablation studies and comparisons with state-of-the-art models.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 36 of its 61 references that are in the map. First posted on arXiv 5 Oct 2021.
Builds on
36 of 61 references.
References · 36
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
24 more
- 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
- 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 166
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
- 2017Variational Sequential Monte Carlocited by 93
- 2019Diverse Trajectory Forecasting with Determinantal Point Processescited by 80
- 2018Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMscited by 77
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agentscited by 64
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2020Trajectron++: Dynamically-Feasible Trajectory Forecasting With Heterogeneous Datacited by 58
- 2018Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecturecited by 55
- 2021Interpretable Social Anchors for Human Trajectory Forecasting in Crowdscited by 44
- 2019DiversityGAN: Diversity-Aware Vehicle Motion Prediction via Latent Semantic Samplingcited by 40
- 2019Maximum Entropy-Regularized Multi-Goal Reinforcement Learningcited by 39
- 2021Divide-and-Conquer for Lane-Aware Diverse Trajectory Predictioncited by 37
- 2015Neural Adaptive Sequential Monte Carlocited by 34
- 2019Analyzing the Variety Loss in the Context of Probabilistic Trajectory Predictioncited by 30
- 2020Map-Adaptive Goal-Based Trajectory Predictioncited by 29
- 2020Goal-driven Long-Term Trajectory Predictioncited by 24
- 2019Generative Hybrid Representations for Activity Forecasting with No-Regret Learningcited by 18
- 2019Switching Linear Dynamics for Variational Bayes Filteringcited by 17
- 2020Fast Risk Assessment for Autonomous Vehicles Using Learned Models of Agent Futurescited by 9
- 2013A General Algorithm for Approximate Inference and its Application to Hybrid Bayes Netscited by 3
- 2021Maneuver-based Anchor Trajectory Hypotheses at Roundaboutscited by 1
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 2; 2024: 2; 2025: 1.
12 papers.
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2024DriveGPT: Scaling Autoregressive Behavior Models for Drivingcited by 29
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2021Trajectory Prediction with Linguistic Representationscited by 13
- 2022Concept Graph Neural Networks for Surgical Video Understandingcited by 13
- 2022MPA: MultiPath++ Based Architecture for Motion Predictioncited by 13
- 2021TIP: Task-Informed Motion Prediction for Intelligent Vehiclescited by 8
- 2023Bridging the Gap Between Multi-Step and One-Shot Trajectory Prediction via Self-Supervisioncited by 7
- 2022VectorFlow: Combining Images and Vectors for Traffic Occupancy and Flow Predictioncited by 6
- 2022Benchmark for Models Predicting Human Behavior in Gap Acceptance Scenarioscited by 5
- 2024Blending Data-Driven Priors in Dynamic Gamescited by 5
- 2023NashFormer: Leveraging Local Nash Equilibria for Semantically Diverse Trajectory Predictioncited by 0
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2024DriveGPT: Scaling Autoregressive Behavior Models for Driving19 Dec 2024
- 2024Blending Data-Driven Priors in Dynamic Games21 Feb 2024
- 2023Bridging the Gap Between Multi-Step and One-Shot Trajectory Prediction via Self-Supervision6 Jun 2023
- 2023NashFormer: Leveraging Local Nash Equilibria for Semantically Diverse Trajectory Prediction28 May 2023
- 2022Benchmark for Models Predicting Human Behavior in Gap Acceptance Scenarios10 Nov 2022
- 2022VectorFlow: Combining Images and Vectors for Traffic Occupancy and Flow Prediction9 Aug 2022
- 2022MPA: MultiPath++ Based Architecture for Motion Prediction20 Jun 2022
- 2022Concept Graph Neural Networks for Surgical Video Understanding27 Feb 2022
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Prediction24 Feb 2022
- 2021Trajectory Prediction with Linguistic Representations19 Oct 2021
- 2021TIP: Task-Informed Motion Prediction for Intelligent Vehicles17 Oct 2021