MATS: An Interpretable Trajectory Forecasting Representation for Planning and Control
Not on the map. Why?
Abstract (arXiv)
Reasoning about human motion is a core component of modern human-robot interactive systems. In particular, one of the main uses of behavior prediction in autonomous systems is to inform robot motion planning and control. However, a majority of planning and control algorithms reason about system dynamics rather than the predicted agent tracklets (i.e., ordered sets of waypoints) that are commonly output by trajectory forecasting methods, which can hinder their integration. Towards this end, we propose Mixtures of Affine Time-varying Systems (MATS) as an output representation for trajectory forecasting that is more amenable to downstream planning and control use. Our approach leverages successful ideas from probabilistic trajectory forecasting works to learn dynamical system representations that are well-studied in the planning and control literature. We integrate our predictions with a proposed multimodal planning methodology and demonstrate significant computational efficiency improvements on a large-scale autonomous driving dataset.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 9; 2023: 7; 2024: 5; 2025: 2; 2026: 1.
30 papers.
Sort:
By area:
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2022Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Drivingcited by 71
- 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 63
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Drivingcited by 46
- 2024Gen-Drive: Enhancing Diffusion Generative Driving Policies with Reward Modeling and Reinforcement Learning Fine-tuningcited by 41
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehiclescited by 36
- 2023Dynamic-Resolution Model Learning for Object Pile Manipulationcited by 22
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluationcited by 21
- 2021Heterogeneous-Agent Trajectory Forecasting Incorporating Class Uncertaintycited by 19
- 2023Scene Informer: Anchor-based Occlusion Inference and Trajectory Prediction in Partially Observable Environmentscited by 14
18 more
- 2023Interactive Joint Planning for Autonomous Vehiclescited by 13
- 2022RAP: Risk-Aware Prediction for Robust Planningcited by 12
- 2021Rethinking Trajectory Forecasting Evaluationcited by 11
- 2022Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehiclescited by 11
- 2025SICNav-Diffusion: Safe and Interactive Crowd Navigation with Diffusion Trajectory Predictionscited by 10
- 2021Learning Interaction-aware Guidance Policies for Motion Planning in Dense Traffic Scenarioscited by 7
- 2023DRL-Based Trajectory Tracking for Motion-Related Modules in Autonomous Drivingcited by 6
- 2024Hypergraph-Transformer (HGT) for Interactive Event Prediction in Laparoscopic and Robotic Surgerycited by 5
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectivescited by 5
- 2022LOPR: Latent Occupancy PRediction using Generative Modelscited by 4
- 2024CARFF: Conditional Auto-encoded Radiance Field for 3D Scene Forecastingcited by 4
- 2024Prediction Horizon Requirements for Automated Driving: Optimizing Safety, Comfort, and Efficiencycited by 3
- 2022P4P: Conflict-Aware Motion Prediction for Planning in Autonomous Drivingcited by 1
- 2022Interpretable Deep Trackingcited by 0
- 2023CLiNet: Joint Detection of Road Network Centerlines in 2D and 3Dcited by 0
- 2023Occlusion-Aware 2D and 3D Centerline Detection for Urban Driving via Automatic Label Generationcited by 0
- 2024Scalable Multi-modal Model Predictive Control via Duality-based Interaction Predictionscited by 0
- 2026TRACER: Training-Free Closed-Loop Structured Inference for Traffic Accident Reconstructioncited by 0
- 2026TRACER: Training-Free Closed-Loop Structured Inference for Traffic Accident Reconstruction23 Jun 2026
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectives14 May 2025
- 2025SICNav-Diffusion: Safe and Interactive Crowd Navigation with Diffusion Trajectory Predictions11 Mar 2025
- 2024Gen-Drive: Enhancing Diffusion Generative Driving Policies with Reward Modeling and Reinforcement Learning Fine-tuning8 Oct 2024
- 2024Prediction Horizon Requirements for Automated Driving: Optimizing Safety, Comfort, and Efficiency6 Feb 2024
- 2024Hypergraph-Transformer (HGT) for Interactive Event Prediction in Laparoscopic and Robotic Surgery3 Feb 2024
- 2024Scalable Multi-modal Model Predictive Control via Duality-based Interaction Predictions2 Feb 2024
- 2024CARFF: Conditional Auto-encoded Radiance Field for 3D Scene Forecasting31 Jan 2024
- 2023Occlusion-Aware 2D and 3D Centerline Detection for Urban Driving via Automatic Label Generation3 Nov 2023
- 2023Interactive Joint Planning for Autonomous Vehicles27 Oct 2023
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Driving9 Oct 2023
- 2023Scene Informer: Anchor-based Occlusion Inference and Trajectory Prediction in Partially Observable Environments25 Sep 2023
18 more
- 2023DRL-Based Trajectory Tracking for Motion-Related Modules in Autonomous Driving30 Aug 2023
- 2023Dynamic-Resolution Model Learning for Object Pile Manipulation29 Jun 2023
- 2023CLiNet: Joint Detection of Road Network Centerlines in 2D and 3D4 Feb 2023
- 2022Planning-oriented Autonomous Driving20 Dec 2022
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehicles13 Dec 2022
- 2022P4P: Conflict-Aware Motion Prediction for Planning in Autonomous Driving3 Nov 2022
- 2022RAP: Risk-Aware Prediction for Robust Planning4 Oct 2022
- 2022Interpretable Deep Tracking3 Oct 2022
- 2022LOPR: Latent Occupancy PRediction using Generative Models3 Oct 2022
- 2022Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehicles25 Jul 2022
- 2022Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Driving21 Jul 2022
- 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planning18 Jun 2022
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Sampling13 Oct 2021
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluation7 Oct 2021
- 2021Rethinking Trajectory Forecasting Evaluation21 Jul 2021
- 2021Learning Interaction-aware Guidance Policies for Motion Planning in Dense Traffic Scenarios9 Jul 2021
- 2021Heterogeneous-Agent Trajectory Forecasting Incorporating Class Uncertainty26 Apr 2021
- 2021Stepwise Goal-Driven Networks for Trajectory Prediction25 Mar 2021
- 2022Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Drivingcited by 71
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Drivingcited by 46
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehiclescited by 36
- 2023Interactive Joint Planning for Autonomous Vehiclescited by 13
- 2022Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehiclescited by 11
- 2023DRL-Based Trajectory Tracking for Motion-Related Modules in Autonomous Drivingcited by 6
- 2024Prediction Horizon Requirements for Automated Driving: Optimizing Safety, Comfort, and Efficiencycited by 3
- 2022P4P: Conflict-Aware Motion Prediction for Planning in Autonomous Drivingcited by 1
- 2024Prediction Horizon Requirements for Automated Driving: Optimizing Safety, Comfort, and Efficiency6 Feb 2024
- 2023Interactive Joint Planning for Autonomous Vehicles27 Oct 2023
- 2023DTPP: Differentiable Joint Conditional Prediction and Cost Evaluation for Tree Policy Planning in Autonomous Driving9 Oct 2023
- 2023DRL-Based Trajectory Tracking for Motion-Related Modules in Autonomous Driving30 Aug 2023
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehicles13 Dec 2022
- 2022P4P: Conflict-Aware Motion Prediction for Planning in Autonomous Driving3 Nov 2022
- 2022Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehicles25 Jul 2022
- 2022Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Driving21 Jul 2022
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2022ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planningcited by 63
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2023Dynamic-Resolution Model Learning for Object Pile Manipulationcited by 22
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluationcited by 21
- 2021Heterogeneous-Agent Trajectory Forecasting Incorporating Class Uncertaintycited by 19
- 2023Scene Informer: Anchor-based Occlusion Inference and Trajectory Prediction in Partially Observable Environmentscited by 14
- 2022RAP: Risk-Aware Prediction for Robust Planningcited by 12
- 2021Rethinking Trajectory Forecasting Evaluationcited by 11
- 2021Learning Interaction-aware Guidance Policies for Motion Planning in Dense Traffic Scenarioscited by 7
- 2024Hypergraph-Transformer (HGT) for Interactive Event Prediction in Laparoscopic and Robotic Surgerycited by 5
12 most cited of 19 All 19 (JSON)
- 2026TRACER: Training-Free Closed-Loop Structured Inference for Traffic Accident Reconstruction23 Jun 2026
- 2024Hypergraph-Transformer (HGT) for Interactive Event Prediction in Laparoscopic and Robotic Surgery3 Feb 2024
- 2024Scalable Multi-modal Model Predictive Control via Duality-based Interaction Predictions2 Feb 2024
- 2024CARFF: Conditional Auto-encoded Radiance Field for 3D Scene Forecasting31 Jan 2024
- 2023Occlusion-Aware 2D and 3D Centerline Detection for Urban Driving via Automatic Label Generation3 Nov 2023
- 2023Scene Informer: Anchor-based Occlusion Inference and Trajectory Prediction in Partially Observable Environments25 Sep 2023
- 2023Dynamic-Resolution Model Learning for Object Pile Manipulation29 Jun 2023
- 2023CLiNet: Joint Detection of Road Network Centerlines in 2D and 3D4 Feb 2023
- 2022Planning-oriented Autonomous Driving20 Dec 2022
- 2022RAP: Risk-Aware Prediction for Robust Planning4 Oct 2022
- 2022Interpretable Deep Tracking3 Oct 2022
- 2022LOPR: Latent Occupancy PRediction using Generative Models3 Oct 2022
12 newest of 19 All 19 (JSON)