KoopCast: Trajectory Forecasting via Koopman Operators
Not on the map. Why?
Abstract (arXiv)
We present KoopCast, a lightweight yet efficient model for trajectory forecasting in general dynamic environments. Our approach leverages Koopman operator theory, which enables a linear representation of nonlinear dynamics by lifting trajectories into a higher-dimensional space. The framework follows a two-stage design: first, a probabilistic neural goal estimator predicts plausible long-term targets, specifying where to go; second, a Koopman operator-based refinement module incorporates intention and history into a nonlinear feature space, enabling linear prediction that dictates how to go. This dual structure not only ensures strong predictive accuracy but also inherits the favorable properties of linear operators while faithfully capturing nonlinear dynamics. As a result, our model offers three key advantages: (i) competitive accuracy, (ii) interpretability grounded in Koopman spectral theory, and (iii) low-latency deployment. We validate these benefits on ETH/UCY, the Waymo Open Motion Dataset, and nuScenes, which feature rich multi-agent interactions and map-constrained nonlinear motion. Across benchmarks, KoopCast consistently delivers high predictive accuracy together with mode-level interpretability and practical efficiency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 52 of its 74 references that are in the map. First posted on arXiv 19 Sep 2025.
Builds on
52 of 74 references.
References · 52
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
- 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
38 more
- 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2020Transformer Networks for Trajectory Forecastingcited by 180
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
- 2016Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive controlcited by 134
- 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
- 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 99
- 2018Uncertainty-aware Short-term Motion Prediction of Traffic Actors for Autonomous Drivingcited by 90
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2018An LSTM Network for Highway Trajectory Predictioncited by 81
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2019Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANscited by 78
- 2020Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Planscited by 72
- 2017On Convergence of Extended Dynamic Mode Decomposition to the Koopman Operatorcited by 70
- 2020MANTRA: Memory Augmented Networks for Multiple Trajectory Predictioncited by 69
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 65
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2020Collaborative Motion Prediction via Neural Motion Message Passingcited by 55
- 2020BiTraP: Bi-directional Pedestrian Trajectory Prediction with Multi-modal Goal Estimationcited by 47
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2018Optimal construction of Koopman eigenfunctions for prediction and controlcited by 34
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Modelscited by 27
- 2020Deep Learning of Koopman Representation for Controlcited by 25
- 2018Scene-LSTM: A Model for Human Trajectory Predictioncited by 24
- 2024LG-Traj: LLM Guided Pedestrian Trajectory Predictioncited by 24
- 2022MotionCNN: A Strong Baseline for Motion Prediction in Autonomous Drivingcited by 21
- 2022MTR-A: 1st Place Solution for 2022 Waymo Open Dataset Challenge -- Motion Predictioncited by 17
- 2023Uncertainty-Aware Pedestrian Trajectory Prediction via Distributional Diffusioncited by 13
- 2024Koopman Operators in Robot Learningcited by 13
- 2020Derivative-Based Koopman Operators for Real-Time Control of Robotic Systemscited by 12
- 2023Context-Aware Timewise VAEs for Real-Time Vehicle Trajectory Predictioncited by 12
- 2022Neural Koopman Lyapunov Controlcited by 11
- 2023Vehicular Applications of Koopman Operator Theory -- A Surveycited by 5
- 2024CCF: Cross Correcting Framework for Pedestrian Trajectory Predictioncited by 2
- 2025TrajFusionNet: Pedestrian Crossing Intention Prediction via Fusion of Sequential and Visual Trajectory Representationscited by 2
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.