mlsanityData to 7 Oct 2026

KoopCast: Trajectory Forecasting via Koopman Operators

arXiv 2509.15513 ↗First posted 19 Sep 2025cs.LG cs.RO cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

We present KoopCast, a lightweight yet efficient model for trajectory forecasting in general dynamic environments. Our approach leverages Koopman operator theory, which enables a linear representation of nonlinear dynamics by lifting trajectories into a higher-dimensional space. The framework follows a two-stage design: first, a probabilistic neural goal estimator predicts plausible long-term targets, specifying where to go; second, a Koopman operator-based refinement module incorporates intention and history into a nonlinear feature space, enabling linear prediction that dictates how to go. This dual structure not only ensures strong predictive accuracy but also inherits the favorable properties of linear operators while faithfully capturing nonlinear dynamics. As a result, our model offers three key advantages: (i) competitive accuracy, (ii) interpretability grounded in Koopman spectral theory, and (iii) low-latency deployment. We validate these benefits on ETH/UCY, the Waymo Open Motion Dataset, and nuScenes, which feature rich multi-agent interactions and map-constrained nonlinear motion. Across benchmarks, KoopCast consistently delivers high predictive accuracy together with mode-level interpretability and practical efficiency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 52 of its 74 references that are in the map. First posted on arXiv 19 Sep 2025.

Builds on

52 of 74 references.

References · 52

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  4. 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
  5. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
  6. 2020TNT: Target-driveN Trajectory Predictioncited by 345
  7. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
  8. 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
  9. 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
  10. 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
  11. 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
  12. 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
38 more
  1. 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
  2. 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
  3. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  4. 2020Transformer Networks for Trajectory Forecastingcited by 180
  5. 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
  6. 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
  7. 2016Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive controlcited by 134
  8. 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
  9. 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
  10. 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 99
  11. 2018Uncertainty-aware Short-term Motion Prediction of Traffic Actors for Autonomous Drivingcited by 90
  12. 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
  13. 2018An LSTM Network for Highway Trajectory Predictioncited by 81
  14. 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
  15. 2019Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANscited by 78
  16. 2020Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Planscited by 72
  17. 2017On Convergence of Extended Dynamic Mode Decomposition to the Koopman Operatorcited by 70
  18. 2020MANTRA: Memory Augmented Networks for Multiple Trajectory Predictioncited by 69
  19. 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 65
  20. 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
  21. 2020Collaborative Motion Prediction via Neural Motion Message Passingcited by 55
  22. 2020BiTraP: Bi-directional Pedestrian Trajectory Prediction with Multi-modal Goal Estimationcited by 47
  23. 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
  24. 2018Optimal construction of Koopman eigenfunctions for prediction and controlcited by 34
  25. 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Modelscited by 27
  26. 2020Deep Learning of Koopman Representation for Controlcited by 25
  27. 2018Scene-LSTM: A Model for Human Trajectory Predictioncited by 24
  28. 2024LG-Traj: LLM Guided Pedestrian Trajectory Predictioncited by 24
  29. 2022MotionCNN: A Strong Baseline for Motion Prediction in Autonomous Drivingcited by 21
  30. 2022MTR-A: 1st Place Solution for 2022 Waymo Open Dataset Challenge -- Motion Predictioncited by 17
  31. 2023Uncertainty-Aware Pedestrian Trajectory Prediction via Distributional Diffusioncited by 13
  32. 2024Koopman Operators in Robot Learningcited by 13
  33. 2020Derivative-Based Koopman Operators for Real-Time Control of Robotic Systemscited by 12
  34. 2023Context-Aware Timewise VAEs for Real-Time Vehicle Trajectory Predictioncited by 12
  35. 2022Neural Koopman Lyapunov Controlcited by 11
  36. 2023Vehicular Applications of Koopman Operator Theory -- A Surveycited by 5
  37. 2024CCF: Cross Correcting Framework for Pedestrian Trajectory Predictioncited by 2
  38. 2025TrajFusionNet: Pedestrian Crossing Intention Prediction via Fusion of Sequential and Visual Trajectory Representationscited by 2

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.