mlsanityData to 7 Oct 2026

Future-Aware Interaction Network For Motion Forecasting

arXiv 2503.06565 ↗First posted 9 Mar 2025cs.CVcited by 4

On the map: State-space sequence models (S4, Mamba) → Video, motion and generative Mamba models

Abstract (arXiv)

Motion forecasting is a crucial component of autonomous driving systems, enabling the generation of accurate and smooth future trajectories to ensure safe navigation to the destination. In previous methods, potential future trajectories are often absent in the scene encoding stage, which may lead to suboptimal outcomes. Additionally, prior approaches typically employ transformer architectures for spatiotemporal modeling of trajectories and map information, which suffer from the quadratic scaling complexity of the transformer architecture. In this work, we propose an interaction-based method, named Future-Aware Interaction Network, that introduces potential future trajectories into scene encoding for a comprehensive traffic representation. Furthermore, a State Space Model (SSM), specifically Mamba, is introduced for both spatial and temporal modeling. To adapt Mamba for spatial interaction modeling, we propose an adaptive reordering strategy that transforms unordered data into a structured sequence. Additionally, Mamba is employed to refine generated future trajectories temporally, ensuring more consistent predictions. These enhancements not only improve model efficiency but also enhance the accuracy and diversity of predictions. We conduct comprehensive experiments on the widely used Argoverse 1 and Argoverse 2 datasets, demonstrating that the proposed method achieves superior performance compared to previous approaches in a more efficient way. The code will be released according to the acceptance.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Video, motion and generative Mamba models, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 55 of its 66 references that are in the map. First posted on arXiv 9 Mar 2025.

Builds on

55 of 66 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024VideoMamba: State Space Model for Efficient Video Understanding11 Mar
  2. 2024Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spaces1 Feb

Other references · 53

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  4. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  5. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  6. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  7. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
  8. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  9. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  10. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
  11. 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 495
  12. 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
38 more
  1. 2019MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentationcited by 370
  2. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 349
  3. 2020TNT: Target-driveN Trajectory Predictioncited by 345
  4. 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
  5. 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
  6. 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
  7. 2022Long Range Language Modeling via Gated State Spacescited by 265
  8. 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
  9. 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
  10. 2019PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settingscited by 178
  11. 2019Multiple Futures Predictioncited by 178
  12. 2021IntentNet: Learning to Predict Intention from Raw Sensor Datacited by 158
  13. 2021HOME: Heatmap Output for future Motion Estimationcited by 122
  14. 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
  15. 2021LaneRCNN: Distributed Representations for Graph-Centric Motion Forecastingcited by 112
  16. 2022HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encodingcited by 109
  17. 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
  18. 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
  19. 2018Uncertainty-aware Short-term Motion Prediction of Traffic Actors for Autonomous Drivingcited by 90
  20. 2019Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecastingcited by 87
  21. 2023Forecast-MAE: Self-supervised Pre-training for Motion Forecasting with Masked Autoencoderscited by 72
  22. 2020Diverse and Admissible Trajectory Forecasting through Multimodal Context Understandingcited by 68
  23. 2022GoRela: Go Relative for Viewpoint-Invariant Motion Forecastingcited by 68
  24. 2022GANet: Goal Area Network for Motion Forecastingcited by 49
  25. 2023ProphNet: Efficient Agent-Centric Motion Forecasting with Anchor-Informed Proposalscited by 47
  26. 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Predictioncited by 47
  27. 2020Multi-scale Interaction for Real-time LiDAR Data Segmentation on an Embedded Platformcited by 40
  28. 2023ADAPT: Efficient Multi-Agent Trajectory Prediction with Adaptationcited by 39
  29. 2023MacFormer: Map-Agent Coupled Transformer for Real-time and Robust Trajectory Predictioncited by 32
  30. 2022SSL-Lanes: Self-Supervised Learning for Motion Forecasting in Autonomous Drivingcited by 31
  31. 2023Dynamic Scenario Representation Learning for Motion Forecasting with Heterogeneous Graph Convolutional Recurrent Networkscited by 27
  32. 2024SIMPL: A Simple and Efficient Multi-agent Motion Prediction Baseline for Autonomous Drivingcited by 27
  33. 2022Path-Aware Graph Attention for HD Maps in Motion Predictioncited by 23
  34. 2022R-Pred: Two-Stage Motion Prediction Via Tube-Query Attention-Based Trajectory Refinementcited by 23
  35. 2024Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Modelscited by 23
  36. 2021Trajectory Prediction with Graph-based Dual-scale Context Fusioncited by 19
  37. 2023TFNet: Exploiting Temporal Cues for Fast and Accurate LiDAR Semantic Segmentationcited by 13
  38. 2020Rethinking 3D LiDAR Point Cloud Segmentationcited by 9

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Trajectory Mamba: Efficient Attention-Mamba Forecasting Model Based on Selective SSM
  2. 2021Scene Transformer: A unified architecture for predicting multiple agent trajectories
  3. 2023Efficient Baselines for Motion Prediction in Autonomous Driving
  4. 2024Enhanced Prediction of Multi-Agent Trajectories via Control Inference and State-Space Dynamics
  5. 2024DeMo: Decoupling Motion Forecasting into Directional Intentions and Dynamic States
  6. 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Driving
  7. 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networks
  8. 2025HAMF: A Hybrid Attention-Mamba Framework for Joint Scene Context Understanding and Future Motion Representation Learning