IPCC-TP: Utilizing Incremental Pearson Correlation Coefficient for Joint Multi-Agent Trajectory Prediction
Not on the map. Why?
Abstract (arXiv)
Reliable multi-agent trajectory prediction is crucial for the safe planning and control of autonomous systems. Compared with single-agent cases, the major challenge in simultaneously processing multiple agents lies in modeling complex social interactions caused by various driving intentions and road conditions. Previous methods typically leverage graph-based message propagation or attention mechanism to encapsulate such interactions in the format of marginal probabilistic distributions. However, it is inherently sub-optimal. In this paper, we propose IPCC-TP, a novel relevance-aware module based on Incremental Pearson Correlation Coefficient to improve multi-agent interaction modeling. IPCC-TP learns pairwise joint Gaussian Distributions through the tightly-coupled estimation of the means and covariances according to interactive incremental movements. Our module can be conveniently embedded into existing multi-agent prediction methods to extend original motion distribution decoders. Extensive experiments on nuScenes and Argoverse 2 datasets demonstrate that IPCC-TP improves the performance of baselines by a large margin.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 34 of its 49 references that are in the map. First posted on arXiv 1 Mar 2023.
Builds on
34 of 49 references.
References · 34
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2015Gated Graph Sequence Neural Networkscited by 792
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2015Generating Sentences from a Continuous Spacecited by 607
22 more
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
- 2020TNT: Target-driveN Trajectory Predictioncited by 345
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
- 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
- 2020Human Trajectory Forecasting in Crowds: A Deep Learning Perspectivecited by 128
- 2019Spatially-Aware Graph Neural Networks for Relational Behavior Forecasting from Sensor Datacited by 104
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2019Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecastingcited by 87
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2020TPNet: Trajectory Proposal Network for Motion Predictioncited by 80
- 2020Semantic Graph Based Place Recognition for 3D Point Cloudscited by 43
- 2022MonoGraspNet: 6-DoF Grasping with a Single RGB Imagecited by 24
- 2022OPA-3D: Occlusion-Aware Pixel-Wise Aggregation for Monocular 3D Object Detectioncited by 23
- 2021Collaborative Uncertainty in Multi-Agent Trajectory Forecastingcited by 17
- 2020FlowMOT: 3D Multi-Object Tracking by Scene Flow Associationcited by 10
- 2022SST: Real-time End-to-end Monocular 3D Reconstruction via Sparse Spatial-Temporal Guidancecited by 4
Built on by
Citing papers per year: 2024: 11; 2025: 2.
13 papers.
Sort:
By area:
- 2024Multi-agent Long-term 3D Human Pose Forecasting via Interaction-aware Trajectory Conditioningcited by 29
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memorycited by 20
- 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understandingcited by 10
- 2024Continual Learning for Smart City: A Surveycited by 9
- 2024Recurrent Aligned Network for Generalized Pedestrian Trajectory Predictioncited by 8
- 2024TrACT: A Training Dynamics Aware Contrastive Learning Framework for Long-tail Trajectory Predictioncited by 7
- 2024CUQDS: Conformal Uncertainty Quantification under Distribution Shift for Trajectory Predictioncited by 5
- 2024AMEND: A Mixture of Experts Framework for Long-tailed Trajectory Predictioncited by 4
- 2024A Structure-Aware Lane Graph Transformer Model for Vehicle Trajectory Predictioncited by 2
- 2024ITPNet: Towards Instantaneous Trajectory Prediction for Autonomous Drivingcited by 2
- 2024Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encodingcited by 1
- 2025Generative Data Augmentation for Object Point Cloud Segmentationcited by 1
1 more
- 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understanding28 May 2025
- 2025Generative Data Augmentation for Object Point Cloud Segmentation23 May 2025
- 2024ITPNet: Towards Instantaneous Trajectory Prediction for Autonomous Driving10 Dec 2024
- 2024Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encoding17 Nov 2024
- 2024Relation Learning and Aggregate-attention for Multi-person Motion Prediction6 Nov 2024
- 2024CUQDS: Conformal Uncertainty Quantification under Distribution Shift for Trajectory Prediction17 Jun 2024
- 2024A Structure-Aware Lane Graph Transformer Model for Vehicle Trajectory Prediction30 May 2024
- 2024TrACT: A Training Dynamics Aware Contrastive Learning Framework for Long-tail Trajectory Prediction18 Apr 2024
- 2024Multi-agent Long-term 3D Human Pose Forecasting via Interaction-aware Trajectory Conditioning8 Apr 2024
- 2024Continual Learning for Smart City: A Survey1 Apr 2024
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memory15 Mar 2024
- 2024Recurrent Aligned Network for Generalized Pedestrian Trajectory Prediction9 Mar 2024
1 more
- 2024Multi-agent Long-term 3D Human Pose Forecasting via Interaction-aware Trajectory Conditioningcited by 29
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memorycited by 20
- 2024Continual Learning for Smart City: A Surveycited by 9
- 2024Recurrent Aligned Network for Generalized Pedestrian Trajectory Predictioncited by 8
- 2024TrACT: A Training Dynamics Aware Contrastive Learning Framework for Long-tail Trajectory Predictioncited by 7
- 2024CUQDS: Conformal Uncertainty Quantification under Distribution Shift for Trajectory Predictioncited by 5
- 2024A Structure-Aware Lane Graph Transformer Model for Vehicle Trajectory Predictioncited by 2
- 2024ITPNet: Towards Instantaneous Trajectory Prediction for Autonomous Drivingcited by 2
- 2024Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encodingcited by 1
- 2024Relation Learning and Aggregate-attention for Multi-person Motion Predictioncited by 0
- 2024ITPNet: Towards Instantaneous Trajectory Prediction for Autonomous Driving10 Dec 2024
- 2024Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encoding17 Nov 2024
- 2024Relation Learning and Aggregate-attention for Multi-person Motion Prediction6 Nov 2024
- 2024CUQDS: Conformal Uncertainty Quantification under Distribution Shift for Trajectory Prediction17 Jun 2024
- 2024A Structure-Aware Lane Graph Transformer Model for Vehicle Trajectory Prediction30 May 2024
- 2024TrACT: A Training Dynamics Aware Contrastive Learning Framework for Long-tail Trajectory Prediction18 Apr 2024
- 2024Multi-agent Long-term 3D Human Pose Forecasting via Interaction-aware Trajectory Conditioning8 Apr 2024
- 2024Continual Learning for Smart City: A Survey1 Apr 2024
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memory15 Mar 2024
- 2024Recurrent Aligned Network for Generalized Pedestrian Trajectory Prediction9 Mar 2024