mlsanityData to 7 Oct 2026

MUSCLE-NET: Predicted-Multiscale-Aware Network for Pedestrian Trajectory Forecasting

arXiv 2606.00471 ↗First posted 30 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate pedestrian trajectory prediction is essential for safe navigation in autonomous driving and intelligent transportation systems. Despite substantial progress made by recent methods, most existing approaches are limited in fully exploiting diverse observations and often overlook the scale dependency of future motion, treating multiscale features uniformly regardless of underlying motion dynamics. This limits their robustness across diverse pedestrian behaviors. To address these challenges, we propose a Predicted-MUltiSCale-Aware Network (MUSCLE-NET) for Pedestrian Trajectory Forecasting that integrates complementary multimodal cues with scale-adaptive prediction mechanisms. The proposed framework is built upon a Multiscale Multimodal Feature Extraction (MMFE) module, which combines multiscale representation, modality-aware recalibration, and directional cross-modal fusion to construct semantically aligned representations from bounding boxes, velocities, and pose information. Building on these features, a Multiscale Enhanced Hierarchical Prediction (MEHP) module performs prediction-aware future-motion refinement via a probabilistic coarse predictor, scale-aligned fusion, and progressive refinement, adaptively selecting scale-relevant cues to mitigate spatial drift. Extensive experiments on the JAAD and PIE benchmarks demonstrate that the proposed MUSCLE-Net achieves competitive performance and consistent gains compared with state-of-the-art trajectory prediction methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 62 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

33 of 62 references.

References · 33

  1. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  2. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  3. 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 516
  4. 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 296
  5. 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
  6. 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
  7. 2023Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusioncited by 137
  8. 2020Dynamic Multiscale Graph Neural Networks for 3D Skeleton-Based Human Motion Predictioncited by 132
  9. 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
  10. 2023Visual Point Cloud Forecasting enables Scalable Autonomous Drivingcited by 97
  11. 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
  12. 2020BiTraP: Bi-directional Pedestrian Trajectory Prediction with Multi-modal Goal Estimationcited by 47
21 more
  1. 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
  2. 2023Efficient Multimodal Fusion via Interactive Promptingcited by 32
  3. 2025MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillationcited by 31
  4. 2024MART: MultiscAle Relational Transformer Networks for Multi-agent Trajectory Predictioncited by 21
  5. 2020Temporal Pyramid Network for Pedestrian Trajectory Prediction with Multi-Supervisioncited by 20
  6. 2025Trajectory Mamba: Efficient Attention-Mamba Forecasting Model Based on Selective SSMcited by 17
  7. 2022Action-based Contrastive Learning for Trajectory Predictioncited by 15
  8. 2020Socially Aware Crowd Navigation with Multimodal Pedestrian Trajectory Prediction for Autonomous Vehiclescited by 14
  9. 2023Another Vertical View: A Hierarchical Network for Heterogeneous Trajectory Prediction via Spectrumscited by 14
  10. 2020Probabilistic Crowd GAN: Multimodal Pedestrian Trajectory Prediction using a Graph Vehicle-Pedestrian Attention Networkcited by 12
  11. 2023A Novel Benchmarking Paradigm and a Scale- and Motion-Aware Model for Egocentric Pedestrian Trajectory Predictioncited by 12
  12. 2020Path Planning in Dynamic Environments using Generative RNNs and Monte Carlo Tree Searchcited by 9
  13. 2022TAMFormer: Multi-Modal Transformer with Learned Attention Mask for Early Intent Predictioncited by 9
  14. 2025Pedestrian Trajectory Prediction Based on Social Interactions Learning With Random Weightscited by 8
  15. 2025Continuous Locomotive Crowd Behavior Generationcited by 7
  16. 2023Distilling Knowledge for Short-to-Long Term Trajectory Predictioncited by 5
  17. 2023Sparse Pedestrian Character Learning for Trajectory Predictioncited by 3
  18. 2024Knowledge-aware Graph Transformer for Pedestrian Trajectory Predictioncited by 3
  19. 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Predictioncited by 2
  20. 2025Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Predictioncited by 1
  21. 2025Occlusion-Aware Diffusion Model for Pedestrian Intention Predictioncited by 1

Built on by

Not cited yet.