mlsanityData to 7 Oct 2026

Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchors

arXiv 2302.04860 ↗First posted 9 Feb 2023cs.CVcited by 34

Not on the map. Why?

Abstract (arXiv)

Predicting diverse human motions given a sequence of historical poses has received increasing attention. Despite rapid progress, existing work captures the multi-modal nature of human motions primarily through likelihood-based sampling, where the mode collapse has been widely observed. In this paper, we propose a simple yet effective approach that disentangles randomly sampled codes with a deterministic learnable component named anchors to promote sample precision and diversity. Anchors are further factorized into spatial anchors and temporal anchors, which provide attractively interpretable control over spatial-temporal disparity. In principle, our spatial-temporal anchor-based sampling (STARS) can be applied to different motion predictors. Here we propose an interaction-enhanced spatial-temporal graph convolutional network (IE-STGCN) that encodes prior knowledge of human motions (e.g., spatial locality), and incorporate the anchors into it. Extensive experiments demonstrate that our approach outperforms state of the art in both stochastic and deterministic prediction, suggesting it as a unified framework for modeling human motions. Our code and pretrained models are available at https://github.com/Sirui-Xu/STARS.

Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 54 of its 77 references that are in the map. First posted on arXiv 9 Feb 2023.

Builds on

54 of 77 references.

References · 54

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2020End-to-End Object Detection with Transformerscited by 7,384
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  6. 2022Generative Adversarial Networkscited by 5,603
  7. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  8. 2015Variational Inference with Normalizing Flowscited by 2,161
  9. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  10. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  11. 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
  12. 2017On human motion prediction using recurrent neural networkscited by 336
38 more
  1. 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
  2. 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
  3. 2016A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehiclescited by 251
  4. 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 245
  5. 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
  6. 2016Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoderscited by 219
  7. 2021Multimodal Motion Prediction with Stacked Transformerscited by 207
  8. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  9. 2020Long-term Human Motion Prediction with Scene Contextcited by 191
  10. 2020DLow: Diversifying Latent Flows for Diverse Human Motion Predictioncited by 184
  11. 2021Character Controllers Using Motion VAEscited by 182
  12. 2017HP-GAN: Probabilistic 3D human motion prediction via GANcited by 176
  13. 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 164
  14. 2020Memory-augmented Dense Predictive Coding for Video Representation Learningcited by 137
  15. 2020Dynamic Multiscale Graph Neural Networks for 3D Skeleton-Based Human Motion Predictioncited by 132
  16. 2018Convolutional Sequence to Sequence Model for Human Dynamicscited by 115
  17. 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
  18. 2018Human Motion Prediction via Spatio-Temporal Inpaintingcited by 114
  19. 2021MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Predictioncited by 100
  20. 2017Deep representation learning for human motion prediction and classificationcited by 97
  21. 2019Structured Prediction Helps 3D Human Motion Modellingcited by 96
  22. 2017The Pose Knows: Video Forecasting by Generating Pose Futurescited by 88
  23. 2019Ego-Pose Estimation and Forecasting as Real-Time PD Controlcited by 87
  24. 2018MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamicscited by 86
  25. 2021Space-Time-Separable Graph Convolutional Network for Pose Forecastingcited by 84
  26. 2019Context-aware Human Motion Predictioncited by 83
  27. 2019Diverse Trajectory Forecasting with Determinantal Point Processescited by 80
  28. 2017DeLiGAN : Generative Adversarial Networks for Diverse and Limited Datacited by 77
  29. 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
  30. 2020Residual Force Control for Agile Human Behavior Imitation and Extended Motion Synthesiscited by 63
  31. 2018Accurate and Diverse Sampling of Sequences based on a "Best of Many" Sample Objectivecited by 56
  32. 2018BiHMP-GAN: Bidirectional 3D Human Motion Prediction GANcited by 55
  33. 2019Predicting 3D Human Dynamics from Videocited by 51
  34. 2018Human Motion Modeling using DVGANscited by 45
  35. 2019Imitation Learning for Human Pose Predictioncited by 44
  36. 2021Interpretable Social Anchors for Human Trajectory Forecasting in Crowdscited by 44
  37. 2022Motron: Multimodal Probabilistic Human Motion Forecastingcited by 30
  38. 2017Forecasting Human Dynamics from Static Imagescited by 17

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 10; 2024: 11; 2025: 7; 2026: 6.

34 papers.

Sort:

By area:

  1. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
  2. 2023HumanTOMATO: Text-aligned Whole-body Motion Generationcited by 103
  3. 2024InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interactioncited by 63
  4. 2023Stochastic Multi-Person 3D Motion Forecastingcited by 28
  5. 2023Interactive Humanoid: Online Full-Body Motion Reaction Synthesis with Social Affordance Canonicalization and Forecastingcited by 27
  6. 2023CoMusion: Towards Consistent Stochastic Human Motion Prediction via Motion Diffusioncited by 21
  7. 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Predictioncited by 16
  8. 2024Progressive Pretext Task Learning for Human Trajectory Predictioncited by 16
  9. 2024Learning Semantic Latent Directions for Accurate and Controllable Human Motion Predictioncited by 14
  10. 2025Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Predictioncited by 12
  11. 2023Toward Reliable Human Pose Forecasting with Uncertaintycited by 11
  12. 2025From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Modelscited by 11
22 more
  1. 2024MotionWavelet: Human Motion Prediction via Wavelet Manifold Learningcited by 8
  2. 2024MotionMap: Representing Multimodality in Human Pose Forecastingcited by 7
  3. 2023Staged Contact-Aware Global Human Motion Forecastingcited by 6
  4. 2024Hand-Centric Motion Refinement for 3D Hand-Object Interaction via Hierarchical Spatial-Temporal Modelingcited by 6
  5. 2024Multi-Condition Latent Diffusion Network for Scene-Aware Neural Human Motion Predictioncited by 6
  6. 2024DivDiff: A Conditional Diffusion Model for Diverse Human Motion Predictioncited by 6
  7. 2023Orientation-Aware Leg Movement Learning for Action-Driven Human Motion Predictioncited by 4
  8. 2025CacheFlow: Fast Human Motion Prediction by Cached Normalizing Flowcited by 4
  9. 2023The MI-Motion Dataset and Benchmark for 3D Multi-Person Motion Predictioncited by 3
  10. 2024Text to Blind Motioncited by 3
  11. 2024Diverse Code Query Learning for Speech-Driven Facial Animationcited by 2
  12. 2024COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Modelscited by 2
  13. 2025MoReact: Generating Reactive Motion from Textual Descriptionscited by 2
  14. 2025Temporal Continual Learning with Prior Compensation for Human Motion Predictioncited by 1
  15. 2025MMCM: Multimodality-aware Metric using Clustering-based Modes for Probabilistic Human Motion Predictioncited by 1
  16. 2025Stochastic Human Motion Prediction with Memory of Action Transition and Action Characteristiccited by 0
  17. 2026KHMP: Frequency-Domain Kalman Refinement for High-Fidelity Human Motion Predictioncited by 0
  18. 2026Capturing Uncertainty in Human Motion for Representation Learning in Soccercited by 0
  19. 2026Autonomous Telerehabilitation via Skeletal Motion Prediction and Joint-Level Performance Assessmentcited by 0
  20. 2026Gaussian-Mixture Latent Flow for Stochastic 3D Human Motion Predictioncited by 0
  21. 2026Multi-Person Human Motion Forecasting in Complex Scenescited by 0
  22. 2026From Where to How: Continuous 4D Interaction Forecasting from Egocentric Videocited by 0