mlsanityData to 7 Oct 2026

AdvMT: Adversarial Motion Transformer for Long-term Human Motion Prediction

arXiv 2401.05018 ↗First posted 10 Jan 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Human motion prediction is a crucial capability for advanced robotic systems that interact with humans. In facilities with dynamic human-robot collaboration settings, robots must anticipate human movements to ensure safety, prevent collisions, and optimize cooperative tasks. Traditionally, motion forecasting is treated as a sequential modeling problem using historical pose data, but achieving long-term accuracy and physical realism remains challenging. We present Adversarial Motion Transformer (AdvMT), a novel approach that integrates a Transformer-based motion encoder with a temporal continuity discriminator to address these challenges. The Transformer captures rich spatio-temporal dependencies across human joints, while adversarial training with a continuity discriminator enforces smooth, natural motion trajectories that adhere to biomechanical constraints. Our training scheme includes a bone-length consistency term and adversarial loss to reduce common artifacts like pose freezing or unnatural transitions. In experiments on the Human3.6M motion dataset, AdvMT achieves state-of-the-art long-horizon prediction accuracy while also delivering robust short-term predictions. These improvements strengthen the prediction foundation for physical AI in manufacturing and human-robot collaboration, where anticipating human motion is a prerequisite for safe and efficient robot coordination.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 48 references that are in the map. First posted on arXiv 10 Jan 2024.

Builds on

20 of 48 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020End-to-End Object Detection with Transformerscited by 7,384
  4. 2017On human motion prediction using recurrent neural networkscited by 336
  5. 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 245
  6. 2017HP-GAN: Probabilistic 3D human motion prediction via GANcited by 176
  7. 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 164
  8. 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
  9. 2018Convolutional Sequence to Sequence Model for Human Dynamicscited by 115
  10. 2018Human Motion Prediction via Spatio-Temporal Inpaintingcited by 114
  11. 2018QuaterNet: A Quaternion-based Recurrent Model for Human Motioncited by 108
  12. 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 99
8 more
  1. 2018BiHMP-GAN: Bidirectional 3D Human Motion Prediction GANcited by 55
  2. 2021Pose Transformers (POTR): Human Motion Prediction with Non-Autoregressive Transformerscited by 46
  3. 2018Long-Term Human Motion Prediction by Modeling Motion Context and Enhancing Motion Dynamiccited by 41
  4. 20223D Human Motion Prediction: A Surveycited by 30
  5. 2022Pose Forecasting in Industrial Human-Robot Collaborationcited by 24
  6. 2021Learning Human Motion Prediction via Stochastic Differential Equationscited by 11
  7. 2021Human Motion Prediction Using Manifold-Aware Wasserstein GANcited by 8
  8. 2020Adversarial Refinement Network for Human Motion Predictioncited by 3

Built on by

Not cited yet.