AdvMT: Adversarial Motion Transformer for Long-term Human Motion Prediction
Not on the map. Why?
Abstract (arXiv)
Human motion prediction is a crucial capability for advanced robotic systems that interact with humans. In facilities with dynamic human-robot collaboration settings, robots must anticipate human movements to ensure safety, prevent collisions, and optimize cooperative tasks. Traditionally, motion forecasting is treated as a sequential modeling problem using historical pose data, but achieving long-term accuracy and physical realism remains challenging. We present Adversarial Motion Transformer (AdvMT), a novel approach that integrates a Transformer-based motion encoder with a temporal continuity discriminator to address these challenges. The Transformer captures rich spatio-temporal dependencies across human joints, while adversarial training with a continuity discriminator enforces smooth, natural motion trajectories that adhere to biomechanical constraints. Our training scheme includes a bone-length consistency term and adversarial loss to reduce common artifacts like pose freezing or unnatural transitions. In experiments on the Human3.6M motion dataset, AdvMT achieves state-of-the-art long-horizon prediction accuracy while also delivering robust short-term predictions. These improvements strengthen the prediction foundation for physical AI in manufacturing and human-robot collaboration, where anticipating human motion is a prerequisite for safe and efficient robot coordination.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 48 references that are in the map. First posted on arXiv 10 Jan 2024.
Builds on
20 of 48 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2017On human motion prediction using recurrent neural networkscited by 336
- 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 245
- 2017HP-GAN: Probabilistic 3D human motion prediction via GANcited by 176
- 2020History Repeats Itself: Human Motion Prediction via Motion Attentioncited by 164
- 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
- 2018Convolutional Sequence to Sequence Model for Human Dynamicscited by 115
- 2018Human Motion Prediction via Spatio-Temporal Inpaintingcited by 114
- 2018QuaterNet: A Quaternion-based Recurrent Model for Human Motioncited by 108
- 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 99
8 more
- 2018BiHMP-GAN: Bidirectional 3D Human Motion Prediction GANcited by 55
- 2021Pose Transformers (POTR): Human Motion Prediction with Non-Autoregressive Transformerscited by 46
- 2018Long-Term Human Motion Prediction by Modeling Motion Context and Enhancing Motion Dynamiccited by 41
- 20223D Human Motion Prediction: A Surveycited by 30
- 2022Pose Forecasting in Industrial Human-Robot Collaborationcited by 24
- 2021Learning Human Motion Prediction via Stochastic Differential Equationscited by 11
- 2021Human Motion Prediction Using Manifold-Aware Wasserstein GANcited by 8
- 2020Adversarial Refinement Network for Human Motion Predictioncited by 3
Built on by
Not cited yet.