History Repeats Itself: Human Motion Prediction via Motion Attention
Not on the map. Why?
Abstract (arXiv)
Human motion prediction aims to forecast future human poses given a past motion. Whether based on recurrent or feed-forward neural networks, existing methods fail to model the observation that human motion tends to repeat itself, even for complex sports actions and cooking activities. Here, we introduce an attention-based feed-forward network that explicitly leverages this observation. In particular, instead of modeling frame-wise attention via pose similarity, we propose to extract motion attention to capture the similarity between the current motion context and the historical motion sub-sequences. Aggregating the relevant past motions and processing the result with a graph convolutional network allows us to effectively exploit motion patterns from the long-term history to predict the future poses. Our experiments on Human3.6M, AMASS and 3DPW evidence the benefits of our approach for both periodical and non-periodical actions. Thanks to our attention model, it yields state-of-the-art results on all three datasets. Our code is available at https://github.com/wei-mao-2019/HisRepItself.
Key facts. Cited by 164 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 30; 2023: 51; 2024: 27; 2025: 18; 2026: 11.
164 papers.
Sort:
By area:
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
- 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
- 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 137
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
- 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 99
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimationcited by 91
- 2021Space-Time-Separable Graph Convolutional Network for Pose Forecastingcited by 84
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2022GIMO: Gaze-Informed Human Motion Prediction in Contextcited by 81
- 2021Multi-Person Extreme Motion Predictioncited by 74
38 more
- 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
- 2022Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Predictioncited by 66
- 2022NeMF: Neural Motion Fields for Kinematic Animationcited by 66
- 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
- 2021Multi-Person 3D Motion Prediction with Multi-Range Transformerscited by 63
- 2021The Wanderings of Odysseus in 3D Scenescited by 59
- 2021TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wildcited by 52
- 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 51
- 2022Spatio-Temporal Gating-Adjacency GCN for Human Motion Predictioncited by 48
- 2021Pose Transformers (POTR): Human Motion Prediction with Non-Autoregressive Transformerscited by 46
- 2021View Vertically: A Hierarchical Network for Trajectory Prediction via Fourier Spectrumscited by 44
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Modelscited by 43
- 2022MotionMixer: MLP-based 3D Human Body Pose Forecastingcited by 42
- 2023Task-Oriented Human-Object Interactions Generation with Implicit Neural Representationscited by 41
- 2021RAIN: Reinforced Hybrid Attention Inference Network for Motion Forecastingcited by 36
- 2021Multiscale Spatio-Temporal Graph Neural Networks for 3D Skeleton-Based Motion Predictioncited by 36
- 2021Multi-level Motion Attention for Human Motion Predictioncited by 35
- 2023Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchorscited by 34
- 2022A generic diffusion-based approach for 3D human pose prediction in the wildcited by 33
- 2022Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary Spacecited by 32
- 20223D Human Motion Prediction: A Surveycited by 30
- 2022Motron: Multimodal Probabilistic Human Motion Forecastingcited by 30
- 2022Skeleton-Parted Graph Scattering Networks for 3D Human Motion Predictioncited by 29
- 2022Human Joint Kinematics Diffusion-Refinement for Stochastic Motion Predictioncited by 28
- 2022Contact-aware Human Motion Forecastingcited by 27
- 2024Towards Open Domain Text-Driven Synthesis of Multi-Person Motionscited by 27
- 2022Weakly-supervised Action Transition Learning for Stochastic Human Motion Predictioncited by 26
- 2023Skeleton-in-Context: Unified Skeleton Sequence Modeling with In-Context Learningcited by 26
- 2023Trajectory-Aware Body Interaction Transformer for Multi-Person Pose Forecastingcited by 25
- 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
- 2022Pose Forecasting in Industrial Human-Robot Collaborationcited by 24
- 2022SoMoFormer: Multi-Person Pose Forecasting with Transformerscited by 23
- 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Modelscited by 23
- 2021Pose2Room: Understanding 3D Scenes from Human Activitiescited by 22
- 2023Robots That Can See: Leveraging Human Pose for Trajectory Predictioncited by 22
- 20223D Vision with Transformers: A Surveycited by 21
- 2023CoMusion: Towards Consistent Stochastic Human Motion Prediction via Motion Diffusioncited by 21
- 2024Multi-Transmotion: Pre-trained Model for Human Motion Predictioncited by 21
50 most cited of 164 All 164 (JSON)
- 2026Latent Dataset Distillation for Human Motion Prediction22 Sep 2026
- 2026DriveMotion: A Large-Scale Multi-Source Benchmark for Driver Motion Sequence Modeling and Forecasting8 Sep 2026
- 2026Multi-Person Human Motion Forecasting in Complex Scenes27 Aug 2026
- 2026Gaussian-Mixture Latent Flow for Stochastic 3D Human Motion Prediction21 Aug 2026
- 2026KOALA: Koopman Operator Learning for WiFi-Based Anticipatory Hum16 Aug 2026
- 2026Capturing Uncertainty in Human Motion for Representation Learning in Soccer11 Aug 2026
- 2026Residual Flow Matching with Dynamic Cross-Interaction for 3D Multi-Person Motion Prediction4 Aug 2026
- 2026Zero-Gated Language-conditioned Human Motion Prediction28 Jun 2026
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modeling11 May 2026
- 2026OmniRobotHome: A Multi-Camera Home Platform for Real-Time Human-Robot Interaction30 Apr 2026
- 2026Vision-Based Safe Human-Robot Collaboration with Uncertainty Guarantees16 Apr 2026
- 2025Spatiotemporal-Untrammelled Mixture of Experts for Multi-Person Motion Prediction25 Dec 2025
38 more
- 2025Scriboora: Rethinking Human Pose Forecasting19 Nov 2025
- 2025Seeing My Future: Predicting Situated Interaction Behavior in Virtual Reality12 Oct 2025
- 2025Human-in-Context: Unified Cross-Domain 3D Human Motion Modeling via In-Context Learning14 Aug 2025
- 2025Spatial-Temporal Multi-Scale Quantization for Flexible Motion Generation12 Aug 2025
- 2025LuKAN: A Kolmogorov-Arnold Network Framework for 3D Human Motion Prediction6 Aug 2025
- 2025UniEgoMotion: A Unified Model for Egocentric Motion Reconstruction, Forecasting, and Generation2 Aug 2025
- 2025Uncertainty-aware Probabilistic 3D Human Motion Forecasting via Invertible Networks19 Jul 2025
- 2025MMHU: A Massive-Scale Multimodal Benchmark for Human Behavior Understanding16 Jul 2025
- 2025Efficient Multi-Person Motion Prediction by Lightweight Spatial and Temporal Interactions13 Jul 2025
- 2025GGMotion: Group Graph Dynamics-Kinematics Networks for Human Motion Prediction10 Jul 2025
- 2025Stochastic Human Motion Prediction with Memory of Action Transition and Action Characteristic5 Jul 2025
- 2025Temporal Continual Learning with Prior Compensation for Human Motion Prediction5 Jul 2025
- 2025HUMOF: Human Motion Forecasting in Interactive Social Scenes4 Jun 2025
- 2025Multi-Resolution Haar Network: Enhancing human motion prediction via Haar transform19 May 2025
- 2025Unified Uncertainty-Aware Diffusion for Multi-Agent Trajectory Modeling24 Mar 2025
- 2025HVIS: A Human-like Vision and Inference System for Human Motion Prediction24 Feb 2025
- 2025Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Prediction10 Jan 2025
- 2024Spatio-Temporal Multi-Subgraph GCN for 3D Human Motion Prediction31 Dec 2024
- 2024Temporal Dynamics Decoupling with Inverse Processing for Enhancing Human Motion Prediction31 Dec 2024
- 2024MotionMap: Representing Multimodality in Human Pose Forecasting25 Dec 2024
- 2024Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrations3 Dec 2024
- 2024UnityGraph: Unified Learning of Spatio-temporal features for Multi-person Motion Prediction6 Nov 2024
- 2024Relation Learning and Aggregate-attention for Multi-person Motion Prediction6 Nov 2024
- 2024Multi-Transmotion: Pre-trained Model for Human Motion Prediction4 Nov 2024
- 2024TranSPORTmer: A Holistic Approach to Trajectory Understanding in Multi-Agent Sports23 Oct 2024
- 2024BadHMP: Backdoor Attack against Human Motion Prediction29 Sep 2024
- 2024T2M-X: Learning Expressive Text-to-Motion Generation from Partially Annotated Data20 Sep 2024
- 2024Massively Multi-Person 3D Human Motion Forecasting with Scene Context18 Sep 2024
- 2024DivDiff: A Conditional Diffusion Model for Diverse Human Motion Prediction16 Aug 2024
- 2024Towards Practical Human Motion Prediction with LiDAR Point Clouds15 Aug 2024
- 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models19 Jul 2024
- 2024CrowdMoGen: Zero-Shot Text-Driven Collective Motion Generation8 Jul 2024
- 2024HOIMotion: Forecasting Human Motion During Human-Object Interactions Using Egocentric 3D Object Bounding Boxes2 Jul 2024
- 2024Towards Open Domain Text-Driven Synthesis of Multi-Person Motions28 May 2024
- 2024Social-MAE: Social Masked Autoencoder for Multi-person Motion Representation Learning8 Apr 2024
- 2024Two-Person Interaction Augmentation with Skeleton Priors8 Apr 2024
- 2024Towards more realistic human motion prediction with attention to motion coordination4 Apr 2024
- 2024Large Motion Model for Unified Multi-Modal Motion Generation1 Apr 2024
50 newest of 164 All 164 (JSON)
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Modelscited by 43
- 2022A generic diffusion-based approach for 3D human pose prediction in the wildcited by 33
- 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Modelscited by 23
- 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Predictioncited by 16
- 2023Can We Use Diffusion Probabilistic Models for 3D Motion Prediction?cited by 14
- 2024DivDiff: A Conditional Diffusion Model for Diverse Human Motion Predictioncited by 6
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modelingcited by 3
- 2026Residual Flow Matching with Dynamic Cross-Interaction for 3D Multi-Person Motion Predictioncited by 0
- 2026Residual Flow Matching with Dynamic Cross-Interaction for 3D Multi-Person Motion Prediction4 Aug 2026
- 2026Heteroscedastic Diffusion for Multi-Agent Trajectory Modeling11 May 2026
- 2024DivDiff: A Conditional Diffusion Model for Diverse Human Motion Prediction16 Aug 2024
- 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Models19 Jul 2024
- 2023Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models3 Oct 2023
- 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Prediction30 Jul 2023
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Prediction20 Mar 2023
- 2023Can We Use Diffusion Probabilistic Models for 3D Motion Prediction?28 Feb 2023
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Prediction25 Nov 2022
- 2022A generic diffusion-based approach for 3D human pose prediction in the wild11 Oct 2022
- 2023Social Motion Prediction with Cognitive Hierarchiescited by 8
- 2023Social Motion Prediction with Cognitive Hierarchies8 Nov 2023
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
- 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
- 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 137
- 2022Back to MLP: A Simple Baseline for Human Motion Predictioncited by 99
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2023PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimationcited by 91
- 2021Space-Time-Separable Graph Convolutional Network for Pose Forecastingcited by 84
- 2022GIMO: Gaze-Informed Human Motion Prediction in Contextcited by 81
- 2021Multi-Person Extreme Motion Predictioncited by 74
- 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
- 2022Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Predictioncited by 66
12 most cited of 152 All 152 (JSON)
- 2026Latent Dataset Distillation for Human Motion Prediction22 Sep 2026
- 2026DriveMotion: A Large-Scale Multi-Source Benchmark for Driver Motion Sequence Modeling and Forecasting8 Sep 2026
- 2026Multi-Person Human Motion Forecasting in Complex Scenes27 Aug 2026
- 2026Gaussian-Mixture Latent Flow for Stochastic 3D Human Motion Prediction21 Aug 2026
- 2026KOALA: Koopman Operator Learning for WiFi-Based Anticipatory Hum16 Aug 2026
- 2026Capturing Uncertainty in Human Motion for Representation Learning in Soccer11 Aug 2026
- 2026Zero-Gated Language-conditioned Human Motion Prediction28 Jun 2026
- 2026OmniRobotHome: A Multi-Camera Home Platform for Real-Time Human-Robot Interaction30 Apr 2026
- 2026Vision-Based Safe Human-Robot Collaboration with Uncertainty Guarantees16 Apr 2026
- 2025Scriboora: Rethinking Human Pose Forecasting19 Nov 2025
- 2025Seeing My Future: Predicting Situated Interaction Behavior in Virtual Reality12 Oct 2025
- 2025Human-in-Context: Unified Cross-Domain 3D Human Motion Modeling via In-Context Learning14 Aug 2025
12 newest of 152 All 152 (JSON)