Forecasting Human Dynamics from Static Images
Not on the map. Why?
Abstract (arXiv)
This paper presents the first study on forecasting human dynamics from static images. The problem is to input a single RGB image and generate a sequence of upcoming human body poses in 3D. To address the problem, we propose the 3D Pose Forecasting Network (3D-PFNet). Our 3D-PFNet integrates recent advances on single-image human pose estimation and sequence prediction, and converts the 2D predictions into 3D space. We train our 3D-PFNet using a three-step training strategy to leverage a diverse source of training data, including image and video based human pose datasets and 3D motion capture (MoCap) data. We demonstrate competitive performance of our 3D-PFNet on 2D pose forecasting and 3D pose recovery through quantitative and qualitative results.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 8; 2022: 2; 2023: 4; 2024: 0; 2025: 2.
17 papers.
Sort:
By area:
- 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
- 2021TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wildcited by 52
- 2019Imitation Learning for Human Pose Predictioncited by 44
- 2023Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchorscited by 34
- 2022A generic diffusion-based approach for 3D human pose prediction in the wildcited by 33
- 2021Image-to-Video Generation via 3D Facial Dynamicscited by 13
- 2023Toward Reliable Human Pose Forecasting with Uncertaintycited by 11
- 2023What Happened 3 Seconds Ago? Inferring the Past with Thermal Imagingcited by 7
- 2021Social Processes: Self-Supervised Meta-Learning over Conversational Groups for Forecasting Nonverbal Social Cuescited by 6
- 2021Exploring Versatile Prior for Human Motion via Motion Frequency Guidancecited by 5
- 2021Learning to Predict Diverse Human Motions from a Single Image via Mixture Density Networkscited by 3
- 2025mmPred: Radar-based Human Motion Prediction in the Darkcited by 3
5 more
- 2025Towards Consistent Long-Term Pose Generationcited by 1
- 2021Understanding in Artificial Intelligencecited by 0
- 2021LARNet: Latent Action Representation for Human Action Synthesiscited by 0
- 2022Unified Simulation, Perception, and Generation of Human Behaviorcited by 0
- 20233D Pose Nowcasting: Forecast the Future to Improve the Presentcited by 0
- 2025mmPred: Radar-based Human Motion Prediction in the Dark29 Nov 2025
- 2025Towards Consistent Long-Term Pose Generation24 Jul 2025
- 20233D Pose Nowcasting: Forecast the Future to Improve the Present24 Aug 2023
- 2023What Happened 3 Seconds Ago? Inferring the Past with Thermal Imaging26 Apr 2023
- 2023Toward Reliable Human Pose Forecasting with Uncertainty13 Apr 2023
- 2023Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchors9 Feb 2023
- 2022A generic diffusion-based approach for 3D human pose prediction in the wild11 Oct 2022
- 2022Unified Simulation, Perception, and Generation of Human Behavior28 Apr 2022
- 2021Exploring Versatile Prior for Human Motion via Motion Frequency Guidance25 Nov 2021
- 2021LARNet: Latent Action Representation for Human Action Synthesis21 Oct 2021
- 2021Learning to Predict Diverse Human Motions from a Single Image via Mixture Density Networks13 Sep 2021
- 2021Social Processes: Self-Supervised Meta-Learning over Conversational Groups for Forecasting Nonverbal Social Cues28 Jul 2021
5 more
- 2021Image-to-Video Generation via 3D Facial Dynamics31 May 2021
- 2021TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild8 Apr 2021
- 2021Synthesis of Compositional Animations from Textual Descriptions26 Mar 2021
- 2021Understanding in Artificial Intelligence17 Jan 2021
- 2019Imitation Learning for Human Pose Prediction8 Sep 2019
- 2019Imitation Learning for Human Pose Predictioncited by 44
- 2019Imitation Learning for Human Pose Prediction8 Sep 2019
- 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
- 2021TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wildcited by 52
- 2023Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchorscited by 34
- 2021Image-to-Video Generation via 3D Facial Dynamicscited by 13
- 2023Toward Reliable Human Pose Forecasting with Uncertaintycited by 11
- 2023What Happened 3 Seconds Ago? Inferring the Past with Thermal Imagingcited by 7
- 2021Social Processes: Self-Supervised Meta-Learning over Conversational Groups for Forecasting Nonverbal Social Cuescited by 6
- 2021Exploring Versatile Prior for Human Motion via Motion Frequency Guidancecited by 5
- 2021Learning to Predict Diverse Human Motions from a Single Image via Mixture Density Networkscited by 3
- 2025mmPred: Radar-based Human Motion Prediction in the Darkcited by 3
- 2025Towards Consistent Long-Term Pose Generationcited by 1
- 2021Understanding in Artificial Intelligencecited by 0
12 most cited of 15 All 15 (JSON)
- 2025mmPred: Radar-based Human Motion Prediction in the Dark29 Nov 2025
- 2025Towards Consistent Long-Term Pose Generation24 Jul 2025
- 20233D Pose Nowcasting: Forecast the Future to Improve the Present24 Aug 2023
- 2023What Happened 3 Seconds Ago? Inferring the Past with Thermal Imaging26 Apr 2023
- 2023Toward Reliable Human Pose Forecasting with Uncertainty13 Apr 2023
- 2023Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchors9 Feb 2023
- 2022Unified Simulation, Perception, and Generation of Human Behavior28 Apr 2022
- 2021Exploring Versatile Prior for Human Motion via Motion Frequency Guidance25 Nov 2021
- 2021LARNet: Latent Action Representation for Human Action Synthesis21 Oct 2021
- 2021Learning to Predict Diverse Human Motions from a Single Image via Mixture Density Networks13 Sep 2021
- 2021Social Processes: Self-Supervised Meta-Learning over Conversational Groups for Forecasting Nonverbal Social Cues28 Jul 2021
- 2021Image-to-Video Generation via 3D Facial Dynamics31 May 2021
12 newest of 15 All 15 (JSON)