mlsanityData to 14 Oct 2026

BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesis

arXiv 2304.11118 ↗First posted 21 Apr 2023cs.CV cs.AIcited by 45

Not on the map. Why?

Abstract (arXiv)

Mixed reality applications require tracking the user's full-body motion to enable an immersive experience. However, typical head-mounted devices can only track head and hand movements, leading to a limited reconstruction of full-body motion due to variability in lower body configurations. We propose BoDiffusion -- a generative diffusion model for motion synthesis to tackle this under-constrained reconstruction problem. We present a time and space conditioning scheme that allows BoDiffusion to leverage sparse tracking inputs while generating smooth and realistic full-body motion sequences. To the best of our knowledge, this is the first approach that uses the reverse diffusion process to model full-body tracking as a conditional sequence generation task. We conduct experiments on the large-scale motion-capture dataset AMASS and show that our approach outperforms the state-of-the-art approaches by a significant margin in terms of full-body motion realism and joint reconstruction error.

Key facts. Cited by 45 papers in the map (data through 14 Oct 2026). Builds on 40 of its 62 references that are in the map. First posted on arXiv 21 Apr 2023.

Builds on

40 of 62 references.

References · 40

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  10. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  11. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  12. 2022Video Diffusion Modelscited by 2,305
28 more
  1. 2015Variational Inference with Normalizing Flowscited by 2,170
  2. 2017Decoupled Weight Decay Regularizationcited by 1,831
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  4. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  5. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
  6. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  7. 2022Human Motion Diffusion Modelcited by 1,080
  8. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
  9. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  10. 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 640
  11. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 501
  12. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 492
  13. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  14. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 324
  15. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  16. 2022DiffusionBERT: Improving Generative Masked Language Models with Diffusion Modelscited by 214
  17. 2021Character Controllers Using Motion VAEscited by 184
  18. 2022Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensorscited by 146
  19. 2019Lagging Inference Networks and Posterior Collapse in Variational Autoencoderscited by 124
  20. 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 110
  21. 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 107
  22. 2017Text2Action: Generative Adversarial Synthesis from Language to Actioncited by 106
  23. 2020Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flowscited by 94
  24. 2022QuestSim: Human Motion Tracking from Sparse Sensors with Simulated Avatarscited by 77
  25. 2022FLAG: Flow-based 3D Avatar Generation from Sparse Observationscited by 55
  26. 2021LoBSTr: Real-time Lower-body Pose Prediction from Sparse Upper-body Tracking Signalscited by 45
  27. 2021ProtoRes: Proto-Residual Network for Pose Authoring via Learned Inverse Kinematicscited by 17
  28. 2021Learning to Fit Morphable Modelscited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 15; 2025: 16; 2026: 12.

45 papers.

Sort:

By area:

  1. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
  2. 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 114
  3. 2024Seamless Human Motion Composition with Blended Positional Encodingscited by 80
  4. 2024Large Motion Model for Unified Multi-Modal Motion Generationcited by 65
  5. 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 58
  6. 2024ReGenNet: Towards Human Action-Reaction Synthesiscited by 53
  7. 2024RoHM: Robust Human Motion Reconstruction via Diffusioncited by 48
  8. 2023Adaptive Guidance: Training-free Acceleration of Conditional Diffusion Modelscited by 31
  9. 2025Whole-Body Conditioned Egocentric Video Predictioncited by 30
  10. 2024EgoLM: Multi-Modal Language Model of Egocentric Motionscited by 28
  11. 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 27
  12. 2024Stratified Avatar Generation from Sparse Observationscited by 21
33 more
  1. 2025Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Inputcited by 17
  2. 2025UniEgoMotion: A Unified Model for Egocentric Motion Reconstruction, Forecasting, and Generationcited by 17
  3. 2025The Invisible EgoHand: 3D Hand Forecasting through EgoBody Pose Estimationcited by 16
  4. 2025HERO: Human Reaction Generation from Videoscited by 15
  5. 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 14
  6. 2024EMHI: A Multimodal Egocentric Human Motion Dataset with HMD and Body-Worn IMUscited by 13
  7. 2024EgoCast: Forecasting Egocentric Human Pose in the Wildcited by 11
  8. 2025From Sparse Signal to Smooth Motion: Real-Time Motion Generation with Rolling Prediction Modelscited by 11
  9. 2024Estimating Ego-Body Pose from Doubly Sparse Egocentric Video Datacited by 8
  10. 2025ECHO: Ego-Centric modeling of Human-Object interactionscited by 5
  11. 2026Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robotscited by 4
  12. 2024Self-Avatar Animation in Virtual Reality: Impact of Motion Signals Artifacts on the Full-Body Pose Reconstructioncited by 3
  13. 2024DragPoser: Motion Reconstruction from Variable Sparse Tracking Signals via Latent Space Optimizationcited by 3
  14. 2026Ground Reaction Inertial Poser: Physics-based Human Motion Capture from Sparse IMUs and Insole Pressure Sensorscited by 2
  15. 2026Seeing Without Eyes: 4D Human-Scene Understanding from Wearable IMUscited by 2
  16. 2025SSD-Poser: Avatar Pose Estimation with State Space Duality from Sparse Observationscited by 1
  17. 2026MotionGRPO: Overcoming Low Intra-Group Diversity in GRPO-Based Egocentric Motion Recoverycited by 1
  18. 2026Towards Real-World Wearable Motion Reconstructioncited by 1
  19. 2026EgoExoMoCap: Distributed Ego-Exo Human Motion Capturecited by 1
  20. 2024PoseAugment: Generative Human Pose Data Augmentation with Physical Plausibility for IMU-based Motion Capturecited by 0
  21. 2025Efficient 3D Full-Body Motion Generation from Sparse Tracking Inputs with Temporal Windowscited by 0
  22. 2025MAGE:A Multi-stage Avatar Generator with Sparse Observationscited by 0
  23. 2025Diffusion Model-based Activity Completion for AI Motion Capture from Videoscited by 0
  24. 2025Cognitive State Inference from VR Motion via Motion Foundation Modelcited by 0
  25. 2025Zero-shot Human Pose Estimation using Diffusion-based Inverse solverscited by 0
  26. 2025Mem-MLP: Real-Time 3D Human Motion Generation from Sparse Inputscited by 0
  27. 2025OmniEgoCap: Camera-Agnostic Sequence-Level Egocentric Motion Reconstructioncited by 0
  28. 2026Dancing Points: Synthesizing Ballroom Dancing with Three-Point Inputscited by 0
  29. 2026Mocap Anywhere: Towards Pairwise-Distance based Motion Capture in the Wild (for the Wild)cited by 0
  30. 2026MotionMAR: Multi-scale Auto-Regressive Human Motion Reconstruction from Sparse Observationscited by 0
  31. 2026SkillSpotter: Pose-Aware Multi-View Skilled Action Detection and Grading in Ego-Exo Videoscited by 0
  32. 2026World Motion Models: Flexible Sequence Modeling of SE(3) Trajectoriescited by 0
  33. 2026Cepheid: Decoupling Scale from Structure for Cross-Family Motion Completioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023TrackDiffusion: Tracklet-Conditioned Video Generation via Diffusion Models
  2. 2023Guided Motion Diffusion for Controllable Human Motion Synthesis
  3. 2023Realistic Human Motion Generation with Cross-Diffusion Models
  4. 2022PhysDiff: Physics-Guided Human Motion Diffusion Model
  5. 2024SyncDiff: Synchronized Motion Diffusion for Multi-Body Human-Object Interaction Synthesis
  6. 2025SimDiff: Simulator-constrained Diffusion Model for Physically Plausible Motion Generation
  7. 2025DiffCap: Diffusion-based Real-time Human Motion Capture using Sparse IMUs and a Monocular Camera
  8. 2022Pretrained Diffusion Models for Unified Human Motion Synthesis