mlsanityData to 7 Oct 2026

MotionGRPO: Overcoming Low Intra-Group Diversity in GRPO-Based Egocentric Motion Recovery

arXiv 2605.05680 ↗First posted 7 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper studies full-body 3D human motion recovery from head-mounted device signals. Existing diffusion-based methods often rely on global distribution matching, leading to local joint reconstruction errors. We propose MotionGRPO, a novel framework leveraging reinforcement learning post-training to inject fine-grained guidance into the diffusion process. Technically, we model diffusion sampling as a Markov decision process optimized via Group Relative Policy Optimization (GRPO). To this end, we introduce a hybrid reward mechanism that combines a learned conditioned perceptual model for global visual plausibility and explicit constraints for local joint precision. Our key technical insight is that policy optimization in diffusion-based recovery suffers from vanishing gradients due to limited intra-group sample diversity. To address this, we further introduce a noise-injection strategy that explicitly increases sample variance and stabilizes learning. Extensive experiments demonstrate that MotionGRPO achieves state-of-the-art performance with superior visual fidelity

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 59 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

45 of 59 references.

References · 45

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2023GPT-4 Technical Reportcited by 18,132
  6. 2017Proximal Policy Optimization Algorithmscited by 14,441
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  9. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  10. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  11. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  12. 2017Deep reinforcement learning from human preferencescited by 3,846
33 more
  1. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  2. 2022Human Motion Diffusion Modelcited by 1,062
  3. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  4. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
  5. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  6. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
  7. 2023Reconstructing Hands in 3D with Transformerscited by 298
  8. 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 201
  9. 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
  10. 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
  11. 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 107
  12. 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 104
  13. 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
  14. 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 93
  15. 2019Ego-Pose Estimation and Forecasting as Real-Time PD Controlcited by 87
  16. 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 56
  17. 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
  18. 2023EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensorscited by 48
  19. 2023BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesiscited by 44
  20. 2024Mocap Everyone Everywhere: Lightweight Motion Capture With Smartwatches and a Head-Mounted Cameracited by 30
  21. 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 26
  22. 2024ReinDiffuse: Crafting Physically Plausible Motions with Reinforced Diffusion Modelcited by 25
  23. 2024PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion and Explicit Remeshingcited by 23
  24. 2024MultiGO: Towards Multi-level Geometry Learning for Monocular 3D Textured Human Reconstructioncited by 10
  25. 2025SCA3D: Enhancing Cross-modal 3D Retrieval via 3D Shape and Caption Paired Data Augmentationcited by 9
  26. 2025FastGRPO: Accelerating Policy Optimization via Concurrency-aware Speculative Decoding and Online Draft Learningcited by 7
  27. 2026OP-GRPO: Efficient Off-Policy GRPO for Flow-Matching Modelscited by 7
  28. 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimizationcited by 6
  29. 2025SAT: Supervisor Regularization and Animation Augmentation for Two-process Monocular Texture 3D Human Reconstructioncited by 4
  30. 2025SMPL Normal Map Is All You Need for Single-view Textured Human Reconstructioncited by 3
  31. 2025FastAnimate: Towards Learnable Template Construction and Pose Deformation for Fast 3D Human Avatar Animationcited by 2
  32. 2026VLM-Guided Group Preference Alignment for Diffusion-based Human Mesh Recoverycited by 2
  33. 2026MultiGO++: Monocular 3D Clothed Human Reconstruction via Geometry-Texture Collaborationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Co-GRPO: Co-Optimized Group Relative Policy Optimization for Masked Diffusion Model
  2. 2026Flash-GRPO: Efficient Alignment for Video Diffusion via One-Step Policy Optimization
  3. 2026MAR-GRPO: Stabilized GRPO for AR-diffusion Hybrid Image Generation
  4. 2025DanceGRPO: Unleashing GRPO on Visual Generation
  5. 2026FlowHMR: Physically Plausible Motion Capture from Video
  6. 2026DuoMo: Dual Motion Diffusion for World-Space Human Reconstruction
  7. 2025Consolidating Reinforcement Learning for Multimodal Discrete Diffusion Models
  8. 2026Pave-GRPO: Beyond Instantaneous Guidance through Principled Average Velocity Decomposition