MotionGRPO: Overcoming Low Intra-Group Diversity in GRPO-Based Egocentric Motion Recovery
Not on the map. Why?
Abstract (arXiv)
This paper studies full-body 3D human motion recovery from head-mounted device signals. Existing diffusion-based methods often rely on global distribution matching, leading to local joint reconstruction errors. We propose MotionGRPO, a novel framework leveraging reinforcement learning post-training to inject fine-grained guidance into the diffusion process. Technically, we model diffusion sampling as a Markov decision process optimized via Group Relative Policy Optimization (GRPO). To this end, we introduce a hybrid reward mechanism that combines a learned conditioned perceptual model for global visual plausibility and explicit constraints for local joint precision. Our key technical insight is that policy optimization in diffusion-based recovery suffers from vanishing gradients due to limited intra-group sample diversity. To address this, we further introduce a noise-injection strategy that explicitly increases sample variance and stabilizes learning. Extensive experiments demonstrate that MotionGRPO achieves state-of-the-art performance with superior visual fidelity
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 59 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
45 of 59 references.
References · 45
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2017Deep reinforcement learning from human preferencescited by 3,846
33 more
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2022Human Motion Diffusion Modelcited by 1,062
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
- 2023Reconstructing Hands in 3D with Transformerscited by 298
- 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 201
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
- 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 107
- 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 104
- 2021Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimationcited by 101
- 2022Ego-Body Pose Estimation via Ego-Head Pose Estimationcited by 93
- 2019Ego-Pose Estimation and Forecasting as Real-Time PD Controlcited by 87
- 2024Estimating Body and Hand Motion in an Ego-sensed Worldcited by 56
- 2024IDOL: Instant Photorealistic 3D Human Creation from a Single Imagecited by 55
- 2023EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensorscited by 48
- 2023BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesiscited by 44
- 2024Mocap Everyone Everywhere: Lightweight Motion Capture With Smartwatches and a Head-Mounted Cameracited by 30
- 2024HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Devicecited by 26
- 2024ReinDiffuse: Crafting Physically Plausible Motions with Reinforced Diffusion Modelcited by 25
- 2024PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion and Explicit Remeshingcited by 23
- 2024MultiGO: Towards Multi-level Geometry Learning for Monocular 3D Textured Human Reconstructioncited by 10
- 2025SCA3D: Enhancing Cross-modal 3D Retrieval via 3D Shape and Caption Paired Data Augmentationcited by 9
- 2025FastGRPO: Accelerating Policy Optimization via Concurrency-aware Speculative Decoding and Online Draft Learningcited by 7
- 2026OP-GRPO: Efficient Off-Policy GRPO for Flow-Matching Modelscited by 7
- 2025ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimizationcited by 6
- 2025SAT: Supervisor Regularization and Animation Augmentation for Two-process Monocular Texture 3D Human Reconstructioncited by 4
- 2025SMPL Normal Map Is All You Need for Single-view Textured Human Reconstructioncited by 3
- 2025FastAnimate: Towards Learnable Template Construction and Pose Deformation for Fast 3D Human Avatar Animationcited by 2
- 2026VLM-Guided Group Preference Alignment for Diffusion-based Human Mesh Recoverycited by 2
- 2026MultiGO++: Monocular 3D Clothed Human Reconstruction via Geometry-Texture Collaborationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Co-GRPO: Co-Optimized Group Relative Policy Optimization for Masked Diffusion Model
- 2026Flash-GRPO: Efficient Alignment for Video Diffusion via One-Step Policy Optimization
- 2026MAR-GRPO: Stabilized GRPO for AR-diffusion Hybrid Image Generation
- 2025DanceGRPO: Unleashing GRPO on Visual Generation
- 2026FlowHMR: Physically Plausible Motion Capture from Video
- 2026DuoMo: Dual Motion Diffusion for World-Space Human Reconstruction
- 2025Consolidating Reinforcement Learning for Multimodal Discrete Diffusion Models
- 2026Pave-GRPO: Beyond Instantaneous Guidance through Principled Average Velocity Decomposition