Human detectors are surprisingly powerful reward models
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Video generation models have recently achieved impressive visual fidelity and temporal coherence. Yet, they continue to struggle with complex, non-rigid motions, especially when synthesizing humans performing dynamic actions such as sports, dance, etc. Generated videos often exhibit missing or extra limbs, distorted poses, or physically implausible actions. In this work, we propose a remarkably simple reward model, HuDA, to quantify and improve the human motion in generated videos. HuDA integrates human detection confidence for appearance quality, and a temporal prompt alignment score to capture motion realism. We show this simple reward function that leverages off-the-shelf models without any additional training, outperforms specialized models finetuned with manually annotated data. Using HuDA for Group Reward Policy Optimization (GRPO) post-training of video models, we significantly enhance video generation, especially when generating complex human motions, outperforming state-of-the-art models like Wan 2.1, with win-rate of 73%. Finally, we demonstrate that HuDA improves generation quality beyond just humans, for instance, significantly improving generation of animal videos and human-object interactions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 44 of its 46 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
44 of 46 references.
Closest ancestors · 5
Same direction, newest first
- 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
- 2024Boost Your Human Image Generation Model via Direct Preference Optimization30 May
- 2024Curriculum Direct Preference Optimization for Diffusion and Consistency Models22 May
- 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov
Other references · 39
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2017Mask R-CNNcited by 7,259
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2023Qwen Technical Reportcited by 3,273
- 2015Fast R-CNNcited by 2,930
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
27 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
- 2023ModelScope Text-to-Video Technical Reportcited by 651
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2018Stochastic Video Generation with a Learned Priorcited by 244
- 2023Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generationcited by 137
- 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 81
- 2019VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generationcited by 74
- 2020Exploring Spatial-Temporal Multi-Frequency Analysis for High-Fidelity and Temporal-Consistency Video Predictioncited by 52
- 2022Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioningcited by 37
- 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
- 2024HumanRefiner: Benchmarking Abnormal Human Generation and Refining with Coarse-to-fine Pose-Reversible Guidancecited by 24
- 2025HumanDreamer: Generating Controllable Human-Motion Videos via Decoupled Generationcited by 19
- 2021Comparing Correspondences: Video Prediction with Correspondence-wise Lossescited by 16
- 2024Is this Generated Person Existed in Real-world? Fine-grained Detecting and Calibrating Abnormal Human-bodycited by 12
- 2024HEIE: MLLM-Based Hierarchical Explainable AIGC Image Implausibility Evaluatorcited by 12
- 2025FinePhys: Fine-grained Human Action Generation by Explicitly Incorporating Physical Laws for Effective Skeletal Guidancecited by 9
- 2018Conditional Video Generation Using Action-Appearance Captionscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Advances in GRPO for Generation Models: A Surveycited by 1
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Generating Human Motion Videos using a Cascaded Text-to-Video Framework
- 2025Video Generation Models Are Good Latent Reward Models
- 2025Improving Video Generation with Human Feedback
- 2024OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generation
- 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generation
- 2026CoRe: Co-Evolving Reward Models for Mitigating Latent Reward Hacking in Video Diffusion Models
- 2026Aligning Human Sense: Calibrated Distributional Reward Learning for Video Generation
- 2025Generative Action Tell-Tales: Assessing Human Motion in Synthesized Videos