mlsanityData to 7 Oct 2026

Human detectors are surprisingly powerful reward models

arXiv 2601.14037 ↗First posted 15 Jan 2026cs.CVcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Video generation models have recently achieved impressive visual fidelity and temporal coherence. Yet, they continue to struggle with complex, non-rigid motions, especially when synthesizing humans performing dynamic actions such as sports, dance, etc. Generated videos often exhibit missing or extra limbs, distorted poses, or physically implausible actions. In this work, we propose a remarkably simple reward model, HuDA, to quantify and improve the human motion in generated videos. HuDA integrates human detection confidence for appearance quality, and a temporal prompt alignment score to capture motion realism. We show this simple reward function that leverages off-the-shelf models without any additional training, outperforms specialized models finetuned with manually annotated data. Using HuDA for Group Reward Policy Optimization (GRPO) post-training of video models, we significantly enhance video generation, especially when generating complex human motions, outperforming state-of-the-art models like Wan 2.1, with win-rate of 73%. Finally, we demonstrate that HuDA improves generation quality beyond just humans, for instance, significantly improving generation of animal videos and human-object interactions.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 44 of its 46 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

44 of 46 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
  2. 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generation18 Dec
  3. 2024Boost Your Human Image Generation Model via Direct Preference Optimization30 May
  4. 2024Curriculum Direct Preference Optimization for Diffusion and Consistency Models22 May
  5. 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov

Other references · 39

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2017Mask R-CNNcited by 7,259
  5. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  7. 2023Qwen Technical Reportcited by 3,273
  8. 2015Fast R-CNNcited by 2,930
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  11. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  12. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
27 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  2. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  3. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  4. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
  5. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  6. 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
  7. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  8. 2023ModelScope Text-to-Video Technical Reportcited by 651
  9. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  10. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  11. 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
  12. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
  13. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  14. 2018Stochastic Video Generation with a Learned Priorcited by 244
  15. 2023Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generationcited by 137
  16. 2023Diffusion-Based 3D Human Pose Estimation with Multi-Hypothesis Aggregationcited by 81
  17. 2019VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generationcited by 74
  18. 2020Exploring Spatial-Temporal Multi-Frequency Analysis for High-Fidelity and Temporal-Consistency Video Predictioncited by 52
  19. 2022Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioningcited by 37
  20. 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
  21. 2024HumanRefiner: Benchmarking Abnormal Human Generation and Refining with Coarse-to-fine Pose-Reversible Guidancecited by 24
  22. 2025HumanDreamer: Generating Controllable Human-Motion Videos via Decoupled Generationcited by 19
  23. 2021Comparing Correspondences: Video Prediction with Correspondence-wise Lossescited by 16
  24. 2024Is this Generated Person Existed in Real-world? Fine-grained Detecting and Calibrating Abnormal Human-bodycited by 12
  25. 2024HEIE: MLLM-Based Hierarchical Explainable AIGC Image Implausibility Evaluatorcited by 12
  26. 2025FinePhys: Fine-grained Human Action Generation by Explicitly Incorporating Physical Laws for Effective Skeletal Guidancecited by 9
  27. 2018Conditional Video Generation Using Action-Appearance Captionscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Generating Human Motion Videos using a Cascaded Text-to-Video Framework
  2. 2025Video Generation Models Are Good Latent Reward Models
  3. 2025Improving Video Generation with Human Feedback
  4. 2024OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generation
  5. 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generation
  6. 2026CoRe: Co-Evolving Reward Models for Mitigating Latent Reward Hacking in Video Diffusion Models
  7. 2026Aligning Human Sense: Calibrated Distributional Reward Learning for Video Generation
  8. 2025Generative Action Tell-Tales: Assessing Human Motion in Synthesized Videos