mlsanityData to 7 Oct 2026

PoseGen: In-Context LoRA Finetuning for Pose-Controllable Long Human Video Generation

arXiv 2508.05091 ↗First posted 7 Aug 2025cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Generating temporally coherent, long-duration videos with precise control over subject identity and movement remains a fundamental challenge for contemporary diffusion-based models, which often suffer from identity drift and are limited to short video length. We present PoseGen, a novel framework that generates human videos of extended duration from a single reference image and a driving video. Our contributions include an in-context LoRA finetuning design that injects subject appearance at the token level for identity preservation, while simultaneously conditioning on pose information at the channel level for fine-grained motion control. To overcome duration limits, we introduce a segment-interleaved generation strategy, where non-overlapping segments are first generated with improved background consistency through a shared KV-cache mechanism, and then stitched into a continuous sequence via pose-aware interpolated generation. Despite being trained on a remarkably small 33-hour video dataset, PoseGen demonstrates superior performance over state-of-the-art baselines in identity fidelity, pose accuracy, and temporal consistency. Code is available at https://github.com/Jessie459/PoseGen .

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 46 of its 54 references that are in the map. First posted on arXiv 7 Aug 2025.

Builds on

46 of 54 references.

References · 46

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  8. 2022Scalable Diffusion Models with Transformerscited by 5,931
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  10. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  11. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  12. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
34 more
  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  2. 2024Qwen2 Technical Reportcited by 2,076
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  4. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  5. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
  6. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  7. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  8. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  9. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  10. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  11. 2025VACE: All-in-One Video Creation and Editingcited by 467
  12. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  13. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
  14. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
  15. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
  16. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 242
  17. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  18. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
  19. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
  20. 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 173
  21. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
  22. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
  23. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
  24. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 85
  25. 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
  26. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 73
  27. 2025HunyuanVideo-Avatar: High-Fidelity Audio-Driven Human Animation for Multiple Characterscited by 64
  28. 2025UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformercited by 40
  29. 2025HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generationcited by 38
  30. 2024RealisDance: Equip controllable character animation with realistic handscited by 37
  31. 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
  32. 2024DisPose: Disentangling Pose Guidance for Controllable Human Image Animationcited by 35
  33. 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
  34. 2025X-Dyna: Expressive Dynamic Human Image Animationcited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 6.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024PoseCrafter: One-Shot Personalized Video Synthesis Following Flexible Pose Control
  2. 2026ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis
  3. 2025LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformer
  4. 2026Controllable Complex Human Motion Video Generation via Text-to-Skeleton Cascades
  5. 2026LiveAnimate: Stable Long-Form Streaming Human Animation in Real-Time
  6. 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluation
  7. 2024VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation
  8. 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generation