PoseGen: In-Context LoRA Finetuning for Pose-Controllable Long Human Video Generation
Not on the map. Why?
Abstract (arXiv)
Generating temporally coherent, long-duration videos with precise control over subject identity and movement remains a fundamental challenge for contemporary diffusion-based models, which often suffer from identity drift and are limited to short video length. We present PoseGen, a novel framework that generates human videos of extended duration from a single reference image and a driving video. Our contributions include an in-context LoRA finetuning design that injects subject appearance at the token level for identity preservation, while simultaneously conditioning on pose information at the channel level for fine-grained motion control. To overcome duration limits, we introduce a segment-interleaved generation strategy, where non-overlapping segments are first generated with improved background consistency through a shared KV-cache mechanism, and then stitched into a continuous sequence via pose-aware interpolated generation. Despite being trained on a remarkably small 33-hour video dataset, PoseGen demonstrates superior performance over state-of-the-art baselines in identity fidelity, pose accuracy, and temporal consistency. Code is available at https://github.com/Jessie459/PoseGen .
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 46 of its 54 references that are in the map. First posted on arXiv 7 Aug 2025.
Builds on
46 of 54 references.
References · 46
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
34 more
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2024Qwen2 Technical Reportcited by 2,076
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 242
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
- 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 173
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
- 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 85
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 73
- 2025HunyuanVideo-Avatar: High-Fidelity Audio-Driven Human Animation for Multiple Characterscited by 64
- 2025UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformercited by 40
- 2025HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generationcited by 38
- 2024RealisDance: Equip controllable character animation with realistic handscited by 37
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2024DisPose: Disentangling Pose Guidance for Controllable Human Image Animationcited by 35
- 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
- 2025X-Dyna: Expressive Dynamic Human Image Animationcited by 18
Built on by
Citing papers per year: 2025: 2; 2026: 6.
8 papers.
- 2026Efficient Video Diffusion Models: Advancements and Challengescited by 6
- 2026AVControl: Efficient Framework for Training Audio-Visual Controlscited by 5
- 2026CoMoVi: Co-Generation of 3D Human Motions and Realistic Videoscited by 4
- 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learningcited by 4
- 2025In-Context Sync-LoRA for Portrait Video Editingcited by 3
- 2026EverAnimate: Minute-Scale Human Animation via Latent Flow Restorationcited by 3
- 2025Screen, Cache, and Match: A Training-Free Causality-Consistent Reference Frame Framework for Human Animationcited by 0
- 2026GroupVideo: Multi-Identity Customized Text-to-Video Generationcited by 0
- 2026GroupVideo: Multi-Identity Customized Text-to-Video Generation23 Jul 2026
- 2026EverAnimate: Minute-Scale Human Animation via Latent Flow Restoration14 May 2026
- 2026Efficient Video Diffusion Models: Advancements and Challenges17 Apr 2026
- 2026AVControl: Efficient Framework for Training Audio-Visual Controls25 Mar 2026
- 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learning29 Jan 2026
- 2026CoMoVi: Co-Generation of 3D Human Motions and Realistic Videos15 Jan 2026
- 2025Screen, Cache, and Match: A Training-Free Causality-Consistent Reference Frame Framework for Human Animation13 Dec 2025
- 2025In-Context Sync-LoRA for Portrait Video Editing2 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2024PoseCrafter: One-Shot Personalized Video Synthesis Following Flexible Pose Control
- 2026ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis
- 2025LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformer
- 2026Controllable Complex Human Motion Video Generation via Text-to-Skeleton Cascades
- 2026LiveAnimate: Stable Long-Form Streaming Human Animation in Real-Time
- 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluation
- 2024VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation
- 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generation