MultiAnimate: Pose-Guided Image Animation Made Extensible
Not on the map. Why?
Abstract (arXiv)
Pose-guided human image animation aims to synthesize realistic videos of a reference character driven by a sequence of poses. While diffusion-based methods have achieved remarkable success, most existing approaches are limited to single-character animation. We observe that naively extending these methods to multi-character scenarios often leads to identity confusion and implausible occlusions between characters. To address these challenges, in this paper, we propose an extensible multi-character image animation framework built upon modern Diffusion Transformers (DiTs) for video generation. At its core, our framework introduces two novel components-Identifier Assigner and Identifier Adapter - which collaboratively capture per-person positional cues and inter-person spatial relationships. This mask-driven scheme, along with a scalable training strategy, not only enhances flexibility but also enables generalization to scenarios with more characters than those seen during training. Remarkably, trained on only a two-character dataset, our model generalizes to multi-character animation while maintaining compatibility with single-character cases. Extensive experiments demonstrate that our approach achieves state-of-the-art performance in multi-character image animation, surpassing existing diffusion-based baselines.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 42 of its 49 references that are in the map. First posted on arXiv 25 Feb 2026.
Builds on
42 of 49 references.
References · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
30 more
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Video Diffusion Modelscited by 2,280
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
- 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 154
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 85
- 2023GenTron: Diffusion Transformers for Image and Video Generationcited by 80
- 2025dParallel: Learnable Parallel Decoding for dLLMscited by 59
- 2024MambaTalk: Efficient Holistic Gesture Synthesis with Selective State Space Modelscited by 46
- 2024Evaluation Agent: Efficient and Promptable Evaluation Framework for Visual Generative Modelscited by 41
- 2024MovieBench: A Hierarchical Movie Level Dataset for Long Video Generationcited by 35
- 2024DisPose: Disentangling Pose Guidance for Controllable Human Image Animationcited by 35
- 2024VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animationcited by 27
- 2024Relational Diffusion Distillation for Efficient Image Generationcited by 24
- 2025Q-VDiT: Towards Accurate Quantization and Distillation of Video-Generation Diffusion Transformerscited by 20
- 2025SparseD: Sparse Attention for Diffusion Language Modelscited by 16
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 12
- 2024Synergy and Synchrony in Couple Dancescited by 8
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioningcited by 7
- 2026LiveAnimate: Stable Long-Form Streaming Human Animation in Real-Timecited by 1
- 2026UniMoCa: Unifying Motion and Camera Controls as Visual Proxies for Faithful Human Video Generationcited by 0
- 2026Vorch-IR: Long-Form Unified Multimodal Identity Replacement Video Generationcited by 0
- 2026PAI-Actor: Cinematic Multi-Character Replacement in Dynamic Scenescited by 0
- 2026WeLike2Party! In-Context Motion Transfer for Multi-Human Image Animationcited by 0
- 2026WeLike2Party! In-Context Motion Transfer for Multi-Human Image Animation29 Sep 2026
- 2026PAI-Actor: Cinematic Multi-Character Replacement in Dynamic Scenes5 Sep 2026
- 2026LiveAnimate: Stable Long-Form Streaming Human Animation in Real-Time12 Aug 2026
- 2026Vorch-IR: Long-Form Unified Multimodal Identity Replacement Video Generation6 Aug 2026
- 2026UniMoCa: Unifying Motion and Camera Controls as Visual Proxies for Faithful Human Video Generation3 Aug 2026
- 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioning9 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer
- 2024Free-viewpoint Human Animation with Pose-correlated Reference Selection
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation
- 2026AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animation
- 2025Multi-identity Human Image Animation with Structural Video Diffusion
- 2026IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation
- 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learning
- 2025DynamiCtrl: Rethinking the Basic Structure and the Role of Text for High-quality Human Image Animation