MotionWeaver: Holistic 4D-Anchored Framework for Multi-Humanoid Image Animation
Not on the map. Why?
Abstract (arXiv)
Character image animation, which synthesizes videos of reference characters driven by pose sequences, has advanced rapidly but remains largely limited to single-human settings. Existing methods struggle to generalize to multi-humanoid scenarios, which involve diverse humanoid forms, complex interactions, and frequent occlusions. We address this gap with two key innovations. First, we introduce unified motion representations that extract identity-agnostic motions and explicitly bind them to corresponding characters, enabling generalization across diverse humanoid forms and seamless extension to multi-humanoid scenarios. Second, we propose a holistic 4D-anchored paradigm that constructs a shared 4D space to fuse motion representations with video latents, and further reinforces this process with hierarchical 4D-level supervision to better handle interactions and occlusions. We instantiate these ideas in MotionWeaver, an end-to-end framework for multi-humanoid image animation. To support this setting, we curate a 46-hour dataset of multi-human videos with rich interactions, and construct a 300-video benchmark featuring paired humanoid characters. Quantitative and qualitative experiments demonstrate that MotionWeaver not only achieves state-of-the-art results on our benchmark but also generalizes effectively across diverse humanoid forms, complex interactions, and challenging multi-humanoid scenarios.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 70 of its 82 references that are in the map. First posted on arXiv 11 Feb 2026.
Builds on
70 of 82 references.
References · 70
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
38 more
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2023Reconstructing Hands in 3D with Transformerscited by 298
- 2019Character Region Awareness for Text Detectioncited by 273
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2021Motion Representations for Articulated Animationcited by 253
- 2022A Survey on Generative Diffusion Modelcited by 238
- 2023A Survey on Video Diffusion Modelscited by 203
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2017Deformable GANs for Pose-based Human Image Generationcited by 166
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
- 2024Training-free Camera Control for Video Generationcited by 119
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
- 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 114
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
- 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 88
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 86
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 85
- 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 63
- 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 63
- 2024Human4DiT: 360-degree Human Video Generation with 4D Diffusion Transformercited by 61
- 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 60
- 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 55
- 2023Putting People in Their Place: Affordance-Aware Human Insertion into Scenescited by 53
- 2025VolSplat: Rethinking Feed-Forward 3D Gaussian Splatting with Voxel-Aligned Predictioncited by 41
- 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editingcited by 38
- 2025HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generationcited by 38
- 2024RealisDance: Equip controllable character animation with realistic handscited by 37
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2024DisPose: Disentangling Pose Guidance for Controllable Human Image Animationcited by 35
- 2024MotionFollower: Editing Video Motion via Lightweight Score-Guided Diffusioncited by 29
- 2025ZPressor: Bottleneck-Aware Compression for Scalable Feed-Forward 3DGScited by 29
- 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
- 2025EchoShot: Multi-Shot Portrait Video Generationcited by 28
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026WeLike2Party! In-Context Motion Transfer for Multi-Human Image Animation29 Sep 2026
- 2026AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual References26 Mar 2026
- 2026DepthArb: Training-Free Depth-Arbitrated Generation for Occlusion-Robust Image Synthesis25 Mar 2026