CoDance: An Unbind-Rebind Paradigm for Robust Multi-Subject Animation
Not on the map. Why?
Abstract (arXiv)
Character image animation is gaining significant importance across various domains, driven by the demand for robust and flexible multi-subject rendering. While existing methods excel in single-person animation, they struggle to handle arbitrary subject counts, diverse character types, and spatial misalignment between the reference image and the driving poses. We attribute these limitations to an overly rigid spatial binding that forces strict pixel-wise alignment between the pose and reference, and an inability to consistently rebind motion to intended subjects. To address these challenges, we propose CoDance, a novel Unbind-Rebind framework that enables the animation of arbitrary subject counts, types, and spatial configurations conditioned on a single, potentially misaligned pose sequence. Specifically, the Unbind module employs a novel pose shift encoder to break the rigid spatial binding between the pose and the reference by introducing stochastic perturbations to both poses and their latent features, thereby compelling the model to learn a location-agnostic motion representation. To ensure precise control and subject association, we then devise a Rebind module, leveraging semantic guidance from text prompts and spatial guidance from subject masks to direct the learned motion to intended characters. Furthermore, to facilitate comprehensive evaluation, we introduce a new multi-subject CoDanceBench. Extensive experiments on CoDanceBench and existing datasets show that CoDance achieves SOTA performance, exhibiting remarkable generalization across diverse subjects and spatial layouts. The code and weights will be open-sourced.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 61 of its 82 references that are in the map. First posted on arXiv 16 Jan 2026.
Builds on
61 of 82 references.
References · 61
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
38 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2020First Order Motion Model for Image Animationcited by 704
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023Pix2Video: Video Editing using Image Diffusioncited by 320
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272
- 2021Motion Representations for Articulated Animationcited by 255
- 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 183
- 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
- 2023Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generationcited by 137
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 117
- 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 115
- 2019Dense Intrinsic Appearance Flow for Human Pose Transfercited by 104
- 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 102
- 2023SimDA: Simple Diffusion Adapter for Efficient Video Generationcited by 101
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 88
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 88
- 2023InstructVideo: Instructing Video Diffusion Models with Human Feedbackcited by 86
- 2024EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesiscited by 80
- 2023A Recipe for Scaling up Text-to-Video Generation with Text-free Videoscited by 51
- 2023Hierarchical Spatio-temporal Decoupling for Text-to-Video Generationcited by 50
- 2025MemFlow: Flowing Adaptive Memory for Consistent and Efficient Long Video Narrativescited by 45
- 2025UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformercited by 42
- 2024FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantizationcited by 39
- 2024Say Anything with Any Stylecited by 26
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
- 2023Check, Locate, Rectify: A Training-Free Layout Calibration System for Text-to-Image Generationcited by 19
- 2024Mimir: Improving Video Diffusion Models for Precise Text Understandingcited by 16
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026TransBiolab: A Real-World Multi-View Dataset of Cluttered Transparent Biomedical Objectscited by 1
- 2026AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animationcited by 0
- 2026SubtleTalk: Generating Controllable Weakly-correlated Facial Dynamics for 3D Talking Heads via Residual Flow Matchingcited by 0
- 2026SubtleTalk: Generating Controllable Weakly-correlated Facial Dynamics for 3D Talking Heads via Residual Flow Matching3 Aug 2026
- 2026TransBiolab: A Real-World Multi-View Dataset of Cluttered Transparent Biomedical Objects23 Jul 2026
- 2026AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animation16 Mar 2026