mlsanityData to 14 Oct 2026

CoDance: An Unbind-Rebind Paradigm for Robust Multi-Subject Animation

arXiv 2601.11096 ↗First posted 16 Jan 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Character image animation is gaining significant importance across various domains, driven by the demand for robust and flexible multi-subject rendering. While existing methods excel in single-person animation, they struggle to handle arbitrary subject counts, diverse character types, and spatial misalignment between the reference image and the driving poses. We attribute these limitations to an overly rigid spatial binding that forces strict pixel-wise alignment between the pose and reference, and an inability to consistently rebind motion to intended subjects. To address these challenges, we propose CoDance, a novel Unbind-Rebind framework that enables the animation of arbitrary subject counts, types, and spatial configurations conditioned on a single, potentially misaligned pose sequence. Specifically, the Unbind module employs a novel pose shift encoder to break the rigid spatial binding between the pose and the reference by introducing stochastic perturbations to both poses and their latent features, thereby compelling the model to learn a location-agnostic motion representation. To ensure precise control and subject association, we then devise a Rebind module, leveraging semantic guidance from text prompts and spatial guidance from subject masks to direct the learned motion to intended characters. Furthermore, to facilitate comprehensive evaluation, we introduce a new multi-subject CoDanceBench. Extensive experiments on CoDanceBench and existing datasets show that CoDance achieves SOTA performance, exhibiting remarkable generalization across diverse subjects and spatial layouts. The code and weights will be open-sourced.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 61 of its 82 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

61 of 82 references.

References · 61

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  10. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  12. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
38 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  3. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  4. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  5. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  6. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  7. 2020First Order Motion Model for Image Animationcited by 704
  8. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  9. 2023ModelScope Text-to-Video Technical Reportcited by 658
  10. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
  11. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  12. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  13. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272
  14. 2021Motion Representations for Articulated Animationcited by 255
  15. 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
  16. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
  17. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 183
  18. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
  19. 2023Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generationcited by 137
  20. 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 117
  21. 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 115
  22. 2019Dense Intrinsic Appearance Flow for Human Pose Transfercited by 104
  23. 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
  24. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 102
  25. 2023SimDA: Simple Diffusion Adapter for Efficient Video Generationcited by 101
  26. 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 88
  27. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 88
  28. 2023InstructVideo: Instructing Video Diffusion Models with Human Feedbackcited by 86
  29. 2024EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesiscited by 80
  30. 2023A Recipe for Scaling up Text-to-Video Generation with Text-free Videoscited by 51
  31. 2023Hierarchical Spatio-temporal Decoupling for Text-to-Video Generationcited by 50
  32. 2025MemFlow: Flowing Adaptive Memory for Consistent and Efficient Long Video Narrativescited by 45
  33. 2025UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformercited by 42
  34. 2024FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantizationcited by 39
  35. 2024Say Anything with Any Stylecited by 26
  36. 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
  37. 2023Check, Locate, Rectify: A Training-Free Layout Calibration System for Text-to-Image Generationcited by 19
  38. 2024Mimir: Improving Video Diffusion Models for Precise Text Understandingcited by 16

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.