mlsanityData to 7 Oct 2026

AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animation

arXiv 2603.15415 ↗First posted 16 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Controllable character animation has advanced rapidly in recent years, yet multi-character animation remains underexplored. As the number of characters grows, multi-character reference encoding becomes more susceptible to latent identity entanglement, resulting in identity bleeding and reduced controllability. Moreover, learning precise and spatio-temporally consistent correspondences between reference identities and driving pose sequences becomes increasingly challenging, often leading to identity-pose mis-binding and inconsistency in generated videos. To address these challenges, we propose AnyCrowd, a Diffusion Transformer (DiT)-based video generation framework capable of scaling to an arbitrary number of characters. Specifically, we first introduce an Instance-Isolated Latent Representation (IILR), which encodes character instances independently prior to DiT processing to prevent latent identity entanglement. Building on this disentangled representation, we further propose Tri-Stage Decoupled Attention (TSDA) to bind identities to driving poses by decomposing self-attention into: (i) instance-aware foreground attention, (ii) background-centric interaction, and (iii) global foreground-background coordination. Furthermore, to mitigate token ambiguity in overlapping regions, an Adaptive Gated Fusion (AGF) module is integrated within TSDA to predict identity-aware weights, effectively fusing competing token groups into identity-consistent representations...

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 54 of its 61 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

54 of 61 references.

References · 54

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  8. 2020Denoising Diffusion Implicit Modelscited by 9,655
  9. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  10. 2022Scalable Diffusion Models with Transformerscited by 5,931
  11. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
38 more
  1. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  4. 2022Video Diffusion Modelscited by 2,280
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  6. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  7. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  8. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  10. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  11. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
  12. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  13. 2020First Order Motion Model for Image Animationcited by 698
  14. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  15. 2025VACE: All-in-One Video Creation and Editingcited by 467
  16. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  17. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
  18. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  19. 2022Thin-Plate Spline Motion Model for Image Animationcited by 209
  20. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
  21. 2025HunyuanVideo 1.5 Technical Reportcited by 148
  22. 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 114
  23. 2019Dense Intrinsic Appearance Flow for Human Pose Transfercited by 104
  24. 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 91
  25. 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 86
  26. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 85
  27. 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 76
  28. 2022Exploring Dual-task Correlation for Pose Guided Person Image Generationcited by 68
  29. 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 63
  30. 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 60
  31. 2018Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesiscited by 59
  32. 2025UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformercited by 40
  33. 2024DisPose: Disentangling Pose Guidance for Controllable Human Image Animationcited by 35
  34. 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
  35. 2025FlexiAct: Towards Flexible Action Control in Heterogeneous Scenarioscited by 25
  36. 2024Towards Multiple Character Image Animation Through Enhancing Implicit Decouplingcited by 15
  37. 2025Multi-identity Human Image Animation with Structural Video Diffusioncited by 13
  38. 2025SCAIL: Towards Studio-Grade Character Animation via In-Context Learning of 3D-Consistent Pose Representationscited by 13

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MultiAnimate: Pose-Guided Image Animation Made Extensible
  2. 2026IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation
  3. 2025One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer
  4. 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learning
  5. 2026RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animation
  6. 2025DeX-Portrait: Disentangled and Expressive Portrait Animation via Explicit and Latent Motion Representations
  7. 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animation
  8. 2024Motion by Queries: Identity-Motion Trade-offs in Text-to-Video Generation