mlsanityData to 7 Oct 2026

Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordance

arXiv 2502.06145 ↗First posted 10 Feb 2025cs.CVcited by 60

On the map: Diffusion models → Video generation

Abstract (arXiv)

Recent character image animation methods based on diffusion models, such as Animate Anyone, have made significant progress in generating consistent and generalizable character animations. However, these approaches fail to produce reasonable associations between characters and their environments. To address this limitation, we introduce Animate Anyone 2, aiming to animate characters with environment affordance. Beyond extracting motion signals from source video, we additionally capture environmental representations as conditional inputs. The environment is formulated as the region with the exclusion of characters and our model generates characters to populate these regions while maintaining coherence with the environmental context. We propose a shape-agnostic mask strategy that more effectively characterizes the relationship between character and environment. Furthermore, to enhance the fidelity of object interactions, we leverage an object guider to extract features of interacting objects and employ spatial blending for feature injection. We also introduce a pose modulation strategy that enables the model to handle more diverse motion patterns. Experimental results demonstrate the superior performance of the proposed method.

Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 49 of its 61 references that are in the map. First posted on arXiv 10 Feb 2025.

Builds on

49 of 61 references.

Closest ancestors · 9

Same direction, newest first

  1. 2024TPC: Test-time Procrustes Calibration for Diffusion-based Human Image Animation31 Oct
  2. 2024TCAN: Animating Human Images with Temporally Consistent Pose Guidance using Diffusion Models12 Jul
  3. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation3 Jun
  4. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar
  5. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation28 Nov
  6. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model27 Nov
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  9. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr

Other references · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2023Segment Anythingcited by 8,158
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  9. 2017Neural Discrete Representation Learningcited by 4,650
  10. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  11. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  12. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
28 more
  1. 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 704
  2. 2020First Order Motion Model for Image Animationcited by 698
  3. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
  4. 2018Everybody Dance Nowcited by 313
  5. 2021Motion Representations for Articulated Animationcited by 253
  6. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
  7. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  8. 2022Thin-Plate Spline Motion Model for Image Animationcited by 209
  9. 2018Animating Arbitrary Objects via Deep Motion Transfercited by 206
  10. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
  11. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
  12. 2020Searching Central Difference Convolutional Networks for Face Anti-Spoofingcited by 173
  13. 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
  14. 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 114
  15. 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 85
  16. 2015face anti-spoofing based on color texture analysiscited by 82
  17. 2020Deep Spatial Gradient and Temporal Depth Learning for Face Anti-spoofingcited by 70
  18. 2022Exploring Dual-task Correlation for Pose Guided Person Image Generationcited by 68
  19. 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 63
  20. 2023Putting People in Their Place: Affordance-Aware Human Insertion into Scenescited by 53
  21. 2020Deep Spatial Transformation for Pose-Guided Person Image Generation and Animationcited by 43
  22. 2023Bidirectionally Deformable Motion Modulation For Video-based Human Pose Transfercited by 25
  23. 2024AnchorCrafter: Animate Cyber-Anchors Selling Your Products via Human-Object Interacting Video Generationcited by 25
  24. 2024MovieCharacter: A Tuning-Free Framework for Controllable Character Video Synthesiscited by 12
  25. 2024Text2Place: Affordance-aware Text Guided Human Placementcited by 11
  26. 2024InVi: Object Insertion In Videos Using Off-the-Shelf Diffusion Modelscited by 10
  27. 2024Dormant: Defending against Pose-driven Human Image Animationcited by 9
  28. 2023Synthesizing Environment-Specific People in Photographscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 36; 2026: 24.

60 papers.

Sort:

By area:

  1. 2025Controllable Video Generation: A Surveycited by 93
  2. 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 76
  3. 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 75
  4. 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
  5. 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
  6. 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
  7. 2025OmniVDiff: Omni Controllable Video Diffusion for Generation and Understandingcited by 22
  8. 2025DreamActor-H1: High-Fidelity Human-Product Demonstration Video Generation via Motion-designed Diffusion Transformerscited by 19
  9. 2025OmniV2V: Versatile Video Generation and Editing via Dynamic Content Manipulationcited by 18
  10. 2025Precise Action-to-Video Generation Through Visual Action Promptscited by 15
  11. 2025HumanDreamer-X: Photorealistic Single-image Human Avatars Reconstruction via Gaussian Restorationcited by 13
  12. 2025HunyuanVideo-HOMA: Generic Human-Object Interaction in Multimodal Driven Human Animationcited by 13
38 more
  1. 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Frameworkcited by 12
  2. 2025AniCrafter: Customizing Realistic Human-Centric Animation via Avatar-Background Conditioning in Video Diffusion Modelscited by 10
  3. 2025RealisMotion: Decomposed Human Motion Control and Video Generation in the World Spacecited by 10
  4. 2025SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservationcited by 10
  5. 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioningcited by 7
  6. 2025GenHSI: Controllable Generation of Human-Scene Interaction Videoscited by 6
  7. 2025ByteLoom: Weaving Geometry-Consistent Human-Object Interactions through Progressive Curriculum Learningcited by 6
  8. 2026Evolution of Video Generative Foundationscited by 6
  9. 2025AnimateAnywhere: Rouse the Background in Human Image Animationcited by 5
  10. 2025MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decouplingcited by 4
  11. 2025VHOI: Controllable Video Generation of Human-Object Interactions from Sparse Trajectories via Motion Densificationcited by 4
  12. 2025iDiT-HOI: Inpainting-based Hand Object Interaction Reenactment via Video Diffusion Transformercited by 3
  13. 2026Making Avatars Interact: Towards Text-Driven Human-Object Interaction for Controllable Talking Avatarscited by 3
  14. 2026MotionWeaver: Holistic 4D-Anchored Framework for Multi-Humanoid Image Animationcited by 3
  15. 2026Kling-MotionControl Technical Reportcited by 3
  16. 2026Gloria: Consistent Character Video Generation via Content Anchorscited by 3
  17. 2025MTVCraft: Tokenizing 4D Motion for Arbitrary Character Animationcited by 2
  18. 2025TalkingPose: Efficient Face and Gesture Animation with Feedback-guided Diffusion Modelcited by 2
  19. 2025Active Intelligence in Video Avatars via Closed-loop World Modelingcited by 2
  20. 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priorscited by 2
  21. 2026StreamHOI: Interaction-aware Temporal Memory Adaptation for Streaming HOI Video Generationcited by 2
  22. 2025LatentMove: Towards Complex Human Movement Video Generationcited by 1
  23. 2025FramePrompt: In-context Controllable Animation with Zero Structural Changescited by 1
  24. 2025UniTransfer: Video Concept Transfer via Progressive Spatial and Timestep Decompositioncited by 1
  25. 2025Preserving Source Video Realism: High-Fidelity Face Swapping for Cinematic Qualitycited by 1
  26. 2026Human Video Generation from a Single Image with 3D Pose and View Controlcited by 1
  27. 2026Image-to-Video Diffusion: From Foundations to Open Frontierscited by 1
  28. 2026Towards 3D-Aware Video Diffusion Models: Render-Free Human Motion Control with Mesh Tokenizationcited by 1
  29. 2025How Animals Dance (When You're Not Looking)cited by 0
  30. 2025Generating Fit Check Videos with a Handheld Cameracited by 0
  31. 2025DreamDance: Animating Character Art via Inpainting Stable Gaussian Worldscited by 0
  32. 2025Populate-A-Scene: Affordance-Aware Human Video Generationcited by 0
  33. 2025DreamSwapV: Mask-guided Subject Swapping for Any Customized Video Editingcited by 0
  34. 2025YingVideo-MV: Music-Driven Multi-Stage Video Generationcited by 0
  35. 2025Screen, Cache, and Match: A Training-Free Causality-Consistent Reference Frame Framework for Human Animationcited by 0
  36. 2026Controllable Complex Human Motion Video Generation via Text-to-Skeleton Cascadescited by 0
  37. 2026AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animationcited by 0
  38. 2026ONE-SHOT: Compositional Human-Environment Video Synthesis via Spatial-Decoupled Motion Injection and Hybrid Context Integrationcited by 0

50 most cited of 60 All 60 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026MultiAnimate: Pose-Guided Image Animation Made Extensible
  2. 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animation
  3. 2024Free-viewpoint Human Animation with Pose-correlated Reference Selection
  4. 2025AnyMoLe: Any Character Motion In-betweening Leveraging Video Diffusion Models
  5. 2025AnyI2V: Animating Any Conditional Image with Motion Control
  6. 2024AniFaceDiff: Animating Stylized Avatars via Parametric Conditioned Diffusion Models
  7. 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learning
  8. 2026IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation