mlsanityData to 14 Oct 2026

InterAnimate: Taming Region-aware Diffusion Model for Realistic Human Interaction Animation

arXiv 2504.10905 ↗First posted 15 Apr 2025cs.CV cs.HCcited by 4

On the map: Diffusion models → Video generation

Abstract (arXiv)

Recent video generation research has focused heavily on isolated actions, leaving interactive motions-such as hand-face interactions-largely unexamined. These interactions are essential for emerging biometric authentication systems, which rely on interactive motion-based anti-spoofing approaches. From a security perspective, there is a growing need for large-scale, high-quality interactive videos to train and strengthen authentication models. In this work, we introduce a novel paradigm for animating realistic hand-face interactions. Our approach simultaneously learns spatio-temporal contact dynamics and biomechanically plausible deformation effects, enabling natural interactions where hand movements induce anatomically accurate facial deformations while maintaining collision-free contact. To facilitate this research, we present InterHF, a large-scale hand-face interaction dataset featuring 18 interaction patterns and 90,000 annotated videos. Additionally, we propose InterAnimate, a region-aware diffusion model designed specifically for interaction animation. InterAnimate leverages learnable spatial and temporal latents to effectively capture dynamic interaction priors and integrates a region-aware interaction mechanism that injects these priors into the denoising process. To the best of our knowledge, this work represents the first large-scale effort to systematically study human hand-face interactions. Qualitative and quantitative results show InterAnimate produces highly realistic animations, setting a new benchmark. Code and data will be made public to advance research.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 56 of its 71 references that are in the map. First posted on arXiv 15 Apr 2025.

Builds on

56 of 71 references.

Closest ancestors · 13

Same direction, newest first

  1. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animation26 Nov
  2. 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editing13 Jun
  3. 2024VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation28 May
  4. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar
  5. 2023HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Models11 Dec
  6. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation28 Nov
  7. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model27 Nov
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  9. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation13 Jun
  10. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
  11. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
  12. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
1 more
  1. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generation23 Nov

Other references · 43

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  6. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  8. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  9. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
  10. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  11. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
  12. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
31 more
  1. 2021Motion Representations for Articulated Animationcited by 255
  2. 2023Object Motion Guided Human Motion Synthesiscited by 212
  3. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 206
  4. 2024Taming Rectified Flow for Inversion and Editingcited by 204
  5. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
  6. 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
  7. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
  8. 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 142
  9. 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 124
  10. 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 88
  11. 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 67
  12. 2023Consistent123: One Image to Highly Consistent 3D Asset Using Case-Aware Diffusion Priorscited by 64
  13. 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 61
  14. 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 59
  15. 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Promptscited by 52
  16. 2023Face Animation with an Attribute-Guided Diffusion Modelcited by 48
  17. 2024MambaTalk: Efficient Holistic Gesture Synthesis with Selective State Space Modelscited by 46
  18. 2024REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignmentcited by 45
  19. 2024Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generationcited by 42
  20. 2024CyberHost: Taming Audio-driven Avatar Diffusion Model with Region Codebook Attentioncited by 39
  21. 2024DisPose: Disentangling Pose Guidance for Controllable Human Image Animationcited by 35
  22. 2024AnchorCrafter: Animate Cyber-Anchors Selling Your Products via Human-Object Interacting Video Generationcited by 26
  23. 2024HOI-Swap: Swapping Objects in Videos with Hand-Object Interaction Awarenesscited by 21
  24. 2024Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patternscited by 21
  25. 2025Audio-visual Controlled Video Diffusion with Masked Selective State Spaces Modeling for Natural Talking Head Generationcited by 17
  26. 2025MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animationcited by 14
  27. 2024UniQA: Unified Vision-Language Pre-training for Image Quality and Aesthetic Assessmentcited by 13
  28. 2024Alignment is All You Need: A Training-free Augmentation Strategy for Pose-guided Video Generationcited by 10
  29. 2024MergeUp-augmented Semi-Weakly Supervised Learning for WSI Classificationcited by 7
  30. 2025HVIS: A Human-like Vision and Inference System for Human Motion Predictioncited by 3
  31. 2023Saliency-based Video Summarization for Face Anti-spoofingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025TalkingPose: Efficient Face and Gesture Animation with Feedback-guided Diffusion Model
  2. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions
  3. 2026HandX: Scaling Bimanual Motion and Interaction Generation
  4. 2025iDiT-HOI: Inpainting-based Hand Object Interaction Reenactment via Video Diffusion Transformer
  5. 2025SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction Scenarios
  6. 2026HarmoHOI: Harmonizing Appearance and 3D Motion for Multi-view Hand-Object Interaction Synthesis
  7. 2025Re-HOLD: Video Hand Object Interaction Reenactment via adaptive Layout-instructed Diffusion Model
  8. 2025Ponimator: Unfolding Interactive Pose for Versatile Human-human Interaction Animation