InterAnimate: Taming Region-aware Diffusion Model for Realistic Human Interaction Animation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent video generation research has focused heavily on isolated actions, leaving interactive motions-such as hand-face interactions-largely unexamined. These interactions are essential for emerging biometric authentication systems, which rely on interactive motion-based anti-spoofing approaches. From a security perspective, there is a growing need for large-scale, high-quality interactive videos to train and strengthen authentication models. In this work, we introduce a novel paradigm for animating realistic hand-face interactions. Our approach simultaneously learns spatio-temporal contact dynamics and biomechanically plausible deformation effects, enabling natural interactions where hand movements induce anatomically accurate facial deformations while maintaining collision-free contact. To facilitate this research, we present InterHF, a large-scale hand-face interaction dataset featuring 18 interaction patterns and 90,000 annotated videos. Additionally, we propose InterAnimate, a region-aware diffusion model designed specifically for interaction animation. InterAnimate leverages learnable spatial and temporal latents to effectively capture dynamic interaction priors and integrates a region-aware interaction mechanism that injects these priors into the denoising process. To the best of our knowledge, this work represents the first large-scale effort to systematically study human hand-face interactions. Qualitative and quantitative results show InterAnimate produces highly realistic animations, setting a new benchmark. Code and data will be made public to advance research.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 56 of its 71 references that are in the map. First posted on arXiv 15 Apr 2025.
Builds on
56 of 71 references.
Closest ancestors · 13
Same direction, newest first
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animation26 Nov
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editing13 Jun
- 2024VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation28 May
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar
- 2023HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Models11 Dec
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation28 Nov
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model27 Nov
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation13 Jun
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
Other references · 43
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
31 more
- 2021Motion Representations for Articulated Animationcited by 255
- 2023Object Motion Guided Human Motion Synthesiscited by 212
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 206
- 2024Taming Rectified Flow for Inversion and Editingcited by 204
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 182
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 142
- 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 124
- 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 88
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 67
- 2023Consistent123: One Image to Highly Consistent 3D Asset Using Case-Aware Diffusion Priorscited by 64
- 2024Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitivescited by 61
- 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 59
- 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Promptscited by 52
- 2023Face Animation with an Attribute-Guided Diffusion Modelcited by 48
- 2024MambaTalk: Efficient Holistic Gesture Synthesis with Selective State Space Modelscited by 46
- 2024REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignmentcited by 45
- 2024Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generationcited by 42
- 2024CyberHost: Taming Audio-driven Avatar Diffusion Model with Region Codebook Attentioncited by 39
- 2024DisPose: Disentangling Pose Guidance for Controllable Human Image Animationcited by 35
- 2024AnchorCrafter: Animate Cyber-Anchors Selling Your Products via Human-Object Interacting Video Generationcited by 26
- 2024HOI-Swap: Swapping Objects in Videos with Hand-Object Interaction Awarenesscited by 21
- 2024Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patternscited by 21
- 2025Audio-visual Controlled Video Diffusion with Masked Selective State Spaces Modeling for Natural Talking Head Generationcited by 17
- 2025MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animationcited by 14
- 2024UniQA: Unified Vision-Language Pre-training for Image Quality and Aesthetic Assessmentcited by 13
- 2024Alignment is All You Need: A Training-free Augmentation Strategy for Pose-guided Video Generationcited by 10
- 2024MergeUp-augmented Semi-Weakly Supervised Learning for WSI Classificationcited by 7
- 2025HVIS: A Human-like Vision and Inference System for Human Motion Predictioncited by 3
- 2023Saliency-based Video Summarization for Face Anti-spoofingcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026PreciseCache: Precise Feature Caching for Efficient and High-fidelity Video Generationcited by 8
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generationcited by 5
- 2025Creative4U: MLLMs-based Advertising Creative Image Selector with Comparative Reasoningcited by 2
- 2026Learning from Label Proportions with Dual-proportion Constraintscited by 0
- 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generation13 Apr 2026
- 2026Learning from Label Proportions with Dual-proportion Constraints22 Mar 2026
- 2026PreciseCache: Precise Feature Caching for Efficient and High-fidelity Video Generation1 Mar 2026
- 2025Creative4U: MLLMs-based Advertising Creative Image Selector with Comparative Reasoning18 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025TalkingPose: Efficient Face and Gesture Animation with Feedback-guided Diffusion Model
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions
- 2026HandX: Scaling Bimanual Motion and Interaction Generation
- 2025iDiT-HOI: Inpainting-based Hand Object Interaction Reenactment via Video Diffusion Transformer
- 2025SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction Scenarios
- 2026HarmoHOI: Harmonizing Appearance and 3D Motion for Multi-view Hand-Object Interaction Synthesis
- 2025Re-HOLD: Video Hand Object Interaction Reenactment via adaptive Layout-instructed Diffusion Model
- 2025Ponimator: Unfolding Interactive Pose for Versatile Human-human Interaction Animation