mlsanityData to 7 Oct 2026

First Order Motion Model for Image Animation

arXiv 2003.00196 ↗First posted 29 Feb 2020cs.CV cs.AIcited by 698

Not on the map. Why?

Cited by 118 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Image animation consists of generating a video sequence so that an object in a source image is animated according to the motion of a driving video. Our framework addresses this problem without using any annotation or prior information about the specific object to animate. Once trained on a set of videos depicting objects of the same category (e.g. faces, human bodies), our method can be applied to any object of this class. To achieve this, we decouple appearance and motion information using a self-supervised formulation. To support complex motions, we use a representation consisting of a set of learned keypoints along with their local affine transformations. A generator network models occlusions arising during target motions and combines the appearance extracted from the source image and the motion derived from the driving video. Our framework scores best on diverse benchmarks and on a variety of object categories. Our source code is publicly available.

Key facts. Cited by 698 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Feb 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 82; 2022: 111; 2023: 123; 2024: 154; 2025: 155; 2026: 73.

698 papers.

Sort:

By area:

  1. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  2. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
  3. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  4. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
  5. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
  6. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
  7. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 330
  8. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  9. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 300
  10. 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
  11. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  12. 2021Motion Representations for Articulated Animationcited by 253
38 more
  1. 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
  2. 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
  3. 2021Neural Head Avatars from Monocular RGB Videoscited by 212
  4. 2022Thin-Plate Spline Motion Model for Image Animationcited by 209
  5. 2023A Survey on Video Diffusion Modelscited by 203
  6. 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
  7. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
  8. 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
  9. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
  10. 2022Generating Videos with Dynamics-aware Implicit Generative Adversarial Networkscited by 186
  11. 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
  12. 2023Conditional Image-to-Video Generation with Latent Flow Diffusion Modelscited by 180
  13. 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
  14. 2022Latent Image Animator: Learning to Animate Images via Latent Space Navigationcited by 172
  15. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
  16. 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
  17. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
  18. 2022EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Modelcited by 151
  19. 2021Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motioncited by 148
  20. 2023Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generationcited by 142
  21. 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
  22. 2022MegaPortraits: One-shot Megapixel Neural Head Avatarscited by 131
  23. 2022Reconstructing Personalized Semantic Facial NeRF Models From Monocular Videocited by 128
  24. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
  25. 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
  26. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 126
  27. 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
  28. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
  29. 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformercited by 121
  30. 2022Realistic One-shot Mesh-based Head Avatarscited by 119
  31. 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
  32. 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
  33. 2022VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wildcited by 106
  34. 2023VDT: General-purpose Video Diffusion Transformers via Mask Modelingcited by 102
  35. 2024Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependencycited by 102
  36. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
  37. 2023Motion-Conditioned Diffusion Model for Controllable Video Synthesiscited by 99
  38. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97

50 most cited of 698 All 698 (JSON)