mlsanityData to 7 Oct 2026

Implicit Warping for Animation with Image Sets

arXiv 2210.01794 ↗First posted 4 Oct 2022cs.CVcited by 45

Not on the map. Why?

Abstract (arXiv)

We present a new implicit warping framework for image animation using sets of source images through the transfer of the motion of a driving video. A single cross- modal attention layer is used to find correspondences between the source images and the driving image, choose the most appropriate features from different source images, and warp the selected features. This is in contrast to the existing methods that use explicit flow-based warping, which is designed for animation using a single source and does not extend well to multiple sources. The pick-and-choose capability of our framework helps it achieve state-of-the-art results on multiple datasets for image animation using both single and multiple source images. The project website is available at https://deepimagination.cc/implicit warping/

Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 46 of its 54 references that are in the map. First posted on arXiv 4 Oct 2022.

Builds on

46 of 54 references.

References · 46

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2017Squeeze-and-Excitation Networkscited by 4,763
  6. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  7. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  8. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  9. 2017Non-local Neural Networkscited by 2,290
  10. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  11. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  12. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
34 more
  1. 2018Image Transformercited by 770
  2. 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 717
  3. 2020First Order Motion Model for Image Animationcited by 698
  4. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  5. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  6. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  7. 2017Residual Attention Network for Image Classificationcited by 385
  8. 2020Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentationcited by 326
  9. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
  10. 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
  11. 2019Cross-Modal Self-Attention Network for Referring Image Segmentationcited by 263
  12. 2021Motion Representations for Articulated Animationcited by 253
  13. 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
  14. 2018Talking Face Generation by Adversarially Disentangled Audio-Visual Representationcited by 212
  15. 2018Animating Arbitrary Objects via Deep Motion Transfercited by 206
  16. 2019Few-shot Video-to-Video Synthesiscited by 196
  17. 2018X2Face: A network for controlling face generation by using images, audio, and pose codescited by 189
  18. 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
  19. 2018GANimation: Anatomically-aware Facial Animation from a Single Imagecited by 160
  20. 2019Realistic Speech-Driven Facial Animation with GANscited by 142
  21. 2021Generative Adversarial Transformerscited by 120
  22. 2020Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatarscited by 116
  23. 2020Neural Head Reenactment with Latent Pose Descriptorscited by 106
  24. 2020HeadGAN: One-shot Neural Head Synthesis and Editingcited by 105
  25. 2017You said that?cited by 99
  26. 2021Geometry-Free View Synthesis: Transformers and no 3D Priorscited by 99
  27. 2019MarioNETte: Few-shot Face Reenactment Preserving Identity of Unseen Targetscited by 90
  28. 2018Recycle-GAN: Unsupervised Video Retargetingcited by 89
  29. 2018ReenactGAN: Learning to Reenact Faces via Boundary Transfercited by 85
  30. 2018Talking Face Generation by Conditional Recurrent Adversarial Networkcited by 84
  31. 2022Look Outside the Room: Synthesizing A Consistent Long-Term 3D Scene Video from A Single Imagecited by 55
  32. 2021High-Resolution Optical Flow from 1D Attention and Correlationcited by 54
  33. 2019FLNet: Landmark Driven Fetching and Learning Network for Faithful Talking Facial Animation Synthesiscited by 28
  34. 2021CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representationscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 11; 2024: 14; 2025: 14; 2026: 3.

45 papers.

Sort:

By area:

  1. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  2. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
  3. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  4. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
  5. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
  6. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
  7. 2023Generative Image Dynamicscited by 93
  8. 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
  9. 2023One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Fieldcited by 68
  10. 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 65
  11. 2023StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Videocited by 52
  12. 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Promptscited by 52
33 more
  1. 2022SPACE: Speech-driven Portrait Animation with Controllable Expressioncited by 49
  2. 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 26
  3. 2023Unsupervised Volumetric Animationcited by 18
  4. 2024PERSE: Personalized 3D Generative Avatars from A Single Portraitcited by 15
  5. 2024MobilePortrait: Real-Time One-Shot Neural Head Avatars on Mobile Devicescited by 12
  6. 2025Tora2: Motion and Appearance Customized Diffusion Transformer for Multi-Entity Video Generationcited by 12
  7. 2023Avatar Fingerprinting for Authorized Use of Synthetic Talking-Head Videoscited by 11
  8. 2024IDOL: Unified Dual-Modal Latent Diffusion for Human-Centric Joint Video-Depth Generationcited by 11
  9. 2024Norface: Improving Facial Expression Analysis by Identity Normalizationcited by 10
  10. 2023Learning Motion Refinement for Unsupervised Face Animationcited by 7
  11. 2024Enhancing Sketch Animation: Text-to-Video Diffusion Models with Temporal Consistency and Rigidity Constraintscited by 7
  12. 2024A Comprehensive Taxonomy and Analysis of Talking Head Synthesis: Techniques for Portrait Generation, Driving Mechanisms, and Editingcited by 4
  13. 2024Takin-ADA: Emotion Controllable Audio-Driven Animation with Canonical and Landmark Loss Optimizationcited by 4
  14. 2023Animating Street Viewcited by 3
  15. 2025Controlling Avatar Diffusion with Learnable Gaussian Embeddingcited by 3
  16. 2025In-Context Sync-LoRA for Portrait Video Editingcited by 3
  17. 2024PAV: Personalized Head Avatar from Unstructured Video Collectioncited by 2
  18. 2024G3FA: Geometry-guided GAN for Face Animationcited by 2
  19. 2025Unlock Pose Diversity: Accurate and Efficient Implicit Keypoint-based Spatiotemporal Diffusion for Audio-driven Talking Portraitcited by 2
  20. 2025Bitrate-Controlled Diffusion for Disentangling Motion and Content in Videocited by 2
  21. 2025Unmasking Puppeteers: Leveraging Biometric Leakage to Expose Impersonation in AI-Based Videoconferencingcited by 2
  22. 2026Leveraging Avatar Fingerprinting: A Multi-Generator Photorealistic Talking-Head Public Database and Benchmarkcited by 2
  23. 2023Controllable One-Shot Face Video Synthesis With Semantic Aware Priorcited by 1
  24. 2024Jump Cut Smoothing for Talking Headscited by 1
  25. 2025Learning to Animate Images from A Few Videos to Portray Delicate Human Actionscited by 1
  26. 2025X2C: A Large-Scale Benchmark for Nuanced Humanoid Facial Expression Imitationcited by 1
  27. 2024Superior and Pragmatic Talking Face Generation with Teacher-Student Frameworkcited by 0
  28. 2025HairShifter: Consistent and High-Fidelity Video Hair Transfer via Anchor-Guided Animationcited by 0
  29. 2025JOLT3D: Joint Learning of Talking Heads and 3DMM Parameters with Application to Lip-Synccited by 0
  30. 2025Instant Expressive Gaussian Head Avatars at Over 100 FPScited by 0
  31. 2025SynergyWarpNet: Attention-Guided Cooperative Warping for Neural Portrait Animationcited by 0
  32. 2026Motion Manipulation via Unsupervised Keypoint Positioning in Face Animationcited by 0
  33. 2026DISPLAY: Directable Human-Object Interaction Video Generation via Sparse Motion Guidance and Multi-Task Auxiliarycited by 0