mlsanityData to 7 Oct 2026

AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidance

arXiv 2311.12886 ↗First posted 21 Nov 2023cs.CVcited by 66

Not on the map. Why?

Cited by 26 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Image animation is a key task in computer vision which aims to generate dynamic visual content from static image. Recent image animation methods employ neural based rendering technique to generate realistic animations. Despite these advancements, achieving fine-grained and controllable image animation guided by text remains challenging, particularly for open-domain images captured in diverse real environments. In this paper, we introduce an open domain image animation method that leverages the motion prior of video diffusion model. Our approach introduces targeted motion area guidance and motion strength guidance, enabling precise control the movable area and its motion speed. This results in enhanced alignment between the animated visual elements and the prompting text, thereby facilitating a fine-grained and interactive animation generation process for intricate motion sequences. We validate the effectiveness of our method through rigorous experiments on an open-domain dataset, with the results showcasing its superior performance. Project page can be found at https://animationai.github.io/AnimateAnything.

Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). Builds on 50 of its 63 references that are in the map. First posted on arXiv 21 Nov 2023.

Builds on

50 of 63 references.

References · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  8. 2022Scalable Diffusion Models with Transformerscited by 5,931
  9. 2022Generative Adversarial Networkscited by 5,603
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  12. 2013Auto-Encoding Variational Bayescited by 3,980
38 more
  1. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  2. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  3. 2022Video Diffusion Modelscited by 2,280
  4. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  5. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  6. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  7. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  8. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  9. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  10. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  11. 2023ModelScope Text-to-Video Technical Reportcited by 651
  12. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
  13. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  14. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
  15. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
  16. 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
  17. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 330
  18. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
  19. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 303
  20. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
  21. 2021Motion Representations for Articulated Animationcited by 253
  22. 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
  23. 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
  24. 2023Conditional Image-to-Video Generation with Latent Flow Diffusion Modelscited by 180
  25. 2022Latent Image Animator: Learning to Animate Images via Latent Space Navigationcited by 172
  26. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
  27. 2023Generative Image Dynamicscited by 93
  28. 2017Learning to Generate Time-Lapse Videos Using Multi-Stage Dynamic Generative Adversarial Networkscited by 88
  29. 2021Make It Move: Controllable Image-to-Video Generation with Text Descriptionscited by 88
  30. 2023Open-vocabulary Object Segmentation with Diffusion Modelscited by 82
  31. 2023Diffusion Models for Open-Vocabulary Segmentationcited by 63
  32. 2018Photo Wake-Up: 3D Character Animation from a Single Photocited by 60
  33. 2020Animating Pictures with Eulerian Motion Fieldscited by 54
  34. 2021Controllable Animation of Fluid Elements in Still Imagescited by 44
  35. 2021Understanding Object Dynamics for Interactive Image-to-Video Synthesiscited by 38
  36. 20233D Cinemagraphy from a Single Imagecited by 23
  37. 2023Blowing in the Wind: CycleNet for Human Cinemagraphs from Still Imagescited by 14
  38. 2023Automatic Animation of Hair Blowing in Still Portrait Photoscited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 37; 2025: 23; 2026: 6.

66 papers.

Sort:

By area:

  1. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 242
  2. 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
  3. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
  4. 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 130
  5. 2024GameGen-X: Interactive Open-world Game Video Generationcited by 124
  6. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
  7. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
  8. 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 99
  9. 2024Ca2-VDM: Efficient Autoregressive Video Diffusion Model with Causal Generation and Cache Sharingcited by 70
  10. 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Promptscited by 52
  11. 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
  12. 2024VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Modelscited by 42
38 more
  1. 2024SF-V: Single Forward Video Generation Modelcited by 40
  2. 2024Video Motion Transfer with Diffusion Transformerscited by 39
  3. 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 38
  4. 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 37
  5. 2024ViD-GPT: Introducing GPT-style Autoregressive Generation in Video Diffusion Modelscited by 33
  6. 2025Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Controlcited by 33
  7. 2024Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Modelcited by 27
  8. 2024STIV: Scalable Text and Image Conditioned Video Generationcited by 24
  9. 2024EffiVED:Efficient Video Editing via Text-instruction Diffusion Modelscited by 21
  10. 2025Dynamic Concepts Personalization from Single Videoscited by 20
  11. 2024LightningDrag: Lightning Fast and Accurate Drag-based Image Editing Emerging from Videoscited by 18
  12. 2024ObjCtrl-2.5D: Training-free Object Control with Camera Posescited by 18
  13. 2024Owl-1: Omni World Model for Consistent Long Video Generationcited by 17
  14. 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generationcited by 16
  15. 2024Cinemo: Consistent and Controllable Image Animation with Motion Diffusion Modelscited by 14
  16. 2025MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animationcited by 14
  17. 2025RoPECraft: Training-Free Motion Transfer with Trajectory-Guided RoPE Optimization on Diffusion Transformerscited by 14
  18. 2024VideoElevator: Elevating Video Generation Quality with Versatile Text-to-Image Diffusion Modelscited by 13
  19. 2024AtomoVideo: High Fidelity Image-to-Video Generationcited by 12
  20. 2025FaceShot: Bring Any Character into Lifecited by 12
  21. 2025Extrapolating and Decoupling Image-to-Video Generation Models: Motion Modeling is Easier Than You Thinkcited by 12
  22. 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Frameworkcited by 12
  23. 2024SpatialDreamer: Self-supervised Stereo Video Synthesis from Monocular Inputcited by 11
  24. 2024Motion Modes: What Could Happen Next?cited by 11
  25. 2025MotionAgent: Fine-grained Controllable Video Generation via Motion Field Agentcited by 11
  26. 2025Mask2IV: Interaction-Centric Video Generation via Mask Trajectoriescited by 10
  27. 2024AniSora: Exploring the Frontiers of Animation Video Generation in the Sora Eracited by 8
  28. 2024Draw an Audio: Leveraging Multi-Instruction for Video-to-Audio Synthesiscited by 7
  29. 2024ByTheWay: Boost Your Text-to-Video Generation Model to Higher Quality in a Training-free Waycited by 7
  30. 2024MikuDance: Animating Character Art with Mixed Motion Dynamicscited by 7
  31. 2024Reenact Anything: Semantic Video Motion Transfer Using Motion-Textual Inversioncited by 6
  32. 2025Proteus-ID: ID-Consistent and Motion-Coherent Video Customizationcited by 6
  33. 2026Evolution of Video Generative Foundationscited by 6
  34. 2024LaSe-E2V: Towards Language-guided Semantic-Aware Event-to-Video Reconstructioncited by 5
  35. 2024Text-Animator: Controllable Visual Text Video Generationcited by 4
  36. 2025Identity-Preserving Text-to-Video Generation Guided by Simple yet Effective Spatial-Temporal Decoupled Representationscited by 4
  37. 2025VDOT: Efficient Unified Video Creation via Optimal Transport Distillationcited by 4
  38. 2025LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformercited by 3

50 most cited of 66 All 66 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors
  2. 2023AnimateZero: Video Diffusion Models are Zero-Shot Image Animators
  3. 2025AnyI2V: Animating Any Conditional Image with Motion Control
  4. 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animation
  5. 2024Animate Your Motion: Turning Still Images into Dynamic Videos
  6. 2023LivePhoto: Real Image Animation with Text-guided Motion Control
  7. 2025AnimaMimic: Imitating 3D Animation from Video Priors
  8. 2023Animate124: Animating One Image to 4D Dynamic Scene