mlsanityData to 7 Oct 2026

Generative AI for Cel-Animation: A Survey

arXiv 2501.06250 ↗First posted 8 Jan 2025cs.CV cs.AI cs.HCcited by 17

Not on the map. Why?

Abstract (arXiv)

Traditional Celluloid (Cel) Animation production pipeline encompasses multiple essential steps, including storyboarding, layout design, keyframe animation, inbetweening, and colorization, which demand substantial manual effort, technical expertise, and significant time investment. These challenges have historically impeded the efficiency and scalability of Cel-Animation production. The rise of generative artificial intelligence (GenAI), encompassing large language models, multimodal models, and diffusion models, offers innovative solutions by automating tasks such as inbetween frame generation, colorization, and storyboard creation. This survey explores how GenAI integration is revolutionizing traditional animation workflows by lowering technical barriers, broadening accessibility for a wider range of creators through tools like AniDoc, ToonCrafter, and AniSora, and enabling artists to focus more on creative expression and artistic innovation. Despite its potential, challenges like visual consistency, stylistic coherence, and ethical considerations persist. Additionally, this paper explores future directions and advancements in AI-assisted animation. For further exploration and resources, please visit our GitHub repository: https://github.com/yunlong10/Awesome-AI4Animation

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 140 of its 188 references that are in the map. First posted on arXiv 8 Jan 2025.

Builds on

140 of 188 references.

References · 140

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2023Visual Instruction Tuningcited by 7,792
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  8. 2020Scaling Laws for Neural Language Modelscited by 6,411
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2024Qwen2.5 Technical Reportcited by 4,713
  12. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
38 more
  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  3. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  4. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  5. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  6. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  7. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  8. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  9. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  10. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  11. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  12. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
  13. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
  14. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  15. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  16. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  17. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
  18. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
  19. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 574
  20. 2023Simple and Controllable Music Generationcited by 480
  21. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  22. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
  23. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  24. 2023MusicLM: Generating Music From Textcited by 442
  25. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  26. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
  27. 2024CRUXEval: A Benchmark for Code Reasoning, Understanding and Executioncited by 294
  28. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  29. 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 264
  30. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
  31. 2023A Survey on Video Diffusion Modelscited by 203
  32. 2023Video Understanding with Large Language Models: A Surveycited by 203
  33. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
  34. 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
  35. 2023Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuningcited by 168
  36. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
  37. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 138
  38. 2021Taming Visually Guided Sound Generationcited by 136

50 most cited of 140 All 140 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 12; 2026: 5.

17 papers.

Sort:

By area:

  1. 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generationcited by 50
  2. 2025GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modelingcited by 43
  3. 2025The Tenth NTIRE 2025 Efficient Super-Resolution Challenge Reportcited by 25
  4. 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelitycited by 23
  5. 2025Intentional Gesture: Deliver Your Intentions with Gestures for Speechcited by 8
  6. 2025ToonComposer: Streamlining Cartoon Production with Generative Post-Keyframingcited by 8
  7. 2026LiveGesture Streamable Co-Speech Gesture Generation Modelcited by 4
  8. 2025DACoN: DINO for Anime Paint Bucket Colorization with Any Number of Reference Imagescited by 2
  9. 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarkscited by 2
  10. 2025AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaborationcited by 1
  11. 2026InstanceAnimator: Multi-Instance Sketch Video Colorizationcited by 1
  12. 2025Advancing Multimodal LLMs by Large-Scale 3D Visual Instruction Dataset Generationcited by 0
5 more
  1. 2025FADE: Adversarial Concept Erasure in Flow Modelscited by 0
  2. 2025Robust Concept Erasure in Diffusion Models: A Theoretical Perspective on Security and Robustnesscited by 0
  3. 2026ExpressEdit: Fast Editing of Stylized Facial Expressions with Diffusion Models in Photoshopcited by 0
  4. 2026PeCA: Palette Context Assisted Inference for Test-Time Paint-Bucket Colourisation on Animation Videoscited by 0
  5. 2026No Pixel Left Behind: Filling Gaps in Anime Colorizationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Generative AI for Film Creation: A Survey of Recent Advances
  2. 2025Generative AI for Character Animation: A Comprehensive Survey of Techniques, Applications, and Future Directions
  3. 2024IDEA-Bench: How Far are Generative Models from Professional Designing?
  4. 2024Generative AI for Visualization: State of the Art and Future Directions
  5. 2024Surrealistic-like Image Generation with Vision-Language Models
  6. 2024GenAI Arena: An Open Evaluation Platform for Generative Models
  7. 2025Advances in Artificial Intelligence: A Review for the Creative Industries
  8. 2025Style Transfer: A Decade Survey