mlsanityData to 7 Oct 2026

Generative AI for Film Creation: A Survey of Recent Advances

arXiv 2504.08296 ↗First posted 11 Apr 2025cs.CVcited by 17

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Generative AI (GenAI) is transforming filmmaking, equipping artists with tools like text-to-image and image-to-video diffusion, neural radiance fields, avatar generation, and 3D synthesis. This paper examines the adoption of these technologies in filmmaking, analyzing workflows from recent AI-driven films to understand how GenAI contributes to character creation, aesthetic styling, and narration. We explore key strategies for maintaining character consistency, achieving stylistic coherence, and ensuring motion continuity. Additionally, we highlight emerging trends such as the growing use of 3D generation and the integration of real footage with AI-generated elements. Beyond technical advancements, we examine how GenAI is enabling new artistic expressions, from generating hard-to-shoot footage to dreamlike diffusion-based morphing effects, abstract visuals, and unworldly objects. We also gather artists' feedback on challenges and desired improvements, including consistency, controllability, fine-grained editing, and motion refinement. Our study provides insights into the evolving intersection of AI and filmmaking, offering a roadmap for researchers and artists navigating this rapidly expanding field.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 46 of its 109 references that are in the map. First posted on arXiv 11 Apr 2025.

Builds on

46 of 109 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb

Other references · 45

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  5. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  6. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  7. 2022Human Motion Diffusion Modelcited by 1,062
  8. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  9. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  10. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  11. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
  12. 2020MovieNet: A Holistic Dataset for Movie Understandingcited by 206
33 more
  1. 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
  2. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 172
  3. 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
  4. 2023TADA! Text to Animatable Digital Avatarscited by 109
  5. 2024TC4D: Trajectory-Conditioned Text-to-4D Generationcited by 76
  6. 2023Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptationcited by 68
  7. 2024Advances in 3D Generation: A Surveycited by 62
  8. 2020A Local-to-Global Approach to Multi-modal Movie Scene Segmentationcited by 60
  9. 2023StreamDiffusion: A Pipeline-level Solution for Real-time Interactive Generationcited by 56
  10. 2024Autonomous Character-Scene Interaction Synthesis from Text Instructioncited by 56
  11. 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55
  12. 2020A Unified Framework for Shot Type Classification Based on Subject Centric Lenscited by 44
  13. 2023RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressionscited by 43
  14. 2023MovieFactory: Automatic Movie Creation from Text using Large Generative Models for Language and Imagescited by 42
  15. 2024VidMuse: A Simple Video-to-Music Generation Framework with Long-Short-Term Modelingcited by 39
  16. 2023Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer modelcited by 37
  17. 2021Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinementcited by 36
  18. 2023TriHuman : A Real-time and Controllable Tri-plane Representation for Detailed Human Geometry and Appearance Synthesiscited by 28
  19. 2022The Anatomy of Video Editing: A Dataset and Benchmark Suite for AI-Assisted Video Editingcited by 24
  20. 2023AutoShot: A Short Video Dataset and State-of-the-Art Shot Boundary Detectioncited by 22
  21. 2023Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Productioncited by 21
  22. 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstructioncited by 18
  23. 2024UltrAvatar: A Realistic Animatable 3D Avatar Diffusion Model with Authenticity Guided Texturescited by 13
  24. 2023Cinematic Behavior Transfer via NeRF-based Differentiable Filmingcited by 12
  25. 2024GEM3D: GEnerative Medial Abstractions for 3D Shape Synthesiscited by 12
  26. 2024Neural Radiance Field-based Visual Rendering: A Comprehensive Reviewcited by 12
  27. 2024MovieCharacter: A Tuning-Free Framework for Controllable Character Video Synthesiscited by 12
  28. 2020Online Multi-modal Person Search in Videoscited by 10
  29. 2024Zero-shot High-fidelity and Pose-controllable Character Animationcited by 9
  30. 2024ScriptViz: A Visualization Tool to Aid Scriptwriting based on a Large Movie Databasecited by 6
  31. 2024ScreenWriter: Automatic Screenplay Generation and Movie Summarisationcited by 5
  32. 2023Automated Conversion of Music Videos into Lyric Videoscited by 4
  33. 2025Make-A-Character 2: Animatable 3D Character Generation From a Single Imagecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 9; 2026: 8.

17 papers.

Sort:

By area:

  1. 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 33
  2. 2025FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generationcited by 28
  3. 2025AnyTalker: Scaling Multi-Person Talking Video Generation with Interactivity Refinementcited by 19
  4. 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Toolingcited by 17
  5. 2025Think Before You Diffuse: Infusing Physical Rules into Video Diffusioncited by 14
  6. 20253D Scene Prompting for Scene-Consistent Camera-Controllable Video Generationcited by 13
  7. 2025AVI-Edit: Audio-sync Video Instance Editing with Granularity-Aware Mask Refinercited by 8
  8. 2025AEGIS: Authenticity Evaluation Benchmark for AI-Generated Video Sequencescited by 6
  9. 2026Chain of Event-Centric Causal Thought for Physically Plausible Video Generationcited by 6
  10. 2026SceneAssistant: A Visual Feedback Agent for Open-Vocabulary 3D Scene Generationcited by 5
  11. 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generationcited by 5
  12. 2025Composing Concepts from Images and Videos via Concept-prompt Bindingcited by 2
5 more
  1. 2025AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaborationcited by 1
  2. 2026GenVideoLens: Where LVLMs Fall Short in AI-Generated Video Detection?cited by 1
  3. 2026Identifying Models Behind Text-to-Image Leaderboardscited by 0
  4. 2026Explainable Forensics of Manipulated Segments in Untrimmed Long Videoscited by 0
  5. 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Generative AI for Character Animation: A Comprehensive Survey of Techniques, Applications, and Future Directions
  2. 2025Generative AI for Vision: A Comprehensive Study of Frameworks and Applications
  3. 2025Style Transfer: A Decade Survey
  4. 2025Generative AI for Cel-Animation: A Survey
  5. 2024GenAI Arena: An Open Evaluation Platform for Generative Models
  6. 2025Advances in Artificial Intelligence: A Review for the Creative Industries
  7. 2026Generative AI for Video Trailer Synthesis: From Extractive Heuristics to Autoregressive Creativity
  8. 2024Generative AI in Vision: A Survey on Models, Metrics and Applications