mlsanityData to 14 Oct 2026

PACE: Precise AI Cinematic Expression

arXiv 2609.19853 ↗First posted 17 Sep 2026cs.CV cs.AIcited by 0

On the map: Diffusion models → Video generation also fits: 3D, point cloud and scene generation

Abstract (arXiv)

Between a screenplay and a film sits a planning problem that is spatial first: who stands where, and what a camera sees from where it stands. An image diffusion model asked for a shot in free text settles that plan by its own defaults. We present PACE (Precise AI Cinematic Expression), a typed representation for the plan: the screenplay evidence, the characters, props and locations it needs, where each subject stands, and what the camera does. A value is written once at the level it belongs to (script, scene, shot or panel) and inherited below it. A compiler turns the result into both the prompt sent to the diffusion model and a 3D scene built in metres, and a camera solver places the camera so that the declared framing is the framing built. Where a declared value becomes geometry, PACE measures, field by field, how far the compiled camera and the staged render sit from the declaration, rather than asking a model to judge. On the 11-scene Automatic Drive screenplay, every staged single-subject panel places its subject within 1.2% of frame width of its declared position; with two or three subjects one camera pose cannot satisfy every position, and the residual is reported rather than absorbed. On 204 external director-storyboard shots, delivered head height is 1.906 times the staged target from the director's words, 1.733 from the compiled prompt, and 0.955 with the greybox control; the condition that holds framing best draws the described action least. Declaring the pose on 30 shots raises the action drawn from 58.9% to 74.4% without moving the framing. Transitions, fitted motion and human review of the generated panels remain open. Code: https://github.com/StudioPiLabs/pace-core

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 40 of its 64 references that are in the map. First posted on arXiv 17 Sep 2026.

Builds on

40 of 64 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Taming Camera-Controlled Video Generation with Verifiable Geometry Reward2 Dec
  2. 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Models15 Aug
  3. 2025VACE: All-in-One Video Creation and Editing10 Mar

Other references · 37

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  3. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  4. 2022Teaching language models to support answers with verified quotescited by 292
  5. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  6. 2020MovieNet: A Holistic Dataset for Movie Understandingcited by 206
  7. 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
  8. 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
  9. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 141
  10. 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 89
  11. 2014Narrative Planning: Balancing Plot and Charactercited by 61
  12. 2019Movie Plot Analysis via Turning Point Identificationcited by 34
25 more
  1. 2024Finding Blind Spots in Evaluator LLMs with Interpretable Checklistscited by 32
  2. 2018Reasoning about Actions and State Changes by Injecting Commonsense Knowledgecited by 29
  3. 2025FilmAgent: A Multi-Agent Framework for End-to-End Film Automation in Virtual 3D Spacescited by 28
  4. 2025STAGE: Storyboard-Anchored Generation for Cinematic Multi-shot Narrativecited by 23
  5. 2023Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Productioncited by 21
  6. 2021Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understandingcited by 19
  7. 2025GenDoP: Auto-regressive Camera Trajectory Generation as a Director of Photographycited by 18
  8. 2024CinePreGen: Camera Controllable Video Previsualization via Engine-powered Diffusioncited by 7
  9. 2025CineVision: An Interactive Pre-visualization Storyboard System for Director-Cinematographer Collaborationcited by 7
  10. 2015The Prose Storyboard Language: A Tool for Annotating and Directing Moviescited by 6
  11. 2025Stable Cinemetrics : Structured Taxonomy and Evaluation for Professional Video Generationcited by 6
  12. 2025ShotDirector: Directorially Controllable Multi-Shot Video Generation with Cinematographic Transitionscited by 6
  13. 2024Reviewing Intelligent Cinematography: AI research for camera-based video productioncited by 4
  14. 2025Camera Trajectory Generation: A Comprehensive Survey of Methods, Metrics, and Future Directionscited by 4
  15. 2026PrevizWhiz: Combining Rough 3D Scenes and 2D Video to Guide Generative Video Previsualizationcited by 4
  16. 2026STAGE: A Full-Screenplay Benchmark for Reasoning over Evolving Storiescited by 3
  17. 2026VERTIGO: Visual Preference Optimization for Cinematic Camera Trajectory Generationcited by 3
  18. 2026StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamicscited by 3
  19. 2026CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboardingcited by 3
  20. 2026Better Call CineCrew: Consistent Ultra-Long Narrative-to-Film Generationcited by 3
  21. 2025LensCraft: Your Professional Virtual Cinematographercited by 2
  22. 2026Camera Control for Text-to-Image Generation via Learning Viewpoint Tokenscited by 2
  23. 2026From Personas to Plot: Character-Grounded Multi-Agent Story Generation for Long-Form Narrativescited by 2
  24. 2025A Unifying Scheme for Extractive Content Selection Taskscited by 1
  25. 2026SEAM: Shot Entity-Attribute Memory for Consistent Short-Drama Generation at Scalecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Cinematographic Camera Diffusion Model
  2. 2026CinemaTraj: Composing Atomic Camera Trajectories for 3D Scenes with LLM Agents
  3. 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequence
  4. 2026Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation
  5. 2023Directed Diffusion: Direct Control of Object Placement through Attention Guidance
  6. 2026Look-Before-Move: Narrative-Grounded World Visual Attention in Dynamic 3D Story Worlds
  7. 2025Captain Cinema: Towards Short Movie Generation
  8. 2023LAW-Diffusion: Complex Scene Generation by Diffusion with Layouts