CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
The integration of large language models (LLMs) into video generation has enabled rapid text-to-video creation and improved visual quality. However, it still falls short of professional filmmaking, where cinematographic language is less refined than human-crafted camera work and multi-shot continuity remains challenging. To address these limitations, we introduce CamPilot, a multi-agent framework that integrates cinematographic planning and camera-work control to produce more coherent, logically structured, and human-aesthetic movies. CamPilot adopts a GRPO-based learning paradigm to learn camera work planning from 14K real-world professional movies, internalizing motion patterns and composition principles that support reasoning over shooting techniques (e.g., camera angle, motion, and focal behavior) and cross-shot relationships for controllable camera-viewpoint generation. Multiple agents further collaborate and evolve to improve overall output quality. To support this work and further studies in this domain, we establish CamEval, a benchmark for evaluating camera work quality and cinematic engagement. Empirical results show that CamPilot outperforms state-of-the-art text-to-movie generation methods on cinematographic control and quality, highlighting the impact of professional camera design on movie generation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 37 of its 52 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
37 of 52 references.
Closest ancestors · 3
Same direction, newest first
- 2025Automated Movie Generation via Multi-Agent CoT Planning10 Mar
- 2025FilmAgent: A Multi-Agent Framework for End-to-End Film Automation in Virtual 3D Spaces22 Jan
- 2024Mora: Enabling Generalist Video Generation via A Multi-Agent Framework20 Mar
Other references · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2016Improved Techniques for Training GANscited by 2,970
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
22 more
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 141
- 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
- 2020Condensed Movies: Story Based Retrieval with Contextual Embeddingscited by 95
- 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 64
- 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generationcited by 50
- 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 39
- 2024Anim-Director: A Large Multimodal Model Powered Agent for Controllable Animation Video Generationcited by 37
- 2024E.T. the Exceptional Trajectories: Text-to-camera-trajectory generation with character awarenesscited by 25
- 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generationcited by 19
- 2025Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal Reasoningcited by 13
- 2024Knowledge-Infused Legal Wisdom: Navigating LLM Consultation through the Lens of Diagnostics and Positive-Unlabeled Reinforcement Learningcited by 12
- 2024Can video generation replace cinematographers? Research on the cinematic language of generated videocited by 6
- 2025Teaching According to Students' Aptitude: Personalized Mathematics Tutoring via Persona-, Memory-, and Forgetting-Aware LLMscited by 3
- 2025DynamicEval: Rethinking Evaluation for Dynamic Text-to-Video Synthesiscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generation
- 2025FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generation
- 2025Captain Cinema: Towards Short Movie Generation
- 2026The Script is All You Need: An Agentic Framework for Long-Horizon Dialogue-to-Cinematic Video Generation
- 2026ShotVerse: Advancing Cinematic Camera Control for Text-Driven Multi-Shot Video Creation
- 2026CineCap: Structured Reasoning with Spatio-Temporal Anchors for Cinematographic Video Captioning
- 2025CineTechBench: A Benchmark for Cinematographic Technique Understanding and Generation
- 2024Kubrick: Multimodal Agent Collaborations for Synthetic Video Generation