mlsanityData to 7 Oct 2026

Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generation

arXiv 2606.01900 ↗First posted 1 Jun 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Generative video models have achieved remarkable visual fidelity and temporal coherence, yet intentional camera control remains elusive. Existing frameworks treat camera motion as a byproduct of pixel synthesis, producing trajectories that are stochastic, spatially inconsistent, and indifferent to the human subject driving the scene. In this work, we present Auteur, a method for language-driven, human-centric camera framing in generative video. Our core insight is that professional filmmakers conceive shots not as world-space trajectories but as framings defined relative to the actor, encoding shot size, angle, and composition as functions of human pose and motion. We formalize this intuition as a human-centric camera parameterization and introduce a Domain-Specific Language (DSL) that is convertible to standard 6-DoF camera parameters. A fine-tuned multimodal large language model then acts as a virtual director, mapping natural language descriptions and coarse human motion to sparse DSL keyframes that are deterministically interpolated into continuous camera trajectories, which are then provided as input to video generators. We train and evaluate Auteur on a new dataset of 34K aligned text, human motion, and DSL-annotated camera trajectories drawn from procedural synthesis and real-world movie footage from the CondensedMovies dataset. Auteur enables cinematographic framing of human-centered scenes, a capability largely absent in prior generative models. To assess this behavior, we propose new framing-focused metrics, and our experiments show that Auteur consistently outperforms existing methods. Project page is https://cyberiada.github.io/Auteur/

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 37 of its 48 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

37 of 48 references.

References · 37

  1. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  4. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  5. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  6. 2025VACE: All-in-One Video Creation and Editingcited by 467
  7. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  8. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  9. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 138
  10. 2024AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmarkcited by 137
  11. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  12. 2024Training-free Camera Control for Video Generationcited by 119
25 more
  1. 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 105
  2. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
  3. 2020Condensed Movies: Story Based Retrieval with Contextual Embeddingscited by 95
  4. 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 75
  5. 2025CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generationcited by 73
  6. 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 63
  7. 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 54
  8. 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50
  9. 2025FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesiscited by 37
  10. 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 26
  11. 2025VidCRAFT3: Camera, Object, and Lighting Control for Image-to-Video Generationcited by 25
  12. 2024E.T. the Exceptional Trajectories: Text-to-camera-trajectory generation with character awarenesscited by 24
  13. 2024Boosting Camera Motion Control for Video Diffusion Transformerscited by 20
  14. 2025EPiC: Efficient Video Camera Control Learning with Precise Anchor-Video Guidancecited by 20
  15. 2024I2VControl: Disentangled and Unified Video Motion Synthesis Controlcited by 19
  16. 2024Cinematographic Camera Diffusion Modelcited by 18
  17. 2025GenDoP: Auto-regressive Camera Trajectory Generation as a Director of Photographycited by 18
  18. 2026Vista4D: Video Reshooting with 4D Point Cloudscited by 15
  19. 2025RoPECraft: Training-Free Motion Transfer with Trajectory-Guided RoPE Optimization on Diffusion Transformerscited by 14
  20. 2025Pulp Motion: Framing-aware multimodal camera and human motion generationcited by 8
  21. 2025Modular-Cam: Modular Dynamic Camera-view Video Generation with LLMcited by 7
  22. 2017Directing Cinematographic Dronescited by 6
  23. 2026SOMA: Unifying Parametric Human Body Modelscited by 6
  24. 2026VERTIGO: Visual Preference Optimization for Cinematic Camera Trajectory Generationcited by 3
  25. 2026Building a Precise Video Language with Human-AI Oversightcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025SkyReels-V2: Infinite-length Film Generative Model
  2. 2026ActCam: Zero-Shot Joint Camera and 3D Motion Control for Video Generation
  3. 2024Can video generation replace cinematographers? Research on the cinematic language of generated video
  4. 2025FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generation
  5. 2026CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation
  6. 2026ShotVerse: Advancing Cinematic Camera Control for Text-Driven Multi-Shot Video Creation
  7. 2025TokenMotion: Decoupled Motion Control via Token Disentanglement for Human-centric Video Generation
  8. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generation