Agentic Aerial Cinematography: From Dialogue Cues to Cinematic Trajectories
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
We present Agentic Aerial Cinematography: From Dialogue Cues to Cinematic Trajectories (ACDC), an autonomous drone cinematography system driven by natural language communication between human directors and drones. The main limitation of previous drone cinematography workflows is that they require manual selection of waypoints and view angles based on predefined human intent, which is labor-intensive and yields inconsistent performance. In this paper, we propose employing large language models (LLMs) and vision foundation models (VFMs) to convert free-form natural language prompts directly into executable indoor UAV video tours. Specifically, our method comprises a vision-language retrieval pipeline for initial waypoint selection, a preference-based Bayesian optimization framework that refines poses using aesthetic feedback, and a motion planner that generates safe quadrotor trajectories. We validate ACDC through both simulation and hardware-in-the-loop experiments, demonstrating that it robustly produces professional-quality footage across diverse indoor scenes without requiring expertise in robotics or cinematography. These results highlight the potential of embodied AI agents to close the loop from open-vocabulary dialogue to real-world autonomous aerial cinematography.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 30 of its 40 references that are in the map. First posted on arXiv 19 Sep 2025.
Builds on
30 of 40 references.
Closest ancestors · 1
Same direction, newest first
Other references · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
- 2022Visual Language Maps for Robot Navigationcited by 365
- 2021Simple but Effective: CLIP Embeddings for Embodied AIcited by 191
- 2023AM-RADIO: Agglomerative Vision Foundation Model -- Reduce All Domains Into Onecited by 169
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 163
- 2025Q-Frame: Query-aware Frame Selection and Multi-Resolution Adaptation for Video-LLMscited by 80
17 more
- 2017Preferential Bayesian Optimizationcited by 74
- 2024KeyVideoLLM: Towards Large-scale Video Keyframe Selectioncited by 54
- 2024Revisit Anything: Visual Place Recognition via Image Segment Retrievalcited by 19
- 2019Autonomous Aerial Cinematography In Unstructured Environments With Learned Artistic Decision-Makingcited by 16
- 2023Swarm-GPT: Combining Large Language Models with Safe Motion Planning for Robot Choreography Designcited by 15
- 2024ChatCam: Empowering Camera Control through Conversational AIcited by 15
- 2019Can a Robot Become a Movie Director? Learning Artistic Principles for Aerial Cinematographycited by 10
- 2023Time-Optimal Gate-Traversing Planner for Autonomous Drone Racingcited by 7
- 2024Which Viewpoint Shows it Best? Language for Weakly Supervising View Selection in Multi-view Instructional Videoscited by 6
- 2024CineMPC: A Fully Autonomous Drone Cinematography System Incorporating Zoom, Focus, Pose, and Scene Compositioncited by 5
- 2025Test-Time Canonicalization by Foundation Models for Robust Perceptioncited by 5
- 2024PhotoBot: Reference-Guided Interactive Photography via Natural Languagecited by 3
- 2025FM-Planner: Foundation Model Guided Path Planning for Autonomous Drone Navigationcited by 3
- 2017Automated Cinematography with Unmanned Aerial Vehiclescited by 2
- 2019Integrated Motion Planner for Real-time Aerial Videography with a Drone in a Dense Environmentcited by 2
- 2025Efficient Visual Appearance Optimization by Learning from Prior Preferencescited by 2
- 2025Test-Time Augmentation for Pose-invariant Face Recognitioncited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searching
- 2025Taking Flight with Dialogue: Enabling Natural Language Control for PX4-based Drone Agent
- 2026DiffusionCinema: Text-to-Aerial Cinematography
- 2025AirVista-II: An Agentic System for Embodied UAVs Toward Dynamic Scene Semantic Understanding
- 2026Learning to Understand Body Language from Flight through Robust 3D Avatar Placing
- 2026HoverAI: An Embodied Aerial Agent for Natural Human-Drone Interaction
- 2026From Local Whole-Body VLA Behaviors to Scene-Scale Aerial Manipulation
- 2026ActiveFly-Bench: Aligning Embodied Question Answering with Vision-Language-Action for Aerial Embodied Perception