mlsanityData to 7 Oct 2026

CinemaTraj: Composing Atomic Camera Trajectories for 3D Scenes with LLM Agents

arXiv 2607.26910 ↗First posted 29 Jul 2026cs.CVcited by 1

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Automatically generating cinematically expressive camera trajectories through 3D scenes from natural language descriptions is a challenging task of high practical value, with applications ranging from real-estate advertising to virtual tour creation. Existing methods either lack true 3D spatial awareness by relying on 2D image priors, or treat trajectory generation as a geometric path planning problem divorced from cinematographic semantics. We present CinemaTraj, a framework that reframes camera trajectory planning as a language-grounded spatial reasoning problem. Given a set of RGB-D images and a user prompt, CinemaTraj equips an LLM agent with a structured 3D scene graph: the agent decomposes the prompt into a sequence of atomic cinematographic movements (dolly, orbit, crane, pan, tilt, zoom, arc). Each movement is instantiated via a novel parametric trajectory representation that is both cinematographically expressive and optimizable for collision avoidance. The scene graph acts as a structured spatial prior, grounding the agent's reasoning in accurate geometric and semantic knowledge of the environment. CinemaTraj further generates synchronized voiceover and subtitles aligned with camera motion, producing narrated cinematic video outputs. We evaluate CinemaTraj on real-world ScanNet++ environments, and show that it produces prompt-faithful, collision-free trajectories with high cinematographic quality, outperforming existing approaches on prompt alignment, trajectory quality, and safety metrics.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 36 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

17 of 36 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Agentic Aerial Cinematography: From Dialogue Cues to Cinematic Trajectories19 Sep
  2. 2025WorldCraft: Photo-Realistic 3D World Creation and Customization via LLM Agents21 Feb

Other references · 15

  1. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  2. 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 195
  3. 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 175
  4. 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 159
  5. 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
  6. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
  7. 2023GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphscited by 96
  8. 2024GaussNav: Gaussian Splatting for Visual Navigationcited by 49
  9. 2024E.T. the Exceptional Trajectories: Text-to-camera-trajectory generation with character awarenesscited by 24
  10. 2025GenDoP: Auto-regressive Camera Trajectory Generation as a Director of Photographycited by 18
  11. 2024ChatCam: Empowering Camera Control through Conversational AIcited by 15
  12. 2024SplaTraj: Camera Trajectory Generation with Semantic Gaussian Splattingcited by 10
3 more
  1. 2025Pulp Motion: Framing-aware multimodal camera and human motion generationcited by 8
  2. 2025LAMP: Language-Assisted Motion Planning for Controllable Video Generationcited by 4
  3. 2025FOCI: Trajectory Optimization on Gaussian Splatscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation
  2. 2026GeomVLA: Unifying Scene, Motion, and Action in 3D
  3. 2026CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation
  4. 2026Look-Before-Move: Narrative-Grounded World Visual Attention in Dynamic 3D Story Worlds
  5. 2025InfiniBench: Infinite Benchmarking for Visual Spatial Reasoning with Customizable Scene Complexity
  6. 2026CineCap: Structured Reasoning with Spatio-Temporal Anchors for Cinematographic Video Captioning
  7. 2026SceneActBench: Can Agents Act on the 3D Scenes They See?
  8. 2024Cinematographic Camera Diffusion Model