PhotoFlow: Agentic 3D Virtual Photography Missions
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Virtual photography asks an agent to enter a prepared 3D scene with no preselected camera pose or reference image, infer a suitable shot from scene information and a language intent, choose executable camera parameters, and render the final photograph. Recent progress in vision-language models makes this kind of spatial agent increasingly plausible, but the task stresses two capabilities that remain hard to evaluate together: complex 3D spatial understanding and abstract aesthetic judgment. We introduce PhotoFlow, a Director-Reviewer-Reflector agent for closed-loop camera search. The Director builds a soft photographic blueprint and proposes diverse candidate cameras; the Reviewer combines rule checks, visual critique, and pairwise incumbent selection; and the Reflector converts failures into region memory, dead-zone suppression, and high-explore relocation. We also introduce VPhotoBench, a benchmark of 47 open-license Blender scenes and 141 language-conditioned photography missions spanning subject placement, relational composition, and atmosphere/style. On held-out experiments, PhotoFlow achieves the strongest external quality-alignment composite and success rate among one-shot prediction, single-chain reflection, anchor-bank selection, and random search under a six-round rendering budget. To our knowledge, this is the first work to make language-conditioned virtual photography in arbitrary Blender scenes an executable agent task, and our results show that an LLM-centered spatial agent can already produce strong photographs in a setting designed to challenge both 3D reasoning and aesthetic choice.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 33 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
23 of 33 references.
Closest ancestors · 2
Same direction, newest first
- 2025Agentic Aerial Cinematography: From Dialogue Cues to Cinematic Trajectories19 Sep
- 2025FilmAgent: A Multi-Agent Framework for End-to-End Film Automation in Virtual 3D Spaces22 Jan
Other references · 21
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2018On Evaluation of Embodied Navigation Agentscited by 547
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
- 2017NIMA: Neural Image Assessmentcited by 389
- 2022Visual Spatial Reasoningcited by 293
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
- 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoningcited by 254
- 2019Stay on the Path: Instruction Fidelity in Vision-and-Language Navigationcited by 130
- 2022Personalized Image Aesthetics Assessment with Rich Attributescited by 58
9 more
- 2025UniPercept: Towards Unified Perceptual-Level Image Understanding across Aesthetics, Quality, Structure, and Texturecited by 22
- 2019Autonomous Aerial Cinematography In Unstructured Environments With Learned Artistic Decision-Makingcited by 16
- 2024ChatCam: Empowering Camera Control through Conversational AIcited by 15
- 2021AutoPhoto: Aesthetic Photo Capture using Reinforcement Learningcited by 7
- 2017Creatism: A deep-learning photographer capable of creating professional workcited by 5
- 2024CineMPC: A Fully Autonomous Drone Cinematography System Incorporating Zoom, Focus, Pose, and Scene Compositioncited by 5
- 2019LeRoP: A Learning-Based Modular Robot Photography Frameworkcited by 2
- 2026Mind-of-Director: Multi-modal Agent-Driven Film Previsualization via Collaborative Decision-Makingcited by 2
- 2026Aesthetic Camera Viewpoint Suggestion with 3D Aesthetic Fieldcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SceneActBench: Can Agents Act on the 3D Scenes They See?
- 2025IR3D-Bench: Evaluating Vision-Language Model Scene Understanding as Agentic Inverse Rendering
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation
- 2026WorldAgents: Can Foundation Image Models be Agents for 3D World Models?
- 2026PhotoAgent: A Robotic Photographer with Spatial and Aesthetic Understanding
- 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Models
- 2026SceneOrchestra: Efficient Agentic 3D Scene Synthesis via Full Tool-Call Trajectory Generation
- 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Models