PhotoAgent: A Robotic Photographer with Spatial and Aesthetic Understanding
Not on the map. Why?
Abstract (arXiv)
Embodied agents for creative tasks like photography must bridge the semantic gap between high-level language commands and geometric control. We introduce PhotoAgent, an agent that achieves this by integrating Large Multimodal Models (LMMs) reasoning with a novel control paradigm. PhotoAgent first translates subjective aesthetic goals into solvable geometric constraints via LMM-driven, chain-of-thought (CoT) reasoning, allowing an analytical solver to compute a high-quality initial viewpoint. This initial pose is then iteratively refined through visual reflection within a photorealistic internal world model built with 3D Gaussian Splatting (3DGS). This ``mental simulation'' replaces costly and slow physical trial-and-error, enabling rapid convergence to aesthetically superior results. Evaluations confirm that PhotoAgent excels in spatial reasoning and achieves superior final image quality.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 34 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
24 of 34 references.
References · 24
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2018World Modelscited by 1,444
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2020Mastering Atari with Discrete World Modelscited by 990
12 more
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
- 2023Gaussian Splatting SLAMcited by 410
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2025HumanAesExpert: Advancing a Multi-Modality Foundation Model for Human Image Aesthetic Assessmentcited by 17
- 2025Multimodal LLMs Can Reason about Aesthetics in Zero-Shotcited by 14
- 2021AutoPhoto: Aesthetic Photo Capture using Reinforcement Learningcited by 7
- 2024PhotoBot: Reference-Guided Interactive Photography via Natural Languagecited by 3
- 2019Learning to Take Good Pictures of People with a Robot Photographercited by 2
- 2019LeRoP: A Learning-Based Modular Robot Photography Frameworkcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025PhotoArtAgent: Intelligent Photo Retouching with Language Model-Based Artist Agents
- 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Models
- 2025Visual Agentic AI for Spatial Reasoning with a Dynamic API
- 2026Socratic-Geo: Synthetic Data Generation and Geometric Reasoning via Multi-Agent Interaction
- 2026Thinking with Imagination: Agentic Visual Spatial Reasoning with World Simulators
- 2026PhotoFlow: Agentic 3D Virtual Photography Missions
- 2026DiffuseAgent-MI: Distributionally-Grounded,Tool-Integrated Self-Evolving Agents for Faithful Visual Reasoning
- 2025Beyond Words and Pixels: A Benchmark for Implicit World Knowledge Reasoning in Generative Models