From Idea to Co-Creation: A Planner-Actor-Critic Framework for Agent Augmented 3D Modeling
Not on the map. Why?
Abstract (arXiv)
We present a framework that extends the Actor-Critic architecture to creative 3D modeling through multi-agent self-reflection and human-in-the-loop supervision. While existing approaches rely on single-prompt agents that directly execute modeling commands via tools like Blender MCP, our approach introduces a Planner-Actor-Critic architecture. In this design, the Planner coordinates modeling steps, the Actor executes them, and the Critic provides iterative feedback, while human users act as supervisors and advisors throughout the process. Through systematic comparison between single-prompt modeling and our reflective multi-agent approach, we demonstrate improvements in geometric accuracy, aesthetic quality, and task completion rates across diverse 3D modeling scenarios. Our evaluation reveals that critic-guided reflection, combined with human supervisory input, reduces modeling errors and increases complexity and quality of the result compared to direct single-prompt execution. This work establishes that structured agent self-reflection, when augmented by human oversight and advisory guidance, produces higher-quality 3D models while maintaining efficient workflow integration through real-time Blender synchronization.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 17 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
10 of 17 references.
References · 10
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 134
- 2025A survey of agent interoperability protocols: Model Context Protocol (MCP), Agent Communication Protocol (ACP), Agent-to-Agent Protocol (A2A), and Agent Network Protocol (ANP)cited by 101
- 2024BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvementcited by 29
- 2025WorldCraft: Photo-Realistic 3D World Creation and Customization via LLM Agentscited by 21
- 2025DeepCritic: Deliberate Critique with Large Language Modelscited by 17
- 2024A Survey On Text-to-3D Contents Generation In The Wildcited by 14
- 2025Gen3DEval: Using vLLMs for Automatic Evaluation of Generated 3D Objectscited by 11
- 2025CoherenDream: Boosting Holistic Text Coherence in 3D Generation via Multimodal Large Language Models Feedbackcited by 1
- 2025Sel3DCraft: Interactive Visual Prompts for User-Friendly Text-to-3D Generationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026MUSE: Agentic 3D Scene Authoring via Memory-Grounded Incremental Requirement Satisfaction
- 2026ViSculpt: Visual-Centric Agentic Geometry Editing
- 2026SceneOrchestra: Efficient Agentic 3D Scene Synthesis via Full Tool-Call Trajectory Generation
- 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code
- 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agent
- 2026CoGen3D: An Agentic Human-AI Co-Design Pipeline for 3D Asset Generation for Virtual Reality
- 2026EZBlender: Efficient 3D Editing with Plan-and-ReAct Agent
- 2026Procedura: Agentic 3D Modeling with Procedural Control