VETR: Execution-Grounded Self-Improving Agent for Symbolic Graphics Reasoning
On the map: LLM agents and tool use → Multimodal and embodied agents
also in 1 more
Abstract (arXiv)
Visual agents for symbolic graphics reasoning depend on executable world representations, yet continued improvement remains bottlenecked by ambiguous supervision from final renders. Recent agentic systems refine scenes through repeated interaction, but they lack mechanisms to recursively extract actionable evidence from execution traces, overlooking which proposed symbolic edits survived, disappeared, or interfered during program execution. To address this, we propose VETR (Verified Execution Trajectories for Refinement), a framework that enables agentic recursive self-improvement over executable world representations for symbolic graphics reasoning. Within each task, VETR retains aligned program/render records with bounded runtime observations and introduces an execution refiner that compiles observed writes and state changes into constrained alternative programs. The refiner validates their endpoints and preservation conditions against captured runtime state; the ordinary visual verifier then assesses goal relevance. Repair construction makes no additional language-model calls, but can require additional executions. Evaluations on BlenderGym (280 tasks) and BlenderBench (27 released tasks) with GPT-5.6-luna and Qwen3.8-27B show that VETR consistently outperforms existing refinement strategies, including BlenderAlchemy and VIGA. Controlled ablations evaluate the contributions of execution refinement and role-asymmetric evidence organization under fixed generator-interaction caps.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 34 of its 41 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
34 of 41 references.
Closest ancestors · 8
Same direction, newest first
- 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning27 Aug
- 2026HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualization25 Jun
- 2026SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agents31 Mar
- 2026Vision-as-Inverse-Graphics Agent via Interleaved Multimodal Reasoning16 Jan
- 2026EZBlender: Efficient 3D Editing with Plan-and-ReAct Agent12 Jan
- 2025VULCAN: Tool-Augmented Multi Agents for Iterative 3D Object Arrangement26 Dec
- 2025NLI4VolVis: Natural Language Interaction for Volume Visualization via LLM Multi-Agents and Editable 3D Gaussian Splatting16 Jul
- 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code2 Mar
Other references · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
- 2023Teaching Large Language Models to Self-Debugcited by 988
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2024Executable Code Actions Elicit Better LLM Agentscited by 564
14 more
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 254
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 95
- 2025BlenderGym: Benchmarking Foundational Model Systems for Graphics Editingcited by 31
- 2025ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editingcited by 24
- 2024BlenderAlchemy: Editing 3D Graphics with Vision-Language Modelscited by 22
- 2026Thinking in Blender: Staged Executable Inverse Graphics with Vision-Language Modelscited by 10
- 2024ViUniT: Visual Unit Tests for More Robust Visual Programmingcited by 4
- 2026Toward AI VIS Co-Scientists: A General and End-to-End Agent Harness for Solving Complex Data Visualization Taskscited by 3
- 2024VDebugger: Harnessing Execution Feedback for Debugging Visual Programscited by 2
- 2018Bidirectional Evaluation with Direct Manipulationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VisualCoding: Learning Executable Skills for Reliable Visual Reasoning
- 2026VLM-in-Sandbox: Visual Workspaces for Agentic Visual Reasoning
- 2025CodeDance: A Dynamic Tool-integrated MLLM for Executable Visual Reasoning
- 2025Toward Causal-Visual Programming: Enhancing Agentic Reasoning in Low-Code Environments
- 2026COMFYCLAW: Self-Evolving Skill Harnesses for Image Generation Workflows
- 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning
- 2023De-fine: Decomposing and Refining Visual Programs with Auto-Feedback
- 2026Symbolic Grounding Reveals Representational Bottlenecks in Abstract Visual Reasoning