mlsanityData to 14 Oct 2026

How Far Can Coding Agents Go in Visual Generation?

arXiv 2610.19025 ↗First posted 13 Oct 2026cs.CV cs.LGcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Modern image generation largely relies on specialized generative models that leave the process of image construction implicit in learned parameters. We explore an alternative: general-purpose coding agents that construct images through executable programs. Our study of zero-shot drawing on AgentDrawBench, a 200-prompt benchmark, reveals a distinctive capability profile. Agents excel at preserving structure and satisfying precise visual constraints, achieving competitive results in domains where compositional accuracy matters more than photorealistic appearance, while remaining limited in perceptual richness. Their visual expressiveness varies with the drawing interface, and a qualitative study on reconstruction shows how procedural skills extracted from human demonstrations support different artistic media. We then examine code as an external visual language of thought: a structured, executable representation that agents can construct and inspect. We test it in visual question answering task and find reconstructed visual code retains substantial information for question answering and, in some domains, supports higher accuracy than the original image. These abilities raise a further question: do agents draw on a shared internal representation of scene content beyond a particular drawing program? We explore an internal visual language-of-thought hypothesis, in which a shared, compositionally structured representation supports visual operations across drawing languages. Cross-harness drawings and images assembled from independent single-pixel queries exhibit related layouts and tones. Agents also maintain self-generated room arrangements across viewpoints after visible drawings are removed. These results demonstrate that the coding agent would maintain a consistent and coherent world inside its imagine even before the harness gets involved and the generation starts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 38 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

29 of 38 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026RS-Gen: A Multi-Stage Agentic Framework for Reasoning and Search-Augmented Image Generation22 Jun
  2. 2026Gen-Searcher: Reinforcing Agentic Search for Image Generation30 Mar

Other references · 27

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  4. 2022Classifier-Free Diffusion Guidancecited by 5,847
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
  7. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  8. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
  9. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  10. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  11. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
  12. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
15 more
  1. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
  2. 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 171
  3. 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 102
  4. 2017Learning to Infer Graphics Programs from Hand-Drawn Imagescited by 74
  5. 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 74
  6. 2019Learning to Paint With Model-based Deep Reinforcement Learningcited by 71
  7. 2021Paint Transformer: Feed Forward Neural Painting with Stroke Predictioncited by 62
  8. 2024SketchAgent: Language-Driven Sequential Sketch Generationcited by 31
  9. 2025Multimodal RewardBench 2: Evaluating Omni Reward Models for Interleaved Text and Imagecited by 20
  10. 2025InternSVG: Towards Unified SVG Tasks with Multimodal Large Language Modelscited by 14
  11. 2026BizGenEval: A Systematic Benchmark for Commercial Visual Content Generationcited by 11
  12. 2026WorldBench: A Challenging and Visually Diverse Multimodal Reasoning Benchmarkcited by 4
  13. 2025VisionDirector: Vision-Language Guided Closed-Loop Refinement for Generative Image Synthesiscited by 3
  14. 2026Arena-T2I Hard: Benchmarking and Improving Faithfulness with Dependency-Aware Checklistcited by 2
  15. 2026MaLiang-Harness: A Programmable Path to Image and Video Generationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GenClaw: Code-Driven Agentic Image Generation
  2. 2026ManimAgent: Self-Evolving Multimodal Agents for Visual Education
  3. 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides
  4. 2026PainterBench: A Figural Divergent-Thinking Benchmark for Tool-Using Language Models
  5. 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generation
  6. 2025CodeV: Code with Images for Faithful Visual Reasoning via Tool-Aware Policy Optimization
  7. 2026Beyond Pixels: Visual Metaphor Transfer via Schema-Driven Agentic Reasoning
  8. 2025See it. Say it. Sorted: Agentic System for Compositional Diagram Generation