mlsanityData to 7 Oct 2026

Self-Evolving Code-with-Image Reasoning

arXiv 2608.11292 ↗First posted 11 Aug 2026cs.CVcited by 1

On the map: Synthetic data and self-improvement for LLMs → Self-improving MLLMs and synthetic data

Abstract (arXiv)

Multimodal models increasingly reach for tools when solving visual tasks (crop, zoom, rotate, brighten), a paradigm known as thinking-with-images. The central challenge is one of perception: tools mostly serve to expose visual evidence, reasoning over that evidence stays in language, and most targets are ones a human could in principle determine by inspection. Some visual questions, however, are not bottlenecked by perception: recovering their answers requires executing a multi-step visual algorithm over the pixels. On such questions a model often names the correct algorithm at once yet still answers wrong, because language can describe an algorithm without being able to run one. Code-with-Image crosses that line: given nothing but a Python interpreter, the model must implement a genuine visual algorithm in code to solve the task; the program itself becomes the reasoning. The bottleneck then shifts from executing code to deciding which algorithm to implement. So we let the model teach itself: a training-free reflection loop studies its own failed programs, tests repairs against constructive ground truth, and keeps what survives as portable skills. On our Code-with-Image Bench (CwI-Bench), thirty task families induced by hidden visual computations with disjoint learning and evaluation splits, even GPT-5.6-luna stays below 30% with tool-free chain of thought; given a bare interpreter it reaches 43%, and with skills evolved through its own executable reflection, 67%. The open 27B model climbs the same ladder (9% rightarrow 33% rightarrow 56%), and the skills are plain text, transferable across scales and families. When code carries the reasoning, debugging code becomes debugging reasoning.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Self-improving MLLMs and synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 41 of its 43 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

41 of 43 references.

References · 41

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  4. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  5. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
  6. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  7. 2023Teaching Large Language Models to Self-Debugcited by 963
  8. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  9. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  10. 2013Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programmingcited by 716
  11. 2022PAL: Program-aided Language Modelscited by 635
  12. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
29 more
  1. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
  2. 2022Visual Programming: Compositional visual reasoning without trainingcited by 507
  3. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  4. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  5. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
  6. 2023Fine-Tuning Language Models with Just Forward Passescited by 337
  7. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
  8. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 260
  9. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
  10. 2025Thyme: Think Beyond Imagescited by 160
  11. 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 151
  12. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 122
  13. 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 119
  14. 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systemscited by 96
  15. 2025PyVision: Agentic Vision with Dynamic Toolingcited by 71
  16. 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agentscited by 71
  17. 2025TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoningcited by 34
  18. 2025Beyond Seeing: Evaluating Multimodal LLMs on Tool-Enabled Image Perception, Transformation, and Reasoningcited by 28
  19. 2025CodeV: Code with Images for Faithful Visual Reasoning via Tool-Aware Policy Optimizationcited by 24
  20. 2026AgentVista: Evaluating Multimodal Agents in Ultra-Challenging Realistic Visual Scenarioscited by 22
  21. 2026SkillOpt-Lite: Better and Faster Agent Self-evolution via One Line of Vibecited by 18
  22. 2025CodeDance: A Dynamic Tool-integrated MLLM for Executable Visual Reasoningcited by 16
  23. 2026PyVision-RL: Forging Open Agentic Vision Models via RLcited by 14
  24. 2025Thinking with Programming Vision: Towards a Unified View for Thinking with Imagescited by 13
  25. 2026VTC-Bench: Evaluating Agentic Multimodal Models via Compositional Visual Tool Chainingcited by 12
  26. 2026Hypothesis-Driven Skill Optimization for LLM Agentscited by 6
  27. 2026Agentic-MME: What Agentic Capability Really Brings to Multimodal Intelligence?cited by 4
  28. 2026Do Multimodal Agents Really Benefit from Tool Use? A Systematic Study of Capability Gainscited by 4
  29. 2026SPyCE: Skill-Policy Co-evolution for Multimodal Agentscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025RECODE: Reasoning Through Code Generation for Visual Question Answering
  2. 2025From Illusion to Intention: Visual Rationale Learning for Vision-Language Reasoning
  3. 2025DeepSketcher: Internalizing Visual Manipulation for Multimodal Reasoning
  4. 2026MM-OPD: Towards One More Bottleneck Between Perception and Reasoning
  5. 2026Are VLMs Seeing or Just Saying? Uncovering the Illusion of Visual Re-examination
  6. 2026ManimAgent: Self-Evolving Multimodal Agents for Visual Education
  7. 2026Thinking With Tools, Not With Pixels: Tool Calls as Text Scaffolds for Visual Reasoning
  8. 2025Evolutionary Prompt Optimization Discovers Emergent Multimodal Reasoning Strategies in Vision-Language Models