Self-Evolving Code-with-Image Reasoning
On the map: Synthetic data and self-improvement for LLMs → Self-improving MLLMs and synthetic data
Abstract (arXiv)
Multimodal models increasingly reach for tools when solving visual tasks (crop, zoom, rotate, brighten), a paradigm known as thinking-with-images. The central challenge is one of perception: tools mostly serve to expose visual evidence, reasoning over that evidence stays in language, and most targets are ones a human could in principle determine by inspection. Some visual questions, however, are not bottlenecked by perception: recovering their answers requires executing a multi-step visual algorithm over the pixels. On such questions a model often names the correct algorithm at once yet still answers wrong, because language can describe an algorithm without being able to run one. Code-with-Image crosses that line: given nothing but a Python interpreter, the model must implement a genuine visual algorithm in code to solve the task; the program itself becomes the reasoning. The bottleneck then shifts from executing code to deciding which algorithm to implement. So we let the model teach itself: a training-free reflection loop studies its own failed programs, tests repairs against constructive ground truth, and keeps what survives as portable skills. On our Code-with-Image Bench (CwI-Bench), thirty task families induced by hidden visual computations with disjoint learning and evaluation splits, even GPT-5.6-luna stays below 30% with tool-free chain of thought; given a bare interpreter it reaches 43%, and with skills evolved through its own executable reflection, 67%. The open 27B model climbs the same ladder (9% rightarrow 33% rightarrow 56%), and the skills are plain text, transferable across scales and families. When code carries the reasoning, debugging code becomes debugging reasoning.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Self-improving MLLMs and synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 41 of its 43 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
41 of 43 references.
References · 41
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2013Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programmingcited by 716
- 2022PAL: Program-aided Language Modelscited by 635
- 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
29 more
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
- 2022Visual Programming: Compositional visual reasoning without trainingcited by 507
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
- 2023Fine-Tuning Language Models with Just Forward Passescited by 337
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 260
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
- 2025Thyme: Think Beyond Imagescited by 160
- 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 151
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 122
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 119
- 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systemscited by 96
- 2025PyVision: Agentic Vision with Dynamic Toolingcited by 71
- 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agentscited by 71
- 2025TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoningcited by 34
- 2025Beyond Seeing: Evaluating Multimodal LLMs on Tool-Enabled Image Perception, Transformation, and Reasoningcited by 28
- 2025CodeV: Code with Images for Faithful Visual Reasoning via Tool-Aware Policy Optimizationcited by 24
- 2026AgentVista: Evaluating Multimodal Agents in Ultra-Challenging Realistic Visual Scenarioscited by 22
- 2026SkillOpt-Lite: Better and Faster Agent Self-evolution via One Line of Vibecited by 18
- 2025CodeDance: A Dynamic Tool-integrated MLLM for Executable Visual Reasoningcited by 16
- 2026PyVision-RL: Forging Open Agentic Vision Models via RLcited by 14
- 2025Thinking with Programming Vision: Towards a Unified View for Thinking with Imagescited by 13
- 2026VTC-Bench: Evaluating Agentic Multimodal Models via Compositional Visual Tool Chainingcited by 12
- 2026Hypothesis-Driven Skill Optimization for LLM Agentscited by 6
- 2026Agentic-MME: What Agentic Capability Really Brings to Multimodal Intelligence?cited by 4
- 2026Do Multimodal Agents Really Benefit from Tool Use? A Systematic Study of Capability Gainscited by 4
- 2026SPyCE: Skill-Policy Co-evolution for Multimodal Agentscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026AnyJev Technical Reportcited by 0
- 2026AnyJev Technical Report30 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025RECODE: Reasoning Through Code Generation for Visual Question Answering
- 2025From Illusion to Intention: Visual Rationale Learning for Vision-Language Reasoning
- 2025DeepSketcher: Internalizing Visual Manipulation for Multimodal Reasoning
- 2026MM-OPD: Towards One More Bottleneck Between Perception and Reasoning
- 2026Are VLMs Seeing or Just Saying? Uncovering the Illusion of Visual Re-examination
- 2026ManimAgent: Self-Evolving Multimodal Agents for Visual Education
- 2026Thinking With Tools, Not With Pixels: Tool Calls as Text Scaffolds for Visual Reasoning
- 2025Evolutionary Prompt Optimization Discovers Emergent Multimodal Reasoning Strategies in Vision-Language Models