VisualCoder: Guiding Large Language Models in Code Execution with Fine-grained Multimodal Chain-of-Thought Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Predicting program behavior and reasoning about code execution remain significant challenges in software engineering, particularly for large language models (LLMs) designed for code analysis. While these models excel at understanding static syntax, they often struggle with dynamic reasoning tasks. We introduce VisualCoder, a simple yet effective approach that enhances code reasoning by integrating multimodal Chain-of-Thought (CoT) reasoning with a visual Control Flow Graph (CFG). By aligning code snippets with their corresponding CFGs, VisualCoder provides deeper insights into execution flows. We address challenges in multimodal CoT integration through a reference mechanism, ensuring consistency between code and its execution path, thereby improving performance in program behavior prediction, error detection, and output generation.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 22 of its 64 references that are in the map. First posted on arXiv 30 Oct 2024.
Builds on
22 of 64 references.
Closest ancestors · 3
Same direction, newest first
- 2024CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs2 Oct
- 2024Qwen2.5-Coder Technical Report18 Sep
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code12 Mar
Other references · 19
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023Code Llama: Open Foundation Models for Codecited by 2,139
- 2024Mixtral of Expertscited by 1,823
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
- 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
- 2024StarCoder 2 and The Stack v2: The Next Generationcited by 502
- 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 333
- 2023OctoPack: Instruction Tuning Code Large Language Modelscited by 189
7 more
- 2023CodeGen2: Lessons for Training LLMs on Programming and Natural Languagescited by 125
- 2022Execution-Based Evaluation for Open-Domain Code Generationcited by 91
- 2024HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scalecited by 61
- 2024RepoHyper: Search-Expand-Refine on Semantic Graphs for Repository-Level Code Completioncited by 15
- 2023Better Language Models of Code through Self-Improvementcited by 14
- 2024Scaling Granite Code Models to 128K Contextcited by 11
- 2024CodeFlow: Program Behavior Prediction with Dynamic Dependencies Learningcited by 3
Built on by
Citing papers per year: 2025: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence
- 2025A Tool for In-depth Analysis of Code Execution Reasoning of Large Language Models
- 2024SemCoder: Training Code Language Models with Comprehensive Semantics Reasoning
- 2025Code Execution as Grounded Supervision for LLM Reasoning
- 2025Demystifying Errors in LLM Reasoning Traces: An Empirical Study of Code Execution Simulation
- 2026CodeGlance: Understanding Code Reasoning Challenges in LLMs through Multi-Dimensional Feature Analysis
- 2025Chain of Execution Supervision Promotes General Reasoning in Large Language Models
- 2026The Path Not Taken: Duality in Reasoning about Program Execution