ConceptCoder: Improve Code Reasoning via Concept Learning
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Large language models (LLMs) have shown promising results for software engineering applications, but still struggle with code reasoning tasks such as vulnerability detection (VD). We introduce ConceptCoder, a fine-tuning method that simulates human code inspection: models are trained to first recognize code concepts and then perform reasoning on top of these concepts. In prior work, concepts are extracted by multimodal models or LLMs to explain vision and natural language models. Our work is the first to formulate concepts for code. We define code concepts as human-understandable semantic properties of code and train models to learn such concepts. Our evaluation shows that this approach significantly improves VD accuracy, from 66.32 to 72.15 F1 on average over 9 open-source LLMs. ConceptCoder achieves the best VD performance compared to state-of-the-art (SOTA) baselines, including fine-tuned SOTA open-source LLMs and prompted proprietary models such as GPT-5.2 and Claude-Opus-4.5. Our approach also scales: concepts defined from four types of vulnerabilities benefit general vulnerability datasets with 134 CWEs. We further demonstrate that concept-based fine-tuning generalizes beyond VD and improves branch prediction. We release our code and datasets at https://figshare.com/s/1decab8232c653b44f71.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 13 of its 59 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
13 of 59 references.
Closest ancestors · 2
Same direction, newest first
- 2025Teaching LLMs to Plan: Logical Chain-of-Thought Instruction Tuning for Symbolic Planning14 Sep
- 2024Qwen2.5-Coder Technical Report18 Sep
Other references · 11
- 2023Code Llama: Open Foundation Models for Codecited by 2,139
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
- 2023StarCoder: may the source be with you!cited by 799
- 2023Label-Free Concept Bottleneck Modelscited by 285
- 2023Demystifying CLIP Datacited by 270
- 2021CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Taskscited by 200
- 2019Interpretability Beyond Classification Output: Semantic Bottleneck Networkscited by 49
- 2024Concept Bottleneck Large Language Modelscited by 43
- 2024Search-Based LLMs for Code Optimizationcited by 28
- 2024ROCODE: Integrating Backtracking Mechanism and Program Analysis in Large Language Models for Code Generationcited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024To Err is Machine: Vulnerability Detection Challenges LLM Reasoning
- 2025VulInstruct: Teaching LLMs Root-Cause Reasoning for Vulnerability Detection via Security Specifications
- 2024Towards Explainable Vulnerability Detection with Large Language Models
- 2024LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoning
- 2026Do Fine-Tuned LLMs Understand Vulnerabilities? An Investigation into the Semantic Trap
- 2025Boosting Vulnerability Detection of LLMs via Curriculum Preference Optimization with Synthetic Reasoning Data
- 2025Reasoning with LLMs for Zero-Shot Vulnerability Detection
- 2025SV-TrustEval-C: Evaluating Structure and Semantic Reasoning in Large Language Models for Source Code Vulnerability Analysis