mlsanityData to 7 Oct 2026

Reasoning Distillation for Lightweight Automated Program Repair

arXiv 2601.10987 ↗First posted 16 Jan 2026cs.LGcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

We study whether lightweight symbolic reasoning supervision can improve fix type classification in compact automated program repair models. Small code models are attractive for resource-constrained settings, but they typically produce only a single prediction, making it unclear whether they learn meaningful program structure or rely on shallow correlations. We propose a reasoning distillation approach in which a large teacher model provides structured symbolic reasoning tags alongside fix-type labels. These tags capture high-level causal properties of bugs without relying on free-form explanations. We train a CodeT5-based student model under label-only and reasoning-distilled settings on the IntroClass benchmark. Reasoning supervision consistently improves macro averaged performance, particularly on less frequent bug categories, without increasing model size or complexity. We further analyze the relationship between reasoning accuracy and fix-type prediction, showing that correct reasoning traces strongly correlate with correct predictions, while not fully determining them. Our results suggest that symbolic reasoning distillation is a practical way to improve interpretability and robustness in lightweight program repair models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 4 of its 8 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

4 of 8 references.

References · 4

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  4. 2023Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Stepcited by 144

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Historical Patches to Repair Plans: Outcome-Conditioned Reasoning for Repository-Level Program Repair
  2. 2025T3: Multi-level Tree-based Automatic Program Repair with Large Language Models
  3. 2025Optimizing Token Consumption in LLMs: A Nano Surge Approach for Code Reasoning Efficiency
  4. 2026RGFL: Reasoning Guided Fault Localization for Automated Program Repair Using Large Language Models
  5. 2025Automated Repair of C Programs Using Large Language Models
  6. 2024ThinkRepair: Self-Directed Automated Program Repair
  7. 2025The Art of Repair: Optimizing Iterative Program Repair with Instruction-Tuned Models
  8. 2025BloomAPR: A Bloom's Taxonomy-based Framework for Assessing the Capabilities of LLM-Powered APR Solutions