mlsanityData to 14 Oct 2026

Causal Syntax Circuits in CodeLMs: Budget and Probe Decide What Looks Localised

arXiv 2610.20683 ↗First posted 14 Oct 2026cs.LG cs.SEcited by 0

On the map: Mechanistic interpretability → Activation steering methods also fits: Knowledge and representations inside LLMs

Abstract (arXiv)

Code models write Python when the prompt does not say which language to use. We ask a mechanistic question about that habit: is it produced by a small, findable group of components inside the model? We run one pipeline---mean ablation, activation patching, greedy circuit extraction, a random-control significance test, and activation steering---over 55 model-language settings spanning ten open code models (five base and five instruction-tuned), three target languages (Rust, C#, PHP), two prompt suites, and two component budgets. We report five findings. First, the preference is large, grows with model size, and survives instruction tuning: it is larger on every instruction-tuned checkpoint than on its base version, by 12% on average. Second, its measured size is mostly a property of the probe; replacing our aligned prompts with XLCoST parallel functions takes the same measurement on the same models from about 1.6 to about 0.01. Third, whether the preference looks localised depends on how many components the search may keep: with a budget of 12, 1 of 15 settings yields a circuit that beats size-matched random controls after multiple-comparison correction, and with a budget of 40, 6 of 15 do. Fourth, interventions that a smaller-budget study reports as uniformly failing do sometimes succeed: patching makes a Python prompt prefer target syntax in 2 of 45 settings, and steering changes the most likely next token in 9 of 45. Fifth, every circuit whose effect is significant but points away from the target language comes from a setting where circuit extraction failed, which makes such results a diagnostic rather than a phenomenon. The practical lesson is that a claim about whether a behaviour is localised can turn on analysis choices that papers rarely report. We release the full grid so those choices can be varied.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Activation steering methods, one of 13 directions in Mechanistic interpretability. First posted on arXiv 14 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026What, Where, and How: Disentangling the Roles of Task, Language, and Model in Code Model Representations
  2. 2025Localized Calibrated Uncertainty in Code Language Models
  3. 2025On Code-Induced Reasoning in LLMs
  4. 2026Steering Code LLMs with Activation Directions for Language and Library Control
  5. 2024What Makes Large Language Models Reason in (Multi-Turn) Code Generation?
  6. 2026CodeEval: A pedagogical approach for targeted evaluation of code-trained Large Language Models
  7. 2026VeriInteresting: An Empirical Study of Model Prompt Interactions in Verilog Code Generation
  8. 2026LangChoiceBench: Measuring and Explaining Programming-Language Choice in LLMs