Neuron Level Analysis of Large Language Model in Legal Domain Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
We presented a neuron-level analysis of legal-domain reasoning in LLMs, comparing it with other applied domain tasks across seven open-weight models. Using neuron attribution scores to rank and suppress influential neurons, we confirmed that suppressing the identified neurons collapses accuracy on the target task, whereas suppressing the same number of random neurons does not. We further found a small subset of neurons influential across all seven tasks; once these are removed, suppressing the remaining neurons degrades only the task they were identified from, revealing genuinely task-specific neurons in every model studied. Within the legal domain, the three benchmarks exhibit relatively high neuron overlap and tend to be affected jointly, suggesting of legal components neurons that span jurisdictions. The distribution of identified neurons in our experiments suggests that the hypothesis that influential neurons are concentrated in middle MLP layers may depend on the input format and content, rather than being a universal phenomenon.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 8 of its 42 references that are in the map. First posted on arXiv 14 Jun 2026.
Builds on
8 of 42 references.
References · 8
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2025Olmo 3cited by 129
- 2026From Interpretability to Performance: Optimizing Retrieval Heads for Long-Context Language Modelscited by 4
- 2025JBE-QA: Japanese Bar Exam QA Dataset for Assessing Legal Domain Knowledgecited by 1
- 2026Reasoning Models Know What's Important, and Encode It in Their Activationscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026NeuroSymbolic AI for Legal AI-TRISM: Trustworthy, Reliable, Interpretable, Safe Models
- 2026LePREC: Reasoning as Classification over Structured Factors for Assessing Relevance of Legal Issues
- 2026Reasoners or Translators? Contamination-aware Evaluation and Neuro-Symbolic Robustness in Tax Law
- 2026Decodable But Not Detachable: Training Data Granularity Determines Parametric Modularity in Large Language Models
- 2025Do LLMs Signal When They're Right? Evidence from Neuron Agreement
- 2025Explainable Rule Application via Structured Prompting: A Neural-Symbolic Approach
- 2026Bridging Legal Interpretation and Formal Logic: Faithfulness, Assumption, and the Future of AI Legal Reasoning
- 2025Auxiliary Metrics Help Decoding Skill Neurons in the Wild