Interpretable by AI Mother Tongue: Native Symbolic Reasoning in Neural Models
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
We present a framework where neural models develop an AI Mother Tongue, a native symbolic language that simultaneously supports intuitive reasoning, compositional symbol chains, and inherent interpretability. Unlike post-hoc explanation methods, our approach embeds reasoning directly into the model's representations: symbols capture meaningful semantic patterns, chains trace decision paths, and gated induction mechanisms guide selective focus, yielding transparent yet flexible reasoning. We introduce complementary training objectives to enhance symbol purity and decision sparsity, and employ a sequential specialization strategy to first build broad symbolic competence and then refine intuitive judgments. Experiments on AI tasks demonstrate competitive accuracy alongside verifiable reasoning traces, showing that AI Mother Tongue can serve as a unified mechanism for interpretability, intuition, and symbolic reasoning in neural models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 5 of its 7 references that are in the map. First posted on arXiv 26 Aug 2025.
Builds on
5 of 7 references.
References · 5
- 2017Neural Discrete Representation Learningcited by 4,712
- 2019Generating Long Sequences with Sparse Transformerscited by 1,546
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 627
- 2025AI Mother Tongue: Self-Emergent Communication in MARL via Endogenous Symbol Systemscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Emergent Symbolic Mechanisms Support Abstract Reasoning in Large Language Models
- 2022Is Neuro-Symbolic AI Meeting its Promise in Natural Language Processing? A Structured Review
- 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning
- 2024Reasoning Circuits in Language Models: A Mechanistic Interpretation of Syllogistic Inference
- 2025Neuro-Symbolic Artificial Intelligence: Towards Improving the Reasoning Abilities of Large Language Models
- 2025PEIRCE: Unifying Material and Formal Reasoning via LLM-Driven Neuro-Symbolic Refinement
- 2025Semantic Deception: When Reasoning Models Can't Compute an Addition
- 2026Delta1 with LLM: symbolic and neural integration for credible and explainable reasoning