From Fuzzy to Exact: The Halo Architecture for Infinite-Depth Reasoning via Rational Arithmetic
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
The prevailing scaling paradigm of Large Language Models (LLMs) rests on a substrate of "Fuzzy" floating-point arithmetic. To mitigate the inherent instability of this approximate foundation, modern architectures have erected a complex scaffolding of structural and numerical heuristics--Complex Residuals, Pre-RMSNorm, Attention Scaling, and Gradient Clipping--consuming significant compute solely to prevent numerical collapse. We propose a paradigm shift to the "Exact". We introduce the Halo Architecture, grounded in the Rational Field (Q) and powered by a custom Exact Inference Unit (EIU). To resolve the exponential bit-width growth of rational arithmetic, Halo employs a Dual-Ring Topology that unifies two complementary control mechanisms: (1) The Micro-Ring (Continuum Maintenance), which strictly bounds memory complexity via Diophantine Approximation; and (2) The Macro-Ring (Symbolic Alignment), which enforces logical consistency via periodic state collapse. This stable dual-ring substrate allows for the "Great Dismantling" of numerical scaffolding, reducing the Transformer block to its "Clean" algebraic form (Tabula Rasa). Furthermore, we verify the "Efficiency Paradox": the elimination of gradient noise (sigma -> 0) allows for Macro-Learning Rates, potentially reducing the Total Time-to-Convergence by orders of magnitude. Halo demonstrates that General Intelligence requires the hybridization of continuous fields and discrete chains under a rigorous mathematical framework.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 20 of its 35 references that are in the map. First posted on arXiv 26 Jan 2026.
Builds on
20 of 35 references.
References · 20
- 2017Attention Is All You Needcited by 60,361
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2017Neural Discrete Representation Learningcited by 4,712
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
- 2017Mixed Precision Trainingcited by 1,156
- 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 906
- 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 415
- 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 372
8 more
- 2019Analysing Mathematical Reasoning Abilities of Neural Modelscited by 335
- 2017A Semantic Loss Function for Deep Learning with Symbolic Knowledgecited by 270
- 2016Exponential expressivity in deep neural networks through transient chaoscited by 261
- 2019Time-Series Anomaly Detection Service at Microsoftcited by 165
- 2021Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoningcited by 85
- 2020Rational neural networkscited by 75
- 2018Neural Arithmetic Logic Unitscited by 70
- 2017Attacking Binarized Neural Networkscited by 29
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026CFNN: Continued Fraction Neural Networkcited by 0
- 2026CFNN: Continued Fraction Neural Network21 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Efficient numeracy in language models through single-token number embeddings
- 2023Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic Reasoning
- 2024Unraveling Arithmetic in Large Language Models: The Role of Algebraic Structures
- 2025M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models
- 2024FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language Models
- 2025Scalable LLM Reasoning Acceleration with Low-rank Distillation
- 2025Quantization Meets Reasoning: Exploring and Mitigating Degradation of Low-Bit LLMs in Mathematical Reasoning
- 2025A Survey on Mathematical Reasoning and Optimization with Large Language Models