A PyTorch Library of Turing-Complete Neural Networks
Not on the map. Why?
Abstract (arXiv)
We present a PyTorch package that compiles neural networks and their weights from Turing machine descriptions, producing models that exactly simulate the specified machine without any training. Given a transition function and a set of terminal states, the package constructs a model whose forward pass corresponds to one step of the Turing machine. Two architectures are implemented, each realizing a different theoretical result: (1) a transformer with self-attention, cross-attention, and feedforward layers based on Wei, Chen, and Ma (2021), and (2) a recurrent network based on Siegelmann and Sontag (1995) that encodes the stack in a Cantor set. We develop the constructions from first principles, showing how ReLU networks implement Boolean circuits (AND, OR, NOT, XOR gates and their composition into DNF formulas and binary adders) and how hard attention implements positional lookup on the tape. The package serves as a concrete, runnable reference for the symbolic-neural bridge, and as a foundation for future work on the stability of constructed solutions under gradient-based optimization. Code is available at https://github.com/jonrbates/turing.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 17 references that are in the map. First posted on arXiv 3 May 2026.
Builds on
7 of 17 references.
References · 7
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Neural Turing Machinescited by 630
- 2024Chain of Thought Empowers Transformers to Solve Inherently Serial Problemscited by 256
- 2021Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformerscited by 101
- 2020On the Computational Power of Transformers and its Implications in Sequence Modelingcited by 85
- 2025Constant Bit-size Transformers Are Turing Completecited by 19
- 2024Mechanisms of Symbol Processing for In-Context Learning in Transformer Networkscited by 6
Built on by
Not cited yet.