mlsanityData to 7 Oct 2026

Logic-Gated Time-Shared Feedforward Networks for Alternating Finite Automata: Exact Simulation and Learnability

arXiv 2604.01228 ↗First posted 20 Mar 2026cs.FL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a formal and constructive framework for simulating Alternating Finite Automata (AFAs) using Logic-Gated Time-Shared Feedforward Networks (LG-TS-FFNs). Unlike prior neural automata models limited to Nondeterministic Finite Automata (NFAs) and existential reachability, our architecture integrates learnable, state-dependent biases that function as differentiable logic gates, enabling the representation of both Existential textsctextscOR and Universal textsctextscAND aggregation within a shared-parameter linear recurrence. We prove that this architectural modification upgrades the network's computational class to be structurally isomorphic to AFAs, thereby inheriting their exponential succinctness: the network can represent regular languages requiring 2n states in an NFA with only n neurons. We rigorously establish that the forward pass of an LG-TS-FFN exactly simulates the reachability dynamics of an AFA, including instantaneous varepsilon-closures. Furthermore, we demonstrate empirical learnability: a continuous relaxation of the logic gates allows the network to simultaneously recover the automaton's topology and logical semantics from binary labels via standard gradient descent. Extensive experiments confirm that our model achieves perfect recovery of ground-truth automata, bridging the gap between statistical learning and succinct, universal logical reasoning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

29 of 60 references.

References · 29

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  4. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  5. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  6. 2018DARTS: Differentiable Architecture Searchcited by 1,782
  7. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 607
  8. 2018SNAS: Stochastic Neural Architecture Searchcited by 288
  9. 2019Theoretical Limitations of Self-Attention in Neural Sequence Modelscited by 286
  10. 2017Learning Explanatory Rules from Noisy Datacited by 210
  11. 2018Learning a SAT Solver from Single-Bit Supervisioncited by 198
  12. 2018Efficient Formal Safety Analysis of Neural Networkscited by 165
17 more
  1. 2019Neural Logic Machinescited by 144
  2. 2017Logic Tensor Networks for Semantic Image Interpretationcited by 92
  3. 2017Extracting Automata from Recurrent Neural Networks Using Queries and Counterexamplescited by 66
  4. 2020A Formal Hierarchy of RNN Architecturescited by 61
  5. 2019Sequential Neural Networks as Automatacited by 54
  6. 2024The Expressive Capacity of State Space Models: A Formal Language Perspectivecited by 45
  7. 2021Differentiable Sorting Networks for Scalable Sorting and Ranking Supervisioncited by 31
  8. 2024On the Expressiveness and Length Generalization of Selective State-Space Models on Regular Languagescited by 15
  9. 2025Neural Network Verification is a Programming Language Challengecited by 12
  10. 2025Differentiable Logic Cellular Automata: From Game of Life to Pattern Generationcited by 9
  11. 2024Neural Model Checkingcited by 6
  12. 2025Transformers are Inherently Succinctcited by 4
  13. 2025Neural Networks as Universal Finite-State Machines: A Constructive Deterministic Finite Automaton Theorycited by 3
  14. 2025A Constructive Framework for Nondeterministic Automata via Time-Shared, Depth-Unrolled Feedforward Networkscited by 2
  15. 2025RNN Generalization to Omega-Regular Languagescited by 1
  16. 2025Symbolic Feedforward Networks for Probabilistic Finite Automata: Exact Simulation and Learnabilitycited by 1
  17. 2026Warm Starting State-Space Models with Automata Learningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Simulating Weighted Automata over Sequences and Trees with Transformers
  2. 2025Finite State Automata Inside Transformers with Chain-of-Thought: A Mechanistic Study on State Tracking
  3. 2022Transformers Learn Shortcuts to Automata
  4. 2025Beyond Memorization: Extending Reasoning Depth with Recurrence, Memory and Test-Time Compute Scaling
  5. 2026Length-Independent State Tracking Under a Parallel Scan
  6. 2025Bridging Expressivity and Scalability with Adaptive Unitary SSMs
  7. 2026Stabilizing Recurrent Dynamics for Test-Time Scalable Latent Reasoning in Looped Language Models
  8. 2024L^*LM: Learning Automata from Examples using Natural Language Oracles