Compressed Recurrent Feedback in Tsetlin Machines: A Reproducible Boolean-FSM Study
Not on the map. Why?
Abstract (arXiv)
Sequential inference on small devices requires a model to retain useful history without repeatedly processing a long input record. A Recurrent Tsetlin Machine (RTM) provides this memory by returning Boolean clause outputs from one time step as inputs to the next. Direct feedback, however, grows with the clause bank and can make the recurrent input unnecessarily wide. This paper investigates a fixed-width alternative. We combine clause activations by exclusive-OR (XOR) folding, retain the folded bits at two time scales, and threshold them back to a binary state. The resulting design reduces 480 clause activations to 96 recurrent bits. We evaluate the method on a reproducible Boolean finite-state-machine benchmark with explicit transition rules, data splits, and random seeds. Across 144 runs, the compressed model obtains 61.47 ± 6.74% and 62.94 ± 9.92% accuracy on the two task families. Raw clause feedback changes these means by less than one percentage point, while increasing the recurrent width tenfold and measured host execution time by 4.38× and 3.71×. Gated neural models remain more accurate, and a no-feedback control retaining only short input history achieves comparable or slightly higher accuracy. On this benchmark, folding matches raw feedback within small empirical margins at a much narrower interface; these findings also underscore the critical necessity of no-feedback recurrence controls when benchmarking sequence models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 20 references that are in the map. First posted on arXiv 5 Sep 2026.
Builds on
12 of 20 references.
References · 12
- 2017Attention Is All You Needcited by 59,932
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2019Designing and Interpreting Probes with Control Taskscited by 608
- 2017Efficient Processing of Deep Neural Networks: A Tutorial and Surveycited by 427
- 2018The Tsetlin Machine -- A Game Theoretic Bandit Driven Approach to Optimal Pattern Recognition with Propositional Logiccited by 71
- 2019The Convolutional Tsetlin Machinecited by 37
- 2020On the Convergence of Tsetlin Machines for the IDENTITY- and NOT Operatorscited by 23
- 2020Massively Parallel and Asynchronous Tsetlin Machine Architecture Supporting Almost Constant-Time Scalingcited by 20
- 2019A Tsetlin Machine with Multigranular Clausescited by 5
- 2019The Weighted Tsetlin Machine: Compressed Representations with Weighted Clausescited by 3
- 2024MATADOR: Automated System-on-Chip Tsetlin Machine Design Generation for Edge Applicationscited by 3
- 2026Low-Energy Reduced RISC-V Instruction Subset Processor for Tsetlin Machine Inference at the Edgecited by 1
Built on by
Not cited yet.