Recursive Dynamics in Fast-Weights Homeostatic Reentry Networks: Toward Reflective Intelligence
Not on the map. Why?
Abstract (arXiv)
This study introduces the Fast-Weights Homeostatic Reentry Layer (FH-RL), a neural mechanism that integrates fast-weight associative memory, homeostatic regularization, and learned reentrant feedback to approximate self-referential computation in neural networks. Unlike standard transformer architectures that operate in a purely feedforward manner during inference, FH-RL enables internal recurrence without external looping, allowing prior latent states to be dynamically re-entered into the ongoing computation stream. We conduct controlled experiments sweeping the reentry gain γ and evaluate emergent internal dynamics using three novel metrics: the Information Reentry Ratio (IRR), Eigen-Spectrum Recursion Index (ESRI), and Representational Drift Periodicity (RDP). Results show that reentry quantity increases proportionally with~γ, while the learned feedback matrix Wr remains bounded and becomes more structured at moderate gains. Critically, a stable reflective band emerges around γ ≈ 0.10-0.20, where internal feedback is maximally expressive yet spectrally stable: IRR rises smoothly, ESRI remains near zero, and RDP exhibits consistent low-frequency cycles. These findings provide quantitative evidence that reflective, thought-like internal processing can arise from a principled balance between feedback amplification and homeostatic regulation, linking modern fast-weight architectures to theories of cortical reentry and recursive cognition.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 24 references that are in the map. First posted on arXiv 10 Nov 2025.
Builds on
10 of 24 references.
References · 10
- 2017Attention Is All You Needcited by 60,361
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
- 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 613
- 2021Linear Transformers Are Secretly Fast Weight Programmerscited by 502
- 2016Using Fast Weights to Attend to the Recent Pastcited by 170
- 2018Differentiable plasticity: training plastic neural networks with backpropagationcited by 84
- 2022A Modern Self-Referential Weight Matrix That Learns to Modify Itselfcited by 41
Built on by
Citing papers per year: 2025: 1.
1 paper.