mlsanityData to 7 Oct 2026

Temporal Coding as a Substrate for Sensorimotor Object Inference: A Spiking Reinterpretation of Thousand Brains Architecture

arXiv 2605.22206 ↗First posted 21 May 2026cs.NE cs.AI cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

The Thousand Brains Theory (TBT) and its open-source Monty framework model object recognition through sensorimotor inference -- identifying objects by actively moving a sensor across their surface and building evidence contact by contact. The current implementation encodes each contact as a dense floating-point vector. While Monty tracks inter-step displacement and accumulates evidence across contacts, it treats the feature activation pattern at each contact as an unordered set - the directional sequence in which features are encountered carries no representational weight. In TBT, the sequence of contacts carries spatial meaning: knowing that feature A was felt before feature B during a left-to-right sweep tells you something about where A and B sit on the object. Dense vectors discard this ordering. We propose replacing dense vectors with rank-order spike packets: each contact produces a brief burst of neural events where the most strongly activated neuron fires first. The time gap between successive bursts implicitly encodes sensor displacement without explicit coordinate calculations. A biologically motivated learning rule (STDP) encodes traversal direction into synaptic weights. A learnable parameter lambda adjusts reliance on earlier versus recent contacts, adapting to each object's geometry. We derive three testable predictions and specify an implementation of four components in approximately 450 lines of NumPy. Three synthetic experiments confirm the core claims: temporal coding achieves perfect discrimination accuracy on objects with identical features in different spatial arrangements, where dense accumulation performs at chance; temporal coding maintains a 30-50 percentage point advantage across all tested noise levels; the adaptive lambda converges to distinct values, reflecting object geometric complexity. End-to-end evaluation on Monty's YCB benchmark is left for future work.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 20 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

6 of 20 references.

References · 6

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019Event-based Vision: A Surveycited by 1,010
  3. 2021Sequence learning, prediction, and replay in networks of spiking neuronscited by 5
  4. 2024The Thousand Brains Project: A New Paradigm for Sensorimotor Intelligencecited by 5
  5. 2022Event-Driven Tactile Learning with Location Spiking Neuronscited by 1
  6. 2024Context Gating in Spiking Neural Networks: Achieving Lifelong Learning through Integration of Local and Global Plasticitycited by 1

Built on by

Not cited yet.