mlsanityData to 7 Oct 2026

Brain inspired neuronal silencing mechanism to enable reliable sequence identification

arXiv 2203.13028 ↗First posted 24 Mar 2022physics.bio-ph cs.AI cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Real-time sequence identification is a core use-case of artificial neural networks (ANNs), ranging from recognizing temporal events to identifying verification codes. Existing methods apply recurrent neural networks, which suffer from training difficulties; however, performing this function without feedback loops remains a challenge. Here, we present an experimental neuronal long-term plasticity mechanism for high-precision feedforward sequence identification networks (ID-nets) without feedback loops, wherein input objects have a given order and timing. This mechanism temporarily silences neurons following their recent spiking activity. Therefore, transitory objects act on different dynamically created feedforward sub-networks. ID-nets are demonstrated to reliably identify 10 handwritten digit sequences, and are generalized to deep convolutional ANNs with continuous activation nodes trained on image sequences. Counterintuitively, their classification performance, even with a limited number of training examples, is high for sequences but low for individual objects. ID-nets are also implemented for writer-dependent recognition, and suggested as a cryptographic tool for encrypted authentication. The presented mechanism opens new horizons for advanced ANN algorithms.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 11 of its 41 references that are in the map. First posted on arXiv 24 Mar 2022.

Builds on

11 of 41 references.

References · 11

  1. 2018Object Detection with Deep Learning: A Reviewcited by 524
  2. 2020Meta Pseudo Labelscited by 372
  3. 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
  4. 2016Training Deep Spiking Neural Networks using Backpropagationcited by 203
  5. 2019Enabling Spike-based Backpropagation for Training Deep Neural Network Architecturescited by 119
  6. 2017Learning Features for Offline Handwritten Signature Verification using Deep Convolutional Neural Networkscited by 20
  7. 2021Significant anisotropic neuronal refractory period plasticitycited by 5
  8. 2018Putting a bug in ML: The moth olfactory network learns to read MNISTcited by 3
  9. 2014Neuronal Response Impedance Mechanism Implementing Cooperative Networks with Low Firing Rates and Microseconds Precisioncited by 2
  10. 2016evt_MNIST: A spike based version of traditional MNISTcited by 2
  11. 2017Fast Reversible Learning based on Neurons functioning as Anisotropic Multiplex Hubscited by 1

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 0; 2024: 1.

2 papers.