mlsanityData to 7 Oct 2026

Spectral-Stimulus Information for Self-Supervised Stimulus Encoding

arXiv 2407.06195 ↗First posted 10 Jun 2024q-bio.NC cs.IT cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Mammalian spatial navigation relies on specialized neurons, such as place and grid cells, which encode position based on self-motion and environmental cues. While extensive research has explored the computational role of grid cells, the principles underlying efficient place cell coding remain less understood. Existing spatial information rate measures primarily assess single-neuron encoding, limiting insights into population-level representations, while, the role of correlation in neural coding remains a subject of considerable debate. To address this, we introduce novel, correlation-aware information-theoretic measures that quantify the encoding efficiency of multiple neurons, including the joint stimulus information rate for neuron pairs and the spectral-stimulus information for arbitrary sized populations. The spectral-stimulus information, defined as the leading eigenvalue of the stimulus information matrix, is maximized when neurons exhibit localized, non-overlapping firing fields, mirroring place cell and head direction cell activity. We apply these measures to neural data recorded in mice and monkeys, elucidating differences in encoding efficiency across neuronal pairs and populations. Then, we demonstrate that these measures can be used to train recurrent neural networks (RNNs) via self-supervised learning, leading to the emergence of place cells and head direction cells. Our findings highlight how neural populations collectively encode stimuli, offering a more comprehensive framework for understanding stimulus encoding and optimizing artificial navigation systems in novel environments.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 96 references that are in the map. First posted on arXiv 10 Jun 2024.

Builds on

9 of 96 references.

References · 9

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  4. 2018Emergence of grid-like representations by training recurrent neural networks to perform spatial localizationcited by 52
  5. 2020Information-Theoretic Segmentation by Inpainting Error Maximizationcited by 22
  6. 2022Actionable Neural Representations: Grid Cells from Minimal Constraintscited by 10
  7. 2023Self-Supervised Learning of Representations for Space Generates Multi-Modular Grid Cellscited by 8
  8. 2019Bayesian Topological Learning for Brain State Classificationcited by 7
  9. 2022A Topological Deep Learning Framework for Neural Spike Decodingcited by 6

Built on by

Not cited yet.