Learning Time-Invariant Representations for Individual Neurons from Population Dynamics
Not on the map. Why?
Abstract (arXiv)
Neurons can display highly variable dynamics. While such variability presumably supports the wide range of behaviors generated by the organism, their gene expressions are relatively stable in the adult brain. This suggests that neuronal activity is a combination of its time-invariant identity and the inputs the neuron receives from the rest of the circuit. Here, we propose a self-supervised learning based method to assign time-invariant representations to individual neurons based on permutation-, and population size-invariant summary of population recordings. We fit dynamical models to neuronal activity to learn a representation by considering the activity of both the individual and the neighboring population. Our self-supervised approach and use of implicit representations enable robust inference against imperfections such as partial overlap of neurons across sessions, trial-to-trial variability, and limited availability of molecular (transcriptomic) labels for downstream supervised tasks. We demonstrate our method on a public multimodal dataset of mouse cortical neuronal activity and transcriptomic labels. We report > 35% improvement in predicting the transcriptomic subclass identity and > 20% improvement in predicting class identity with respect to the state-of-the-art.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 15 of its 49 references that are in the map. First posted on arXiv 3 Nov 2023.
Builds on
15 of 49 references.
References · 15
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2022Learnable latent embeddings for joint behavioral and neural analysiscited by 113
- 2021Neural Latents Benchmark '21: Evaluating latent variable models of neural population activitycited by 57
- 2021Representation learning for neural population activity with Neural Data Transformerscited by 48
- 2016Linear dynamical neural population models through nonlinear embeddingscited by 36
- 2016A State Space Approach for Piecewise-Linear Recurrent Neural Networks for Reconstructing Nonlinear Dynamics from Neural Measurementscited by 24
- 2022STNDT: Modeling Neural Population Activity with a Spatiotemporal Transformercited by 23
- 2016Variational Latent Gaussian Process for Recovering Single-Trial Dynamics from Population Spike Trainscited by 22
- 2022Seeing the forest and the tree: Building representations of both individual and collective dynamics with transformerscited by 18
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 1.
8 papers.
- 2025SPINT: Spatial Permutation-Invariant Neural Transformer for Consistent Intracortical Motor Decodingcited by 5
- 2024BLEND: Behavior-guided Neural Population Dynamics Modeling via Privileged Knowledge Distillationcited by 4
- 2025NOBLE -- Neural Operator with Biologically-informed Latent Embeddings to Capture Experimental Variability in Biological Neuron Modelscited by 2
- 2025Know Thyself by Knowing Others: Learning Neuron Identity from Population Contextcited by 2
- 2025Neuron Platonic Intrinsic Representation From Dynamics Using Contrastive Learningcited by 1
- 2025Fast Fourier Correlation is a Highly Efficient and Accurate Feature Attribution Algorithm from the Perspective of Control Theory and Game Theorycited by 1
- 2024Comprehensive and Reliable Feature Attribution for Diverse Modalities and Models via Frequency-Domain Insightscited by 0
- 2026A Benchmark Analysis of Graph and Non-Graph Methods for Caenorhabditis Elegans Neuron Classificationcited by 0
- 2026A Benchmark Analysis of Graph and Non-Graph Methods for Caenorhabditis Elegans Neuron Classification19 Feb 2026
- 2025Know Thyself by Knowing Others: Learning Neuron Identity from Population Context1 Dec 2025
- 2025SPINT: Spatial Permutation-Invariant Neural Transformer for Consistent Intracortical Motor Decoding11 Jul 2025
- 2025NOBLE -- Neural Operator with Biologically-informed Latent Embeddings to Capture Experimental Variability in Biological Neuron Models5 Jun 2025
- 2025Fast Fourier Correlation is a Highly Efficient and Accurate Feature Attribution Algorithm from the Perspective of Control Theory and Game Theory2 Apr 2025
- 2025Neuron Platonic Intrinsic Representation From Dynamics Using Contrastive Learning6 Feb 2025
- 2024Comprehensive and Reliable Feature Attribution for Diverse Modalities and Models via Frequency-Domain Insights27 Nov 2024
- 2024BLEND: Behavior-guided Neural Population Dynamics Modeling via Privileged Knowledge Distillation2 Oct 2024