mlsanityData to 7 Oct 2026

Learning Time-Invariant Representations for Individual Neurons from Population Dynamics

arXiv 2311.02258 ↗First posted 3 Nov 2023q-bio.NC cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Neurons can display highly variable dynamics. While such variability presumably supports the wide range of behaviors generated by the organism, their gene expressions are relatively stable in the adult brain. This suggests that neuronal activity is a combination of its time-invariant identity and the inputs the neuron receives from the rest of the circuit. Here, we propose a self-supervised learning based method to assign time-invariant representations to individual neurons based on permutation-, and population size-invariant summary of population recordings. We fit dynamical models to neuronal activity to learn a representation by considering the activity of both the individual and the neighboring population. Our self-supervised approach and use of implicit representations enable robust inference against imperfections such as partial overlap of neurons across sessions, trial-to-trial variability, and limited availability of molecular (transcriptomic) labels for downstream supervised tasks. We demonstrate our method on a public multimodal dataset of mouse cortical neuronal activity and transcriptomic labels. We report > 35% improvement in predicting the transcriptomic subclass identity and > 20% improvement in predicting class identity with respect to the state-of-the-art.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 15 of its 49 references that are in the map. First posted on arXiv 3 Nov 2023.

Builds on

15 of 49 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2022Learnable latent embeddings for joint behavioral and neural analysiscited by 113
  6. 2021Neural Latents Benchmark '21: Evaluating latent variable models of neural population activitycited by 57
  7. 2021Representation learning for neural population activity with Neural Data Transformerscited by 48
  8. 2016Linear dynamical neural population models through nonlinear embeddingscited by 36
  9. 2016A State Space Approach for Piecewise-Linear Recurrent Neural Networks for Reconstructing Nonlinear Dynamics from Neural Measurementscited by 24
  10. 2022STNDT: Modeling Neural Population Activity with a Spatiotemporal Transformercited by 23
  11. 2016Variational Latent Gaussian Process for Recovering Single-Trial Dynamics from Population Spike Trainscited by 22
  12. 2022Seeing the forest and the tree: Building representations of both individual and collective dynamics with transformerscited by 18
3 more
  1. 2014Automatic discovery of cell types and microcircuitry from neural connectomicscited by 2
  2. 2017Deep Learning with Permutation-invariant Operator for Multi-instance Histopathology Classificationcited by 2
  3. 2019A coupled autoencoder approach for multi-modal analysis of cell typescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 5; 2026: 1.

8 papers.