mlsanityData to 7 Oct 2026

Interpretable statistical representations of neural population dynamics and geometry

arXiv 2304.03376 ↗First posted 6 Apr 2023cs.LG math.DS q-bio.NCcited by 12

Not on the map. Why?

Abstract (arXiv)

The dynamics of neuron populations commonly evolve on low-dimensional manifolds. Thus, we need methods that learn the dynamical processes over neural manifolds to infer interpretable and consistent latent representations. We introduce a representation learning method, MARBLE, that decomposes on-manifold dynamics into local flow fields and maps them into a common latent space using unsupervised geometric deep learning. In simulated non-linear dynamical systems, recurrent neural networks, and experimental single-neuron recordings from primates and rodents, we discover emergent low-dimensional latent representations that parametrise high-dimensional neural dynamics during gain modulation, decision-making, and changes in the internal state. These representations are consistent across neural networks and animals, enabling the robust comparison of cognitive computations. Extensive benchmarking demonstrates state-of-the-art within- and across-animal decoding accuracy of MARBLE compared with current representation learning approaches, with minimal user input. Our results suggest that manifold structure provides a powerful inductive bias to develop powerful decoding algorithms and assimilate data across experiments.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 26 of its 84 references that are in the map. First posted on arXiv 6 Apr 2023.

Builds on

26 of 84 references.

References · 26

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  5. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  6. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
  7. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  8. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
  9. 2018Neural Relational Inference for Interacting Systemscited by 339
  10. 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 208
  11. 2020DiffusionNet: Discretization Agnostic Learning on Surfacescited by 163
  12. 2020Directional Graph Networkscited by 132
14 more
  1. 2022Learnable latent embeddings for joint behavioral and neural analysiscited by 113
  2. 2021Generalized Shape Metrics on Neural Representationscited by 109
  3. 2017Classification and Geometry of General Perceptual Manifoldscited by 62
  4. 2019Universality and individuality in neural dynamics across large populations of recurrent networkscited by 61
  5. 2021Attractor and integrator networks in the braincited by 60
  6. 2017Linking connectivity, dynamics and computations in low-rank recurrent neural networkscited by 51
  7. 2020Learning identifiable and interpretable latent models of high-dimensional neural activity using pi-VAEcited by 48
  8. 2021Data-driven discovery of intrinsic dynamicscited by 45
  9. 2021Neural tuning and representational geometrycited by 31
  10. 2022Generalised Implicit Neural Representationscited by 31
  11. 2021Steerable Partial Differential Operators for Equivariant Neural Networkscited by 22
  12. 2018Parallel Transport Unfolding: A Connection-based Manifold Learning Approachcited by 9
  13. 2022Comparing high-dimensional neural recordings by aligning their low-dimensional latent representationscited by 5
  14. 2021Connecting the dots in ethology: applying network theory to understand neural and animal collectivescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 4; 2026: 4.

12 papers.