# Large-scale neural recordings call for new insights to link brain and behavior

arXiv: https://arxiv.org/abs/2103.14662 · HTML: https://mlsanity.com/paper/2103.14662/

## Key facts

- Cited by 28 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 26 Mar 2021.

## Built on by (most cited first, 28 of 28)

- [Learnable latent embeddings for joint behavioral and neural analysis](https://mlsanity.com/paper/2204.00673/) (2022)
- [A Unified, Scalable Framework for Neural Population Decoding](https://mlsanity.com/paper/2310.16046/) (2023)
- [Towards a "universal translator" for neural dynamics at single-cell, single-spike resolution](https://mlsanity.com/paper/2407.14668/) (2024)
- [BrainWave: A Brain Signal Foundation Model for Clinical Applications](https://mlsanity.com/paper/2402.10251/) (2024)
- [Seeing the forest and the tree: Building representations of both individual and collective dynamics with transformers](https://mlsanity.com/paper/2206.06131/) (2022)
- [NeuroBind: Towards Unified Multimodal Representations for Neural Signals](https://mlsanity.com/paper/2407.14020/) (2024)
- [Neural population geometry and optimal coding of tasks with shared latent structure](https://mlsanity.com/paper/2402.16770/) (2024)
- [Generalizable, real-time neural decoding with hybrid state-space models](https://mlsanity.com/paper/2506.05320/) (2025)
- [Can Information Flows Suggest Targets for Interventions in Neural Circuits?](https://mlsanity.com/paper/2111.05299/) (2021)
- [Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses](https://mlsanity.com/paper/2310.03311/) (2023)
- [Simultaneous Dimensionality Reduction: A Data Efficient Approach for Multimodal Representations Learning](https://mlsanity.com/paper/2310.04458/) (2023)
- [Latent Processes Identification From Multi-View Time Series](https://mlsanity.com/paper/2305.08164/) (2023)
- [Data efficiency, dimensionality reduction, and the generalized symmetric information bottleneck](https://mlsanity.com/paper/2309.05649/) (2023)
- [Adaptive Intelligence: leveraging insights from adaptive behavior in animals to build flexible AI systems](https://mlsanity.com/paper/2411.15234/) (2024)
- [Forecasting Whole-Brain Neuronal Activity from Volumetric Video](https://mlsanity.com/paper/2503.00073/) (2025)
- [Animal behavioral analysis and neural encoding with transformer-based self-supervised pretraining](https://mlsanity.com/paper/2507.09513/) (2025)
- [Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equations](https://mlsanity.com/paper/2412.12112/) (2024)
- [Equivariance by Contrast: Identifiable Equivariant Embeddings from Unlabeled Finite Group Actions](https://mlsanity.com/paper/2510.21706/) (2025)
- [A ghost mechanism: An analytical model of abrupt learning in recurrent networks](https://mlsanity.com/paper/2501.02378/) (2025)
- [BrainPilot: Automating Brain Discovery with Agentic Research](https://mlsanity.com/paper/2607.15079/) (2026)
- [Overcoming the Domain Gap in Neural Action Representations](https://mlsanity.com/paper/2112.01176/) (2021)
- [Integrating Statistical and Machine Learning Approaches to Identify Receptive Field Structure in Neural Populations](https://mlsanity.com/paper/2208.12025/) (2022)
- [Mapping EEG Signals to Visual Stimuli: A Deep Learning Approach to Match vs. Mismatch Classification](https://mlsanity.com/paper/2309.04153/) (2023)
- [Neural Crystals](https://mlsanity.com/paper/2311.16111/) (2023)
- [NLP4Neuro: Sequence-to-sequence learning for neural population decoding](https://mlsanity.com/paper/2507.02264/) (2025)
- [Learning Mixtures of Linear Dynamical Systems via Hybrid Tensor-EM Method](https://mlsanity.com/paper/2510.06091/) (2025)
- [Behavior-dLDS: A decomposed linear dynamical systems model for neural activity partially constrained by behavior](https://mlsanity.com/paper/2603.05612/) (2026)
- [Machine Learning Methods for Studying Latent Neural Activity Dynamics](https://mlsanity.com/paper/2606.10530/) (2026)

## Abstract (arXiv)

Neuroscientists today can measure activity from more neurons than ever before, and are facing the challenge of connecting these brain-wide neural recordings to computation and behavior. Here, we first describe emerging tools and technologies being used to probe large-scale brain activity and new approaches to characterize behavior in the context of such measurements. We next highlight insights obtained from large-scale neural recordings in diverse model systems, and argue that some of these pose a challenge to traditional theoretical frameworks. Finally, we elaborate on existing modelling frameworks to interpret these data, and argue that interpreting brain-wide neural recordings calls for new theoretical approaches that may depend on the desired level of understanding at stake. These advances in both neural recordings and theory development will pave the way for critical advances in our understanding of the brain.
