Spectral Analysis of Representational Similarity with Limited Neurons
Not on the map. Why?
Abstract (arXiv)
Understanding representational similarity between neural recordings and computational models is essential for neuroscience, yet remains challenging to measure reliably due to the constraints on the number of neurons that can be recorded simultaneously. In this work, we apply tools from Random Matrix Theory to investigate how such limitations affect similarity measures, focusing on Centered Kernel Alignment (CKA) and Canonical Correlation Analysis (CCA). We propose an analytical framework for representational similarity analysis that relates measured similarities to the spectral properties of the underlying representations. We demonstrate that neural similarities are systematically underestimated under finite neuron sampling, mainly due to eigenvector delocalization. Moreover, for power-law population spectra, we show that the number of localized eigenvectors scales as the square root of the number of recorded neurons, providing a simple rule of thumb for practitioners. To overcome sampling bias, we introduce a denoising method to infer population-level similarity, enabling accurate analysis even with small neuron samples. Theoretical predictions are validated on synthetic and real datasets, offering practical strategies for interpreting neural data under finite sampling constraints.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 15 of its 54 references that are in the map. First posted on arXiv 27 Feb 2025.
Builds on
15 of 54 references.
References · 15
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2021Explaining Neural Scaling Lawscited by 353
- 2020Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networkscited by 200
- 2020Spectral Bias and Task-Model Alignment Explain Generalization in Kernel Regression and Infinitely Wide Neural Networkscited by 166
- 2020Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Futurecited by 83
- 2020Implicit Regularization of Random Feature Modelscited by 54
- 2024Scaling and renormalization in high-dimensional regressioncited by 45
- 2024Correcting Biased Centered Kernel Alignment Measures in Biological and Artificial Neural Networkscited by 16
- 2023A Spectral Theory of Neural Prediction and Alignmentcited by 14
- 2021Statistical inference on representational geometriescited by 13
- 2016Spectrum Estimation from Samplescited by 9
- 2024Universal scale-free representations in human visual cortexcited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.