# Analyzing biological and artificial neural networks: challenges with opportunities for synergy?

arXiv: https://arxiv.org/abs/1810.13373 · HTML: https://mlsanity.com/paper/1810.13373/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 31 Oct 2018.

## Built on by (most cited first, 20 of 20)

- [Generalized Shape Metrics on Neural Representations](https://mlsanity.com/paper/2110.14739/) (2021)
- [Neural population geometry: An approach for understanding biological and artificial neural networks](https://mlsanity.com/paper/2104.07059/) (2021)
- [Discovering Causal Relations and Equations from Data](https://mlsanity.com/paper/2305.13341/) (2023)
- [Divergent Creativity in Humans and Large Language Models](https://mlsanity.com/paper/2405.13012/) (2024)
- [Soft Matching Distance: A metric on neural representations that captures single-neuron tuning](https://mlsanity.com/paper/2311.09466/) (2023)
- [Mechanistic Interpretability as Statistical Estimation: A Variance Analysis](https://mlsanity.com/paper/2510.00845/) (2025)
- [The Dead Salmons of AI Interpretability](https://mlsanity.com/paper/2512.18792/) (2025)
- [Emergent representations in networks trained with the Forward-Forward algorithm](https://mlsanity.com/paper/2305.18353/) (2023)
- [Poisson Variational Autoencoder](https://mlsanity.com/paper/2405.14473/) (2024)
- [Neural Networks as Paths through the Space of Representations](https://mlsanity.com/paper/2206.10999/) (2022)
- [Coupling Visual Semantics of Artificial Neural Networks and Human Brain Function via Synchronized Activations](https://mlsanity.com/paper/2206.10821/) (2022)
- [Connectionism, Complexity, and Living Systems: a comparison of Artificial and Biological Neural Networks](https://mlsanity.com/paper/2103.15553/) (2021)
- [Label Words as Local Task Vectors in In-Context Learning](https://mlsanity.com/paper/2406.16007/) (2024)
- [Emergent Manifold Separability during Reasoning in Large Language Models](https://mlsanity.com/paper/2602.20338/) (2026)
- [Using Human-like Mechanism to Weaken Effect of Pre-training Weight Bias in Face-Recognition Convolutional Neural Network](https://mlsanity.com/paper/2310.13674/) (2023)
- [Explainable Emotion Decoding for Human and Computer Vision](https://mlsanity.com/paper/2408.00493/) (2024)
- [Geometric Properties and Graph-Based Optimization of Neural Networks: Addressing Non-Linearity, Dimensionality, and Scalability](https://mlsanity.com/paper/2503.05761/) (2025)
- [Stretching Beyond the Obvious: A Gradient-Free Framework to Unveil the Hidden Landscape of Visual Invariance](https://mlsanity.com/paper/2506.17040/) (2025)
- [Modulation of temporal decision-making in a deep reinforcement learning agent under the dual-task paradigm](https://mlsanity.com/paper/2511.01415/) (2025)
- [Multi-Scale Temporal Homeostasis Enables Efficient and Robust Neural Networks](https://mlsanity.com/paper/2602.07009/) (2026)

## Abstract (arXiv)

Deep neural networks (DNNs) transform stimuli across multiple processing stages to produce representations that can be used to solve complex tasks, such as object recognition in images. However, a full understanding of how they achieve this remains elusive. The complexity of biological neural networks substantially exceeds the complexity of DNNs, making it even more challenging to understand the representations that they learn. Thus, both machine learning and computational neuroscience are faced with a shared challenge: how can we analyze their representations in order to understand how they solve complex tasks? We review how data-analysis concepts and techniques developed by computational neuroscientists can be useful for analyzing representations in DNNs, and in turn, how recently developed techniques for analysis of DNNs can be useful for understanding representations in biological neural networks. We explore opportunities for synergy between the two fields, such as the use of DNNs as in-silico model systems for neuroscience, and how this synergy can lead to new hypotheses about the operating principles of biological neural networks.