# Balanced Excitation and Inhibition are Required for High-Capacity, Noise-Robust Neuronal Selectivity

arXiv: https://arxiv.org/abs/1705.01502 · HTML: https://mlsanity.com/paper/1705.01502/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 May 2017.

## Built on by (most cited first, 7 of 7)

- [Brain-Model Evaluations Need the NeuroAI Turing Test](https://mlsanity.com/paper/2502.16238/) (2025)
- [A theory of learning with constrained weight-distribution](https://mlsanity.com/paper/2206.08933/) (2022)
- [Embryology of a Language Model](https://mlsanity.com/paper/2508.00331/) (2025)
- [Capacity of Group-invariant Linear Readouts from Equivariant Representations: How Many Objects can be Linearly Classified Under All Possible Views?](https://mlsanity.com/paper/2110.07472/) (2021)
- [Curl Descent: Non-Gradient Learning Dynamics with Sign-Diverse Plasticity](https://mlsanity.com/paper/2510.02765/) (2025)
- [Emergent organization of receptive fields in networks of excitatory and inhibitory neurons](https://mlsanity.com/paper/2205.13614/) (2022)
- [Basin Geometry and Reliable Recall of Dynamical Memories in Reservoir Computing](https://mlsanity.com/paper/2609.01914/) (2026)

## Abstract (arXiv)

Neurons and networks in the cerebral cortex must operate reliably despite multiple sources of noise. To evaluate the impact of both input and output noise, we determine the robustness of single-neuron stimulus selective responses, as well as the robustness of attractor states of networks of neurons performing memory tasks. We find that robustness to output noise requires synaptic connections to be in a balanced regime in which excitation and inhibition are strong and largely cancel each other. We evaluate the conditions required for this regime to exist and determine the properties of networks operating within it. A plausible synaptic plasticity rule for learning that balances weight configurations is presented. Our theory predicts an optimal ratio of the number of excitatory and inhibitory synapses for maximizing the encoding capacity of balanced networks for a given statistics of afferent activations. Previous work has shown that balanced networks amplify spatio-temporal variability and account for observed asynchronous irregular states. Here we present a novel type of balanced network that amplifies small changes in the impinging signals, and emerges automatically from learning to perform neuronal and network functions robustly.