# Contracting Neural Networks: Sharp LMI Conditions with Applications to Integral Control and Deep Learning

arXiv: https://arxiv.org/abs/2604.00119 · HTML: https://mlsanity.com/paper/2604.00119/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 31 Mar 2026.

## Built on by (most cited first, 1 of 1)

- [A Nonlinear Separation Principle via Contraction Theory: Applications to Neural Networks, Control, and Learning](https://mlsanity.com/paper/2604.15238/) (2026)

## Abstract (arXiv)

This paper studies contractivity of firing-rate and Hopfield recurrent neural networks. We derive sharp LMI conditions on the synaptic matrices that characterize contractivity of both architectures, for activation functions that are either non-expansive or monotone non-expansive, in both continuous and discrete time. We establish structural relationships among these conditions, including connections to Schur diagonal stability and the recovery of optimal contraction rates for symmetric synaptic matrices. We demonstrate the utility of these results through two applications. First, we develop an LMI-based design procedure for low-gain integral controllers enabling reference tracking in contracting firing rate networks. Second, we provide an exact parameterization of weight matrices that guarantee contraction and use it to improve the expressivity of Implicit Neural Networks, achieving competitive performance on image classification benchmarks with fewer parameters.