# Singular Value Decomposition and Neural Networks

arXiv: https://arxiv.org/abs/1906.11755 · HTML: https://mlsanity.com/paper/1906.11755/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 27 Jun 2019.

## Built on by (most cited first, 2 of 2)

- [Generalization Error Bound for Quantum Machine Learning in NISQ Era -- A Survey](https://mlsanity.com/paper/2409.07626/) (2024)
- [Metacognitive Steering: Learning the Structure of Scientific Judgment](https://mlsanity.com/paper/2609.16245/) (2026)

## Abstract (arXiv)

Singular Value Decomposition (SVD) constitutes a bridge between the linear algebra concepts and multi-layer neural networks---it is their linear analogy. Besides of this insight, it can be used as a good initial guess for the network parameters, leading to substantially better optimization results.