# Notes on Deep Learning Theory

arXiv: https://arxiv.org/abs/2012.05760 · HTML: https://mlsanity.com/paper/2012.05760/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 10 Dec 2020.

## Built on by (most cited first, 1 of 1)

- [Neural Tangent Kernel: A Survey](https://mlsanity.com/paper/2208.13614/) (2022)

## Abstract (arXiv)

These are the notes for the lectures that I was giving during Fall 2020 at the Moscow Institute of Physics and Technology (MIPT) and at the Yandex School of Data Analysis (YSDA). The notes cover some aspects of initialization, loss landscape, generalization, and a neural tangent kernel theory. While many other topics (e.g. expressivity, a mean-field theory, a double descent phenomenon) are missing in the current version, we plan to add them in future revisions.