# A Neural Network model with Bidirectional Whitening

arXiv: https://arxiv.org/abs/1704.07147 · HTML: https://mlsanity.com/paper/1704.07147/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Apr 2017.

## Built on by (most cited first, 1 of 1)

- [Natural Gradient Descent for Online Continual Learning](https://mlsanity.com/paper/2603.20898/) (2026)

## Abstract (arXiv)

We present here a new model and algorithm which performs an efficient Natural gradient descent for Multilayer Perceptrons. Natural gradient descent was originally proposed from a point of view of information geometry, and it performs the steepest descent updates on manifolds in a Riemannian space. In particular, we extend an approach taken by the "Whitened neural networks" model. We make the whitening process not only in feed-forward direction as in the original model, but also in the back-propagation phase. Its efficacy is shown by an application of this "Bidirectional whitened neural networks" model to a handwritten character recognition data (MNIST data).