# PILAE: A Non-gradient Descent Learning Scheme for Deep Feedforward Neural Networks

arXiv: https://arxiv.org/abs/1811.01545 · HTML: https://mlsanity.com/paper/1811.01545/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Nov 2018.

## Built on by (most cited first, 2 of 2)

- [Analytic Learning of Convolutional Neural Network For Pattern Recognition](https://mlsanity.com/paper/2202.06504/) (2022)
- [Semi-adaptive Synergetic Two-way Pseudoinverse Learning System](https://mlsanity.com/paper/2406.18931/) (2024)

## Abstract (arXiv)

In this work, a non-gradient descent learning (NGDL) scheme was proposed for deep feedforward neural networks (DNN). It is known that an autoencoder can be used as the building blocks of the multi-layer perceptron (MLP) DNN, the MLP is taken as an example to illustrate the proposed scheme of pseudoinverse learning algorithm for autoencoder (PILAE) in this paper. The PILAE with low rank approximation is a NGDL algorithm, and the encoder weight matrix is set to be the low rank approximation of the pseudoinverse of the input matrix, while the decoder weight matrix is calculated by the pseudoinverse learning algorithm. It is worth to note that only very few network structure hyper-parameters need to be tuned compared with classical gradient descent learning algorithm. Hence, the proposed algorithm could be regarded as a quasi-automated training algorithm which could be utilized in automated machine learning field. The experimental results show that the proposed learning scheme for DNN could achieve better performance on considering the tradeoff between training efficiency and classification accuracy.