# Nonlinear Hyperspectral Unmixing based on Multilinear Mixing Model using Convolutional Autoencoders

arXiv: https://arxiv.org/abs/2303.08156 · HTML: https://mlsanity.com/paper/2303.08156/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 7 of its 35 references that are in the map.
- First posted on arXiv 14 Mar 2023.

## Builds on (most cited first, 7 of 7)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Identity Mappings in Deep Residual Networks](https://mlsanity.com/paper/1603.05027/) (2016)
- [EndNet: Sparse AutoEncoder Network for Endmember Extraction and Hyperspectral Unmixing](https://mlsanity.com/paper/1708.01894/) (2017)
- [Nonlinear unmixing of hyperspectral images: models and algorithms](https://mlsanity.com/paper/1304.1875/) (2013)
- [Hyperspectral Unmixing via Deep Autoencoder Networks for a Generalized Linear-Mixture/Nonlinear-Fluctuation Model](https://mlsanity.com/paper/1904.13017/) (2019)
- [Integration of Physics-Based and Data-Driven Models for Hyperspectral Image Unmixing](https://mlsanity.com/paper/2206.05508/) (2022)
- [Unsupervised Nonlinear Spectral Unmixing based on a Multilinear Mixing Model](https://mlsanity.com/paper/1604.04293/) (2016)

## Abstract (arXiv)

Unsupervised spectral unmixing consists of representing each observed pixel as a combination of several pure materials called endmembers with their corresponding abundance fractions. Beyond the linear assumption, various nonlinear unmixing models have been proposed, with the associated optimization problems solved either by traditional optimization algorithms or deep learning techniques. Current deep learning-based nonlinear unmixing focuses on the models in additive, bilinear-based formulations. By interpreting the reflection process using the discrete Markov chain, the multilinear mixing model (MLM) successfully accounts for the up to infinite-order interactions between endmembers. However, to simulate the physics process of MLM by neural networks explicitly is a challenging problem that has not been approached by far. In this article, we propose a novel autoencoder-based network for unsupervised unmixing based on MLM. Benefitting from an elaborate network design, the relationships among all the model parameters em i.e., endmembers, abundances, and transition probability parameters are explicitly modeled. There are two modes: MLM-1DAE considers only pixel-wise spectral information, and MLM-3DAE exploits the spectral-spatial correlations within input patches. Experiments on both the synthetic and real datasets demonstrate the effectiveness of the proposed method as it achieves competitive performance to the classic solutions of MLM.