# A practical tutorial on autoencoders for nonlinear feature fusion: Taxonomy, models, software and guidelines

arXiv: https://arxiv.org/abs/1801.01586 · HTML: https://mlsanity.com/paper/1801.01586/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Jan 2018.

## Built on by (most cited first, 17 of 17)

- [Multimodal Co-learning: Challenges, Applications with Datasets, Recent Advances and Future Directions](https://mlsanity.com/paper/2107.13782/) (2021)
- [Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolution](https://mlsanity.com/paper/2103.14629/) (2021)
- [DoE2Vec: Deep-learning Based Features for Exploratory Landscape Analysis](https://mlsanity.com/paper/2304.01219/) (2023)
- [Enhanced Multimodal Hate Video Detection via Channel-wise and Modality-wise Fusion](https://mlsanity.com/paper/2505.12051/) (2025)
- [Reducing Data Complexity using Autoencoders with Class-informed Loss Functions](https://mlsanity.com/paper/2111.06142/) (2021)
- [Deconvolution-and-convolution Networks](https://mlsanity.com/paper/2103.11887/) (2021)
- [The Classification of Optical Galaxy Morphology Using Unsupervised Learning Techniques](https://mlsanity.com/paper/2206.06165/) (2022)
- [EvoAAA: An evolutionary methodology for automated neural autoencoder architecture search](https://mlsanity.com/paper/2301.06047/) (2023)
- [Towards Active Participant Centric Vertical Federated Learning: Some Representations May Be All You Need](https://mlsanity.com/paper/2410.17648/) (2024)
- [CNN Autoencoders for Hierarchical Feature Extraction and Fusion in Multi-sensor Human Activity Recognition](https://mlsanity.com/paper/2502.04489/) (2025)
- [A machine learning approach for fighting the curse of dimensionality in global optimization](https://mlsanity.com/paper/2110.14985/) (2021)
- [Towards Phytoplankton Parasite Detection Using Autoencoders](https://mlsanity.com/paper/2303.08744/) (2023)
- [PARDINUS: Weakly supervised discarding of photo-trapping empty images based on autoencoders](https://mlsanity.com/paper/2312.14812/) (2023)
- [Multi-Model Least Squares-Based Recomputation Framework for Large Data Analysis](https://mlsanity.com/paper/2101.01271/) (2021)
- [DEDUCE: Multi-head attention decoupled contrastive learning to discover cancer subtypes based on multi-omics data](https://mlsanity.com/paper/2307.04075/) (2023)
- [Improving Large-Scale k-Nearest Neighbor Text Categorization with Label Autoencoders](https://mlsanity.com/paper/2402.01963/) (2024)
- [Determinacc~ao Autom'atica de Limiar de Deteccc~ao de Ataques em Redes de Computadores Utilizando Autoencoders](https://mlsanity.com/paper/2506.14937/) (2025)

## Abstract (arXiv)

Many of the existing machine learning algorithms, both supervised and unsupervised, depend on the quality of the input characteristics to generate a good model. The amount of these variables is also important, since performance tends to decline as the input dimensionality increases, hence the interest in using feature fusion techniques, able to produce feature sets that are more compact and higher level. A plethora of procedures to fuse original variables for producing new ones has been developed in the past decades. The most basic ones use linear combinations of the original variables, such as PCA (Principal Component Analysis) and LDA (Linear Discriminant Analysis), while others find manifold embeddings of lower dimensionality based on non-linear combinations, such as Isomap or LLE (Linear Locally Embedding) techniques. More recently, autoencoders (AEs) have emerged as an alternative to manifold learning for conducting nonlinear feature fusion. Dozens of AE models have been proposed lately, each with its own specific traits. Although many of them can be used to generate reduced feature sets through the fusion of the original ones, there also AEs designed with other applications in mind. The goal of this paper is to provide the reader with a broad view of what an AE is, how they are used for feature fusion, a taxonomy gathering a broad range of models, and how they relate to other classical techniques. In addition, a set of didactic guidelines on how to choose the proper AE for a given task is supplied, together with a discussion of the software tools available. Finally, two case studies illustrate the usage of AEs with datasets of handwritten digits and breast cancer.