Variational decomposition autoencoding improves disentanglement of latent representations
Not on the map. Why?
Abstract (arXiv)
Understanding the structure of complex, nonstationary, high-dimensional time-evolving signals is a central challenge in scientific data analysis. In many domains, such as speech and biomedical signal processing, the ability to learn disentangled and interpretable representations is critical for uncovering latent generative mechanisms. Traditional approaches to unsupervised representation learning, including variational autoencoders (VAEs), often struggle to capture the temporal and spectral diversity inherent in such data. Here we introduce variational decomposition autoencoding (VDA), a framework that extends VAEs by incorporating a strong structural bias toward signal decomposition. VDA is instantiated through variational decomposition autoencoders (DecVAEs), i.e., encoder-only neural networks that combine a signal decomposition model, a contrastive self-supervised task, and variational prior approximation to learn multiple latent subspaces aligned with time-frequency characteristics. We demonstrate the effectiveness of DecVAEs on simulated data and three publicly available scientific datasets, spanning speech recognition, dysarthria severity evaluation, and emotional speech classification. Our results demonstrate that DecVAEs surpass state-of-the-art VAE-based methods in terms of disentanglement quality, generalization across tasks, and the interpretability of latent encodings. These findings suggest that decomposition-aware architectures can serve as robust tools for extracting structured representations from dynamic signals, with potential applications in clinical diagnostics, human-computer interaction, and adaptive neurotechnologies.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 53 references that are in the map. First posted on arXiv 11 Jan 2026.
Builds on
23 of 53 references.
References · 23
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2016Layer Normalizationcited by 5,669
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
- 2018Disentangling by Factorisingcited by 616
- 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 378
- 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 273
11 more
- 2023A Cookbook of Self-Supervised Learningcited by 250
- 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 144
- 2018Robustly Disentangled Causal Mechanisms: Validating Deep Representations for Interventional Robustnesscited by 108
- 2018Learning Deep Disentangled Embeddings with the F-Statistic Losscited by 101
- 2017Unsupervised Learning of Disentangled and Interpretable Representations from Sequential Datacited by 93
- 2018Variational Autoencoders Pursue PCA Directions (by Accident)cited by 85
- 2020Measuring Disentanglement: A Review of Metricscited by 70
- 2016A Survey of Inductive Biases for Factorial Representation-Learningcited by 23
- 2023Designing and Evaluating Speech Emotion Recognition Systems: A reality check case study with IEMOCAPcited by 6
- 2024Empirical wavelet transformcited by 6
- 2020Dimensionality reduction to maximize prediction generalization capabilitycited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.