mlsanityData to 7 Oct 2026

Identifiability-Guaranteed Simplex-Structured Post-Nonlinear Mixture Learning via Autoencoder

arXiv 2106.09070 ↗First posted 16 Jun 2021cs.LG eess.SP stat.MLcited by 7

Not on the map. Why?

Abstract (arXiv)

This work focuses on the problem of unraveling nonlinearly mixed latent components in an unsupervised manner. The latent components are assumed to reside in the probability simplex, and are transformed by an unknown post-nonlinear mixing system. This problem finds various applications in signal and data analytics, e.g., nonlinear hyperspectral unmixing, image embedding, and nonlinear clustering. Linear mixture learning problems are already ill-posed, as identifiability of the target latent components is hard to establish in general. With unknown nonlinearity involved, the problem is even more challenging. Prior work offered a function equation-based formulation for provable latent component identification. However, the identifiability conditions are somewhat stringent and unrealistic. In addition, the identifiability analysis is based on the infinite sample (i.e., population) case, while the understanding for practical finite sample cases has been elusive. Moreover, the algorithm in the prior work trades model expressiveness with computational convenience, which often hinders the learning performance. Our contribution is threefold. First, new identifiability conditions are derived under largely relaxed assumptions. Second, comprehensive sample complexity results are presented -- which are the first of the kind. Third, a constrained autoencoder-based algorithmic framework is proposed for implementation, which effectively circumvents the challenges in the existing algorithm. Synthetic and real experiments corroborate our theoretical analyses.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 11 of its 52 references that are in the map. First posted on arXiv 16 Jun 2021.

Builds on

11 of 52 references.

References · 11

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 278
  3. 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 270
  4. 2019The Incomplete Rosetta Stone Problem: Identifiability Results for Multi-View Nonlinear ICAcited by 86
  5. 2018Nonnegative Matrix Factorization for Signal and Data Analytics: Identifiability, Algorithms, and Applicationscited by 55
  6. 2016Robust Volume Minimization-Based Matrix Factorization for Remote Sensing and Document Clusteringcited by 28
  7. 2013Nonlinear unmixing of hyperspectral images: models and algorithmscited by 27
  8. 2019Crowdsourcing via Pairwise Co-occurrences: Identifiability and Algorithmscited by 23
  9. 2013Robust Near-Separable Nonnegative Matrix Factorization Using Linear Optimizationcited by 12
  10. 2013Unsupervised Post-Nonlinear Unmixing of Hyperspectral Images Using a Hamiltonian Monte Carlo Algorithmcited by 2
  11. 2019Learning Nonlinear Mixtures: Identifiability and Algorithmcited by 2

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 1; 2024: 1; 2025: 2.

7 papers.