mlsanityData to 14 Oct 2026

Pro-t-VAE: Closed-Form Student's t Mixtures for Robust Prototype Discovery

arXiv 2610.14894 ↗First posted 10 Oct 2026cs.LGcited by 0

On the map: Diffusion models → Flow matching, time series and science also fits: Diffusion foundations and sampling

Abstract (arXiv)

We present a robust deep generative framework for unsupervised image prototype discovery, built on a heavy-tailed Student's t mixture prior, that bridges statistical robustness and mathematical tractability. Existing generative approaches typically rely on noise-prone Gaussian priors or computationally intensive diffusion models; neither simultaneously provides explicit latent structure nor exact analytic optimization. While diffusion models can yield strong priors, iterative sampling and intractable likelihoods limit scalability and interpretability for prototype discovery. We address these issues by constructing a Student's t latent space via a Bayesian scale-mixture formulation. This yields a fully closed-form augmented ELBO for unsupervised Student's t mixture variational autoencoders, which, to our knowledge, is the first such objective applied to robust image prototype discovery, avoiding biased variational approximations and high computational costs in prior heavy-tailed or diffusion-based frameworks. Treating precision as a latent variable automatically modulates each data point's influence, downweighting outliers to learn a data-dependent measure of trust. The result is improved robustness, accuracy, and efficiency, with well-separated latent representations and more stable manifold learning than state-of-the-art methods. We validate our model on standard vision benchmarks and challenging neuroimaging tasks. In brain MRI-driven neurodegenerative disease analysis, our model recovers clean, anatomically coherent prototypes where clinical noise often collapses rare subtypes. These results highlight the ability of our framework to preserve anatomy-associated patterns for precise discovery in clinical settings. Our code is available at: https://github.com/xuzhikangnba/torch-tvae.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 22 of its 34 references that are in the map. First posted on arXiv 10 Oct 2026.

Builds on

22 of 34 references.

References · 22

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  3. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  4. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
  5. 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,028
  6. 2015Unsupervised Deep Embedding for Clustering Analysiscited by 767
  7. 2020SCAN: Learning to Classify Images without Labelscited by 352
  8. 2020Contrastive Clusteringcited by 265
  9. 2016Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoderscited by 220
  10. 2016Variational Deep Embedding: An Unsupervised and Generative Approach to Clusteringcited by 220
  11. 2024Morphological Prototyping for Unsupervised Slide Representation Learning in Computational Pathologycited by 72
  12. 2019Learning Conditional Deformable Templates with Convolutional Networkscited by 65
10 more
  1. 2023InfoDiffusion: Representation Learning Using Information Maximizing Diffusion Modelscited by 50
  2. 2023t3-Variational Autoencoder: Learning Heavy-tailed Data with Student's t and Power Divergencecited by 18
  3. 2020Variational auto-encoders with Student's t-priorcited by 10
  4. 2021Bayesian Atlas Building with Hierarchical Priors for Subject-specific Regularizationcited by 8
  5. 2022Interpretable differential diagnosis for Alzheimer's disease and Frontotemporal dementiacited by 8
  6. 2020Variational Autoencoder with Embedded Student-t Mixture Model for Authorship Attributioncited by 3
  7. 2024TreeDiffusion: Hierarchical Generative Clustering for Conditional Diffusioncited by 3
  8. 2025AtlasMorph: Learning conditional deformable templates for brain MRIcited by 3
  9. 2023ClusterDDPM: An EM clustering framework with Denoising Diffusion Probabilistic Modelscited by 2
  10. 2024GCC: Generative Calibration Clusteringcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ProtoQuant: Quantization of Prototypical Parts For General and Fine-Grained Image Classification
  2. 2025Enhancing Variational Autoencoders with Smooth Robust Latent Encoding
  3. 2025Multivariate Variational Autoencoder
  4. 2023Sampling From Autoencoders' Latent Space via Quantization And Probability Mass Function Concepts
  5. 2025Compressing Biology: Evaluating the Stable Diffusion VAE for Phenotypic Drug Discovery
  6. 2021Variational Diffusion Models
  7. 2024Posterior sampling via Langevin dynamics based on generative priors
  8. 2023Variational Diffusion Auto-encoder: Latent Space Extraction from Pre-trained Diffusion Models