mlsanityData to 7 Oct 2026

Stick-Breaking Mixture Normalizing Flows with Component-Wise Tail Adaptation for Variational Inference

arXiv 2510.07965 ↗First posted 9 Oct 2025stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Normalizing flows with a Gaussian base provide a computationally efficient way to approximate posterior distributions in Bayesian inference, but they often struggle to capture complex posteriors with multimodality and heavy tails. We propose a stick-breaking mixture base with component-wise tail adaptation (StiCTAF) for posterior approximation. The method first learns a flexible mixture base to mitigate the mode-seeking bias of reverse KL divergence through a weighted average of component-wise ELBOs. It then estimates local tail indices of unnormalized densities and finally refines each mixture component using a shared backbone combined with component-specific tail transforms calibrated by the estimated indices. This design enables accurate mode coverage and anisotropic tail modeling while retaining exact density evaluation and stable optimization. Experiments on synthetic posteriors demonstrate improved tail recovery and better coverage of multiple modes compared to benchmark models. We also present a real-data analysis illustrating the practical benefits of our approach for posterior inference.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 26 references that are in the map. First posted on arXiv 9 Oct 2025.

Builds on

13 of 26 references.

References · 13

  1. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  2. 2015Variational Inference with Normalizing Flowscited by 2,161
  3. 2016Variational Inference: A Review for Statisticianscited by 1,466
  4. 2016Automatic Differentiation Variational Inferencecited by 159
  5. 2017Sticking the Landing: Simple, Lower-Variance Gradient Estimators for Variational Inferencecited by 97
  6. 2019Semi-Supervised Learning with Normalizing Flowscited by 76
  7. 2023normflows: A PyTorch Package for Normalizing Flowscited by 56
  8. 2016Stick-Breaking Variational Autoencoderscited by 44
  9. 2019Dirichlet Variational Autoencodercited by 43
  10. 2022Marginal Tail-Adaptive Normalizing Flowscited by 12
  11. 2024Flexible Tails for Normalizing Flowscited by 11
  12. 2022Fat-Tailed Variational Inference with Anisotropic Tail Adaptive Flowscited by 10
1 more
  1. 2014Efficient Gradient-Based Inference through Transformations between Bayes Nets and Neural Netscited by 5

Built on by

Not cited yet.