mlsanityData to 14 Oct 2026

Mode Collapse Is Cheap to Detect: A Ground-Truth-Free Pre-Flight Check for Neural Samplers

arXiv 2609.26272 ↗First posted 20 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural samplers are trained against an unnormalised target tildeπ=e-E with no samples from π, which leaves the practitioner with no way to tell whether an expensive training run has silently dropped part of the target. The diagnostics in common use are computed from the model's own draws and are therefore confined to the model's support: we exhibit a sampler whose self-normalised effective sample size is 0.99 while it misses 87% of the target mass. We argue that detecting missing mass is a strictly easier problem than sampling it: detection needs one point per missed basin plus a local curvature estimate, whereas correction needs the sampler retrained. We turn this into a pre-flight check that consumes a few percent of the sampler's own training budget and uses only E, nabla E and nabla2 E. On Gaussian-mixture, Many-Well and rotated anisotropic Many-Well targets with exactly computable ground truth, the check estimates the missing mass to within 10-3 at 2.7% of training cost, where a tuned annealed SMC reference needs 70--280% of training cost to do worse. It also applies unchanged to a controlled-SDE sampler that has no tractable density, where ESS and the ELBO cannot be formed at all. The estimator carries a self-diagnostic that, without ground truth, is conservative in the safe direction: across 60 configurations it clears 16, of which 15 are accurate to 10-2 or better. We are explicit about what this does and does not license: the check cheaply produces evidence of missing mass, and sometimes evidence that the search has stabilised, but it cannot certify a run, and its thresholds are heuristic. We then map the boundary of the method on a real physical landscape, LJ-13, and report where it fails and why.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 30 references that are in the map. First posted on arXiv 20 Aug 2026.

Builds on

24 of 30 references.

References · 24

  1. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  2. 2018Assessing Generative Models via Precision and Recallcited by 406
  3. 2021Path Integral Sampler: a stochastic control approach for samplingcited by 181
  4. 2025Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matchingcited by 85
  5. 2024NETS: A Non-Equilibrium Transport Samplercited by 69
  6. 2024Beyond ELBOs: A Large-Scale Evaluation of Variational Methods for Samplingcited by 56
  7. 2024Sequential Controlled Langevin Diffusionscited by 48
  8. 2025Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physicscited by 29
  9. 2025No Trick, No Treat: Pursuits and Challenges Towards Simulation-free Training of Neural Samplerscited by 28
  10. 2025Proximal Diffusion Neural Samplercited by 16
  11. 2025Progressive Tempering Sampler with Diffusioncited by 13
  12. 2025On scalable and efficient training of diffusion samplerscited by 10
12 more
  1. 2024Batch, match, and patch: low-rank approximations for score-based variational inferencecited by 8
  2. 2026Flow Sampling: Learning to Sample from Unnormalized Densities via Denoising Conditional Processescited by 5
  3. 2025End-To-End Learning of Gaussian Mixture Priors for Diffusion Samplercited by 4
  4. 2025Diffusion Bridge Variational Inference for Deep Gaussian Processescited by 4
  5. 2025Model-Informed Flows for Bayesian Inferencecited by 3
  6. 2026Diffusion models recover accurate mixture weights despite score function insensitivitycited by 3
  7. 2024Denoising Diffusion Variational Inference: Diffusion Models as Expressive Variational Posteriorscited by 2
  8. 2025FlowVAT: Normalizing Flow Variational Inference with Affine-Invariant Temperingcited by 2
  9. 2025Fisher meets Feynman: score-based variational inference with a product of expertscited by 2
  10. 2025Normalizing Flow Regression for Bayesian Inference with Offline Likelihood Evaluationscited by 1
  11. 2026Large-scale Score-based Variational Posterior Inference for Bayesian Deep Neural Networkscited by 1
  12. 2026Conditional Diffusion Samplingcited by 1

Built on by

Not cited yet.