mlsanityData to 14 Oct 2026

Manifold Percolation: from generative model to Reinforce learning

arXiv 2511.20503 ↗First posted 25 Nov 2025stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Generative modeling is typically framed as learning mapping rules, but from an observer's perspective without access to these rules, the task becomes disentangling the geometric support from the probability distribution. We propose that continuum percolation is uniquely suited to this support analysis, as the sampling process effectively projects high-dimensional density estimation onto a geometric counting problem on the support. In this work, we establish a rigorous correspondence between the topological phase transitions of random geometric graphs and the underlying data manifold in high-dimensional space. By analyzing the relationship between our proposed Percolation Shift metric and FID, we show that this metric captures structural pathologies, such as implicit mode collapse, where standard statistical metrics fail. Finally, we translate this topological phenomenon into a differentiable loss function that guides training. Experimental results confirm that this approach not only prevents manifold shrinkage but also fosters a form of synergistic improvement, where topological stability becomes a prerequisite for sustained high fidelity in both static generation and sequential decision making.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 19 references that are in the map. First posted on arXiv 25 Nov 2025.

Builds on

9 of 19 references.

References · 9

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2017Proximal Policy Optimization Algorithmscited by 15,215
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2017Deep reinforcement learning from human preferencescited by 3,912
  7. 2024TinyLlama: An Open-Source Small Language Modelcited by 618
  8. 2018Lipschitz regularity of deep neural networks: analysis and efficient estimationcited by 415
  9. 2014On the Number of Linear Regions of Deep Neural Networkscited by 381

Built on by

Not cited yet.