mlsanityData to 7 Oct 2026

Langevin-Informed Transfer Learning: Replacing Target Samples by Black-Box Feedback

arXiv 2610.01522 ↗First posted 1 Oct 2026cs.LG stat.MLcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Many scientific and machine learning systems, from molecular dynamics to diffusion models and beyond, are governed by stochastic dynamics with low-dimensional structure, evolving on slow timescales. However, target trajectories, used to identify and interpret such dynamics, are often inaccessible: only biased or static samples that explore the underlying manifold are available. We introduce Langevin-Informed Transfer Learning (LITL), a framework for recovering target Langevin dynamics from biased source samples using only black-box feedback. LITL learns the leading spectral structure of the target infinitesimal generator and the projected drift through Dirichlet representation learning, enabling kinetic reconstruction in spectral form and slow-manifold gradient field estimation. We further introduce a spherical variant well suited to steering normalized latent representations commonly used in learning systems toward desired objectives. We establish finite-sample guarantees for eigenvalue, eigenfunction, and projected drift estimation in Sobolev norms, thereby ensuring generalization of these quantities and their first-order derivatives. Empirically, LITL recovers physical transition timescales from biased molecular simulations, builds kinetic structure from static samples of generative models, reconstructs spherical symmetries of physical systems, and enables post-hoc latent steering of trained neural networks under black-box feedback. Together, these results position spectral operator learning as a practical framework for recovering stochastic dynamics under distribution shift and unlock applications across machine learning and the physical sciences.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 28 of its 61 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

28 of 61 references.

References · 28

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  6. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  7. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,323
  8. 2014How transferable are features in deep neural networks?cited by 1,216
  9. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  10. 2015An Introduction to Matrix Concentration Inequalitiescited by 391
  11. 2020Do Adversarially Robust ImageNet Models Transfer Better?cited by 315
  12. 2018Empirical Risk Minimization under Fairness Constraintscited by 226
16 more
  1. 2015The Benefit of Multitask Representation Learningcited by 194
  2. 2023A mathematical perspective on Transformerscited by 160
  3. 2015A Complete Recipe for Stochastic Gradient MCMCcited by 146
  4. 2017VAMPnets: Deep learning of molecular kineticscited by 135
  5. 2017Stochastic gradient descent performs variational inference, converges to limit cycles for deep networkscited by 108
  6. 2018Fairness Under Unawareness: Assessing Disparity When Protected Class Is Unobservedcited by 94
  7. 2019Data-driven approximation of the Koopman generator: Model reduction, system identification, and controlcited by 85
  8. 2017Variational approach for learning Markov processes from time series datacited by 51
  9. 2021Rigorous data-driven computation of spectral properties of Koopman operators for dynamical systemscited by 44
  10. 2025Metastable Dynamics of Chain-of-Thought Reasoning: Provable Benefits of Search, RL and Distillationcited by 25
  11. 2024Neural Conditional Probability for Uncertainty Quantificationcited by 14
  12. 2021Solving eigenvalue PDEs of metastable diffusion processes using artificial neural networkscited by 13
  13. 2024Learning the Infinitesimal Generator of Stochastic Diffusion Processescited by 9
  14. 2024Laplace Transform Based Low-Complexity Learning of Continuous Markov Semigroupscited by 7
  15. 2023The Galerkin method beats Graph-Based Approaches for Spectral Algorithmscited by 6
  16. 2024From Biased to Unbiased Dynamics: An Infinitesimal Generator Approachcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Diffusion Models are Molecular Dynamics Simulators
  2. 2026Memory-Conditioned Diffusion Model for Generalized Langevin Dynamics
  3. 2023Implicit Transfer Operator Learning: Multiple Time-Resolution Surrogates for Molecular Dynamics
  4. 2026Training-Free Generative Sampling via Moment-Matched Score Smoothing
  5. 2026Generative Modeling of Stochastic Dynamics for Long-Time Evolution
  6. 2024Posterior sampling via Langevin dynamics based on generative priors
  7. 2025Action-Minimization Meets Generative Modeling: Efficient Transition Path Sampling with the Onsager-Machlup Functional
  8. 2025Strictly Constrained Generative Modeling via Split Augmented Langevin Sampling