mlsanityData to 7 Oct 2026

Analysis of Kinetic Models for Label Switching and Stochastic Gradient Descent

arXiv 2207.00389 ↗First posted 1 Jul 2022math.AP cs.LG math-phcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper we provide a novel approach to the analysis of kinetic models for label switching, which are used for particle systems that can randomly switch between gradient flows in different energy landscapes. Besides problems in biology and physics, we also demonstrate that stochastic gradient descent, the most popular technique in machine learning, can be understood in this setting, when considering a time-continuous variant. Our analysis is focusing on the case of evolution in a collection of external potentials, for which we provide analytical and numerical results about the evolution as well as the stationary problem.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 28 references that are in the map. First posted on arXiv 1 Jul 2022.

Builds on

5 of 28 references.

References · 5

  1. 2018Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundationscited by 109
  2. 2021Stochastic gradient descent with noise of machine learning type. Part I: Discrete time analysiscited by 38
  3. 2020Analysis of Stochastic Gradient Descent in Continuous Timecited by 24
  4. 2019Uniform-in-Time Weak Error Analysis for Stochastic Gradient Descent Algorithms via Diffusion Approximationcited by 14
  5. 2021The convergence of the Stochastic Gradient Descent (SGD) : a self-contained proofcited by 9

Built on by

Not cited yet.