mlsanityData to 7 Oct 2026

DeepParticle: learning invariant measure by a deep neural network minimizing Wasserstein distance on data generated from an interacting particle method

arXiv 2111.01356 ↗First posted 2 Nov 2021cs.LG physics.comp-phcited by 9

Not on the map. Why?

Abstract (arXiv)

We introduce the so called DeepParticle method to learn and generate invariant measures of stochastic dynamical systems with physical parameters based on data computed from an interacting particle method (IPM). We utilize the expressiveness of deep neural networks (DNNs) to represent the transform of samples from a given input (source) distribution to an arbitrary target distribution, neither assuming distribution functions in closed form nor a finite state space for the samples. In training, we update the network weights to minimize a discrete Wasserstein distance between the input and target samples. To reduce computational cost, we propose an iterative divide-and-conquer (a mini-batch interior point) algorithm, to find the optimal transition matrix in the Wasserstein distance. We present numerical results to demonstrate the performance of our method for accelerating IPM computation of invariant measures of stochastic dynamical systems arising in computing reaction-diffusion front speeds through chaotic flows. The physical parameter is a large Pecl'et number reflecting the advection dominated regime of our interest.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 28 of its 76 references that are in the map. First posted on arXiv 2 Nov 2021.

Builds on

28 of 76 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  3. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  4. 2018Computational Optimal Transportcited by 765
  5. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  6. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
  7. 2016Error bounds for approximations with deep ReLU networkscited by 567
  8. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  9. 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 329
  10. 2017PDE-Net: Learning PDEs from Datacited by 304
  11. 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
  12. 2018PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Networkcited by 208
16 more
  1. 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
  2. 2017Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equationscited by 188
  3. 2020Deep Network Approximation for Smooth Functionscited by 163
  4. 2015On the Expressive Power of Deep Learning: A Tensor Analysiscited by 97
  5. 2019A Machine Learning Framework for Solving High-Dimensional Mean Field Game and Mean Field Control Problemscited by 95
  6. 2018Data Driven Governing Equations Approximation Using Deep Neural Networkscited by 94
  7. 2018Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systemscited by 88
  8. 2019Data-Driven Deep Learning of Partial Differential Equations in Modal Spacecited by 46
  9. 2020Alternating the Population and Control Neural Networks to Solve High-Dimensional Stochastic Mean-Field Gamescited by 35
  10. 2020Numerical Solution of Inverse Problems by Weak Adversarial Networkscited by 29
  11. 2019Deep least-squares methods: an unsupervised learning-based numerical method for solving elliptic PDEscited by 27
  12. 2021Least-Squares ReLU Neural Network (LSNN) Method For Linear Advection-Reaction Equationcited by 16
  13. 2020Deep regularization and direct training of the inner layers of Neural Networks with Kernel Flowscited by 10
  14. 2018Deep Multiscale Model Learningcited by 8
  15. 2019Convergence Analysis of Machine Learning Algorithms for the Numerical Solution of Mean Field Control and Games: I -- The Ergodic Casecited by 5
  16. 2020Global Convergence and Geometric Characterization of Slow to Fast Weight Evolution in Neural Network Training for Classifying Linearly Non-Separable Datacited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 1; 2024: 0; 2025: 4; 2026: 1.

9 papers.