Multi-scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose multi-scale deep neural networks (MscaleDNNs) using the idea of radial scaling in frequency domain and activation functions with compact support. The radial scaling converts the problem of approximation of high frequency contents of PDEs' solutions to a problem of learning about lower frequency functions, and the compact support activation functions facilitate the separation of frequency contents of the target function to be approximated by corresponding DNNs. As a result, the MscaleDNNs achieve fast uniform convergence over multiple scales. The proposed MscaleDNNs are shown to be superior to traditional fully connected DNNs and be an effective mesh-less numerical method for Poisson-Boltzmann equations with ample frequency contents over complex and singular domains.
Key facts. Cited by 78 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 11; 2023: 13; 2024: 19; 2025: 18; 2026: 3.
78 papers.
Sort:
By area:
- 2021Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemscited by 220
- 2021Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equationscited by 142
- 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2024From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learningcited by 73
- 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networkscited by 70
- 2022Overview frequency principle/spectral bias in deep learningcited by 68
- 2021Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functionscited by 49
- 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modelingcited by 36
- 2021SPINN: Sparse, Physics-based, and partially Interpretable Neural Networks for PDEscited by 32
- 2021Towards Understanding the Condensation of Neural Networks at Initial Trainingcited by 31
- 2021MOD-Net: A Machine Learning Approach via Model-Operator-Data Network for Solving PDEscited by 24
38 more
- 2022Finite Expression Method for Solving High-Dimensional Partial Differential Equationscited by 21
- 2021Reproducing Activation Function for Deep Learningcited by 19
- 2023Loss Spike in Training Neural Networkscited by 15
- 2023A practical PINN framework for multi-scale problems with multi-magnitude loss termscited by 15
- 2021Linear Frequency Principle Model to Understand the Absence of Overfitting in Neural Networkscited by 14
- 2021Solving Partial Differential Equations with Point Source Based on Physics-Informed Neural Networkscited by 14
- 2024Addressing Spectral Bias of Deep Neural Networks by Multi-Grade Deep Learningcited by 14
- 2025Do We Always Need the Simplicity Bias? Looking for Optimal Inductive Biases in the Wildcited by 13
- 2025An overview of condensation phenomenon in deep learningcited by 13
- 2023Monte Carlo Neural PDE Solver for Learning PDEs via Probabilistic Representationcited by 11
- 2021Subspace Decomposition based DNN algorithm for elliptic type multi-scale PDEscited by 10
- 2022Multiple Descent in the Multiple Random Feature Modelcited by 10
- 2025Binned Spectral Power Loss for Improved Prediction of Chaotic Systemscited by 10
- 2021Stationary Density Estimation of Ito Diffusions Using Deep Learningcited by 9
- 2024Parametric Encoding with Attention and Convolution Mitigate Spectral Bias of Neural Partial Differential Equation Solverscited by 9
- 2022A Dimension-Augmented Physics-Informed Neural Network (DaPINN) with High Level Accuracy and Efficiencycited by 7
- 2023A Block-Coordinate Approach of Multi-level Optimization with an Application to Physics-Informed Neural Networkscited by 7
- 2022Adaptive physics-informed neural operator for coarse-grained non-equilibrium flowscited by 6
- 2024Acquiring Clean Language Models from Backdoor Poisoned Datasets by Downscaling Frequency Spacecited by 6
- 2021Hierarchical Learning to Solve Partial Differential Equations Using Physics-Informed Neural Networkscited by 5
- 2022Deep Random Vortex Method for Simulation and Inference of Navier-Stokes Equationscited by 5
- 2023Neural Control of Parametric Solutions for High-dimensional Evolution PDEscited by 5
- 2024Frequency-adaptive Multi-scale Deep Neural Networkscited by 5
- 2025Spectral Bias in Variational Quantum Machine Learningcited by 5
- 2021Frequency Principle in Deep Learning Beyond Gradient-descent-based Trainingcited by 4
- 2023Temporal Convolutional Explorer Helps Understand 1D-CNN's Learning Behavior in Time Series Classification from Frequency Domaincited by 4
- 2025Fourier Multi-Component and Multi-Layer Neural Networks: Unlocking High-Frequency Potentialcited by 4
- 2021An Upper Limit of Decaying Rate with Respect to Frequency in Deep Neural Networkcited by 3
- 2022Computing non-equilibrium trajectories by a deep learning approachcited by 3
- 2023Solving multiscale elliptic problems by sparse radial basis function neural networkscited by 3
- 2024Physics and geometry informed neural operator network with application to acoustic scatteringcited by 3
- 2024Quantifying Training Difficulty and Accelerating Convergence in Neural Network-Based PDE Solverscited by 3
- 2025Computational Advantages of Multi-Grade Deep Learning: Convergence Analysis and Performance Insightscited by 3
- 2022On the Compatibility between Neural Networks and Partial Differential Equations for Physics-informed Learningcited by 2
- 2024Spectrum-Informed Multistage Neural Networks: Multiscale Function Approximators of Machine Precisioncited by 2
- 2024Enhanced BPINN Training Convergence in Solving General and Multi-scale Elliptic PDEs with Noisecited by 2
- 2024M2M: Learning controllable Multi of experts and multi-scale operators are the Partial Differential Equations needcited by 2
- 2025Learn Singularly Perturbed Solutions via Homotopy Dynamicscited by 2
50 most cited of 78 All 78 (JSON)
- 2026Frequency Shift Physics-Informed Extreme Learning Machine for Solving High-Frequency Partial Differential Equations2 Jul 2026
- 2026MUSA-PINN: Multi-scale Weak-form Physics-Informed Neural Networks for Fluid Flow in Complex Geometries9 Mar 2026
- 2026Parametrization of subgrid scales in long-term simulations of the shallow-water equations using machine learning and convex limiting30 Jan 2026
- 2025FreIE: Low-Frequency Spectral Bias in Neural Networks for Time-Series Tasks29 Oct 2025
- 2025Multi-Scale Finite Expression Method for PDEs with Oscillatory Solutions on Complex Domains26 Oct 2025
- 2025Application of Reduced-Order Models for Temporal Multiscale Representations in the Prediction of Dynamical Systems21 Oct 2025
- 2025Statistical Learning Guarantees for Group-Invariant Barron Functions27 Sep 2025
- 2025Is the Frequency Principle always valid?24 Aug 2025
- 2025Frequency-adaptive tensor neural networks for high-dimensional multi-scale problems21 Aug 2025
- 2025Computational Advantages of Multi-Grade Deep Learning: Convergence Analysis and Performance Insights27 Jul 2025
- 2025Energy Dissipation Rate Guided Adaptive Sampling for Physics-Informed Neural Networks: Resolving Surface-Bulk Dynamics in Allen-Cahn Systems13 Jul 2025
- 2025Spectral Bias in Variational Quantum Machine Learning27 Jun 2025
38 more
- 2025Over-PINNs: Enhancing Physics-Informed Neural Networks via Higher-Order Partial Derivative Overdetermination of PDEs6 Jun 2025
- 2025A ZeNN architecture to avoid the Gaussian trap26 May 2025
- 2025Multi-level datasets training method in Physics-Informed Neural Networks30 Apr 2025
- 2025Multi-scale DeepOnet (Mscale-DeepOnet) for Mitigating Spectral Bias in Learning High Frequency Operators of Oscillatory Functions15 Apr 2025
- 2025An overview of condensation phenomenon in deep learning13 Apr 2025
- 2025Do We Always Need the Simplicity Bias? Looking for Optimal Inductive Biases in the Wild13 Mar 2025
- 2025Fourier Multi-Component and Multi-Layer Neural Networks: Unlocking High-Frequency Potential26 Feb 2025
- 2025Learn Singularly Perturbed Solutions via Homotopy Dynamics1 Feb 2025
- 2025Binned Spectral Power Loss for Improved Prediction of Chaotic Systems1 Feb 2025
- 2024ε-rank and the Staircase Phenomenon: New Insights into Neural Network Training Dynamics6 Dec 2024
- 2024Addressing Spectral Bias of Deep Neural Networks by Multi-Grade Deep Learning21 Oct 2024
- 2024From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learning17 Oct 2024
- 2024Quantifying Training Difficulty and Accelerating Convergence in Neural Network-Based PDE Solvers8 Oct 2024
- 2024M2M: Learning controllable Multi of experts and multi-scale operators are the Partial Differential Equations need1 Oct 2024
- 2024Frequency-adaptive Multi-scale Deep Neural Networks28 Sep 2024
- 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modeling13 Sep 2024
- 2024Enhanced BPINN Training Convergence in Solving General and Multi-scale Elliptic PDEs with Noise18 Aug 2024
- 2024Spectrum-Informed Multistage Neural Networks: Multiscale Function Approximators of Machine Precision24 Jul 2024
- 2024Benign overfitting in Fixed Dimension via Physics-Informed Learning with Smooth Inductive Bias13 Jun 2024
- 2024A Noise-robust Multi-head Attention Mechanism for Formation Resistivity Prediction: Frequency Aware LSTM6 Jun 2024
- 2024Physics and geometry informed neural operator network with application to acoustic scattering2 Jun 2024
- 2024Loss Jump During Loss Switch in Solving PDEs with Neural Networks6 May 2024
- 2024Parametric Encoding with Attention and Convolution Mitigate Spectral Bias of Neural Partial Differential Equation Solvers22 Mar 2024
- 2024MPIPN: A Multi Physics-Informed PointNet for solving parametric acoustic-structure systems2 Mar 2024
- 2024Two-scale Neural Networks for Partial Differential Equations with Small Parameters27 Feb 2024
- 2024Acquiring Clean Language Models from Backdoor Poisoned Datasets by Downscaling Frequency Space19 Feb 2024
- 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networks1 Feb 2024
- 2024Approximation of Solution Operators for High-dimensional PDEs18 Jan 2024
- 2023Enhanced physics-informed neural networks with domain scaling and residual correction methods for multi-frequency elliptic problems7 Nov 2023
- 2023Zero Coordinate Shift: Whetted Automatic Differentiation for Physics-informed Operator Learning1 Nov 2023
- 2023Temporal Convolutional Explorer Helps Understand 1D-CNN's Learning Behavior in Time Series Classification from Frequency Domain9 Oct 2023
- 2023Solving multiscale elliptic problems by sparse radial basis function neural networks1 Sep 2023
- 2023An Expert's Guide to Training Physics-informed Neural Networks16 Aug 2023
- 2023A practical PINN framework for multi-scale problems with multi-magnitude loss terms13 Aug 2023
- 2023A Block-Coordinate Approach of Multi-level Optimization with an Application to Physics-Informed Neural Networks23 May 2023
- 2023Loss Spike in Training Neural Networks20 May 2023
- 2023Physics-informed Neural Network Combined with Characteristic-Based Split for Solving Navier-Stokes Equations21 Apr 2023
- 2023Properties and Potential Applications of Random Functional-Linked Types of Neural Networks3 Apr 2023
50 newest of 78 All 78 (JSON)
- 2021Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemscited by 220
- 2021Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equationscited by 142
- 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2024From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learningcited by 73
- 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networkscited by 70
- 2022Overview frequency principle/spectral bias in deep learningcited by 68
- 2021Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functionscited by 49
- 2021SPINN: Sparse, Physics-based, and partially Interpretable Neural Networks for PDEscited by 32
- 2021Towards Understanding the Condensation of Neural Networks at Initial Trainingcited by 31
- 2021MOD-Net: A Machine Learning Approach via Model-Operator-Data Network for Solving PDEscited by 24
- 2022Finite Expression Method for Solving High-Dimensional Partial Differential Equationscited by 21
12 most cited of 76 All 76 (JSON)
- 2026Frequency Shift Physics-Informed Extreme Learning Machine for Solving High-Frequency Partial Differential Equations2 Jul 2026
- 2026MUSA-PINN: Multi-scale Weak-form Physics-Informed Neural Networks for Fluid Flow in Complex Geometries9 Mar 2026
- 2026Parametrization of subgrid scales in long-term simulations of the shallow-water equations using machine learning and convex limiting30 Jan 2026
- 2025FreIE: Low-Frequency Spectral Bias in Neural Networks for Time-Series Tasks29 Oct 2025
- 2025Multi-Scale Finite Expression Method for PDEs with Oscillatory Solutions on Complex Domains26 Oct 2025
- 2025Application of Reduced-Order Models for Temporal Multiscale Representations in the Prediction of Dynamical Systems21 Oct 2025
- 2025Statistical Learning Guarantees for Group-Invariant Barron Functions27 Sep 2025
- 2025Is the Frequency Principle always valid?24 Aug 2025
- 2025Frequency-adaptive tensor neural networks for high-dimensional multi-scale problems21 Aug 2025
- 2025Computational Advantages of Multi-Grade Deep Learning: Convergence Analysis and Performance Insights27 Jul 2025
- 2025Energy Dissipation Rate Guided Adaptive Sampling for Physics-Informed Neural Networks: Resolving Surface-Bulk Dynamics in Allen-Cahn Systems13 Jul 2025
- 2025Spectral Bias in Variational Quantum Machine Learning27 Jun 2025
12 newest of 76 All 76 (JSON)