Extreme sparsification of physics-augmented neural networks for interpretable model discovery in mechanics
Not on the map. Why?
Abstract (arXiv)
Data-driven constitutive modeling with neural networks has received increased interest in recent years due to its ability to easily incorporate physical and mechanistic constraints and to overcome the challenging and time-consuming task of formulating phenomenological constitutive laws that can accurately capture the observed material response. However, even though neural network-based constitutive laws have been shown to generalize proficiently, the generated representations are not easily interpretable due to their high number of trainable parameters. Sparse regression approaches exist that allow to obtaining interpretable expressions, but the user is tasked with creating a library of model forms which by construction limits their expressiveness to the functional forms provided in the libraries. In this work, we propose to train regularized physics-augmented neural network-based constitutive models utilizing a smoothed version of L0-regularization. This aims to maintain the trustworthiness inherited by the physical constraints, but also enables interpretability which has not been possible thus far on any type of machine learning-based constitutive model where model forms were not assumed a-priory but were actually discovered. During the training process, the network simultaneously fits the training data and penalizes the number of active parameters, while also ensuring constitutive constraints such as thermodynamic consistency. We show that the method can reliably obtain interpretable and trustworthy constitutive models for compressible and incompressible hyperelasticity, yield functions, and hardening models for elastoplasticity, for synthetic and experimental data.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 32 of its 86 references that are in the map. First posted on arXiv 5 Oct 2023.
Builds on
32 of 86 references.
References · 32
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
- 2017Channel Pruning for Accelerating Very Deep Neural Networkscited by 702
- 2017Learning Sparse Neural Networks through L0 Regularizationcited by 583
- 2020What is the State of Neural Network Pruning?cited by 583
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 548
- 2021Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networkscited by 527
- 2017Nonparametric regression using deep neural networks with ReLU activation functioncited by 433
- 2016Input Convex Neural Networkscited by 414
- 2015Structured Pruning of Deep Convolutional Neural Networkscited by 149
- 2020SINDy-PI: A Robust Algorithm for Parallel Implicit Sparse Identification of Nonlinear Dynamicscited by 125
20 more
- 2019Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discoverycited by 93
- 2021Polyconvex anisotropic hyperelasticity with neural networkscited by 55
- 2020A Survey of Constrained Gaussian Process Regression: Approaches and Implementation Challengescited by 52
- 2020Unsupervised discovery of interpretable hyperelastic constitutive lawscited by 51
- 2022A new family of Constitutive Artificial Neural Networks towards automated model discoverycited by 49
- 2023Neural networks meet hyperelasticity: A guide to enforcing physicscited by 46
- 2023Seeing is Believing: Brain-Inspired Modular Training for Mechanistic Interpretabilitycited by 38
- 2022Automated discovery of generalized standard material models with EUCLIDcited by 31
- 2022Discovering plasticity models without stress datacited by 28
- 2020A machine learning based plasticity model using proper orthogonal decompositioncited by 26
- 2021On physics-informed data-driven isotropic and anisotropic constitutive models through probabilistic machine learning and space-filling samplingcited by 24
- 2021Local approximate Gaussian process regression for data-driven constitutive laws: Development and comparison with neural networkscited by 17
- 2022Modular machine learning-based elastoplasticity: generalization in the context of limited datacited by 16
- 2023Data-driven anisotropic finite viscoelasticity using neural ordinary differential equationscited by 16
- 2023Neural network-based multiscale modeling of finite strain magneto-elasticity with relaxed convexity criteriacited by 14
- 2022Finite electro-elasticity with physics-augmented neural networkscited by 12
- 2019Tensor Basis Gaussian Process Models of Hyperelastic Materialscited by 11
- 2023Automated discovery of interpretable hyperelastic material models for human brain tissue with EUCLIDcited by 10
- 2023Stress representations for tensor basis neural networks: alternative formulations to Finger-Rivlin-Ericksencited by 9
- 2023Physics-informed Data-driven Discovery of Constitutive Models with Application to Strain-Rate-sensitive Soft Materialscited by 6
Built on by
Citing papers per year: 2024: 5; 2025: 7; 2026: 4.
16 papers.
Sort:
- 2024A review on data-driven constitutive laws for solidscited by 35
- 2024Accounting for plasticity: An extension of inelastic Constitutive Artificial Neural Networkscited by 6
- 2025Polyconvex Physics-Augmented Neural Network Constitutive Models in Principal Stretchescited by 5
- 2025On the definition and importance of interpretability in scientific machine learningcited by 5
- 2024Improving the performance of Stein variational inference through extreme sparsification of physically-constrained neural network modelscited by 4
- 2025Physics Augmented Machine Learning Discovery of Composition-Dependent Constitutive Laws for 3D Printed Digital Materialscited by 4
- 2025A Complement to Neural Networks for Anisotropic Inelasticity at Finite Strainscited by 4
- 2025Input convex neural networks: universal approximation theorem and implementation for isotropic polyconvex hyperelastic energiescited by 3
- 2025Automated Constitutive Model Discovery by Pairing Sparse Regression Algorithms with Model Selection Criteriacited by 3
- 2026Towards Rapid Constitutive Model Discovery from Multi-Modal Data: Physics Augmented Finite Element Model Updating (paFEMU)cited by 3
- 2025Input Specific Neural Networkscited by 2
- 2024Equivariant graph convolutional neural networks for the representation of homogenized anisotropic microstructural mechanical responsecited by 0
4 more
- 2024Learning Physics-Consistent Material Behavior from Dynamic Displacementscited by 0
- 2026CANN-EUCLID: unsupervised constitutive artificial neural network model discovery from full-field datacited by 0
- 2026Physics-Informed Discovery of Yield Functions in Plasticity via Convex Neural Representationscited by 0
- 2026Interval and fuzzy physics-augmented neural networks (iPANN and fPANN) for uncertainty quantification and propagation in constitutive modelingcited by 0
- 2026Interval and fuzzy physics-augmented neural networks (iPANN and fPANN) for uncertainty quantification and propagation in constitutive modeling22 Jul 2026
- 2026Physics-Informed Discovery of Yield Functions in Plasticity via Convex Neural Representations12 Jun 2026
- 2026CANN-EUCLID: unsupervised constitutive artificial neural network model discovery from full-field data12 Jun 2026
- 2026Towards Rapid Constitutive Model Discovery from Multi-Modal Data: Physics Augmented Finite Element Model Updating (paFEMU)9 Apr 2026
- 2025A Complement to Neural Networks for Anisotropic Inelasticity at Finite Strains5 Oct 2025
- 2025Automated Constitutive Model Discovery by Pairing Sparse Regression Algorithms with Model Selection Criteria19 Sep 2025
- 2025Physics Augmented Machine Learning Discovery of Composition-Dependent Constitutive Laws for 3D Printed Digital Materials1 Jul 2025
- 2025On the definition and importance of interpretability in scientific machine learning16 May 2025
- 2025Polyconvex Physics-Augmented Neural Network Constitutive Models in Principal Stretches1 Mar 2025
- 2025Input Specific Neural Networks1 Mar 2025
- 2025Input convex neural networks: universal approximation theorem and implementation for isotropic polyconvex hyperelastic energies12 Feb 2025
- 2024Accounting for plasticity: An extension of inelastic Constitutive Artificial Neural Networks27 Jul 2024
4 more
- 2024Learning Physics-Consistent Material Behavior from Dynamic Displacements25 Jul 2024
- 2024Improving the performance of Stein variational inference through extreme sparsification of physically-constrained neural network models30 Jun 2024
- 2024A review on data-driven constitutive laws for solids6 May 2024
- 2024Equivariant graph convolutional neural networks for the representation of homogenized anisotropic microstructural mechanical response5 Apr 2024
- 2024A review on data-driven constitutive laws for solidscited by 35
- 2024Accounting for plasticity: An extension of inelastic Constitutive Artificial Neural Networkscited by 6
- 2025Polyconvex Physics-Augmented Neural Network Constitutive Models in Principal Stretchescited by 5
- 2025On the definition and importance of interpretability in scientific machine learningcited by 5
- 2024Improving the performance of Stein variational inference through extreme sparsification of physically-constrained neural network modelscited by 4
- 2025Physics Augmented Machine Learning Discovery of Composition-Dependent Constitutive Laws for 3D Printed Digital Materialscited by 4
- 2025A Complement to Neural Networks for Anisotropic Inelasticity at Finite Strainscited by 4
- 2025Input convex neural networks: universal approximation theorem and implementation for isotropic polyconvex hyperelastic energiescited by 3
- 2025Automated Constitutive Model Discovery by Pairing Sparse Regression Algorithms with Model Selection Criteriacited by 3
- 2026Towards Rapid Constitutive Model Discovery from Multi-Modal Data: Physics Augmented Finite Element Model Updating (paFEMU)cited by 3
- 2025Input Specific Neural Networkscited by 2
- 2024Equivariant graph convolutional neural networks for the representation of homogenized anisotropic microstructural mechanical responsecited by 0
12 most cited of 16 All 16 (JSON)
- 2026Interval and fuzzy physics-augmented neural networks (iPANN and fPANN) for uncertainty quantification and propagation in constitutive modeling22 Jul 2026
- 2026Physics-Informed Discovery of Yield Functions in Plasticity via Convex Neural Representations12 Jun 2026
- 2026CANN-EUCLID: unsupervised constitutive artificial neural network model discovery from full-field data12 Jun 2026
- 2026Towards Rapid Constitutive Model Discovery from Multi-Modal Data: Physics Augmented Finite Element Model Updating (paFEMU)9 Apr 2026
- 2025A Complement to Neural Networks for Anisotropic Inelasticity at Finite Strains5 Oct 2025
- 2025Automated Constitutive Model Discovery by Pairing Sparse Regression Algorithms with Model Selection Criteria19 Sep 2025
- 2025Physics Augmented Machine Learning Discovery of Composition-Dependent Constitutive Laws for 3D Printed Digital Materials1 Jul 2025
- 2025On the definition and importance of interpretability in scientific machine learning16 May 2025
- 2025Polyconvex Physics-Augmented Neural Network Constitutive Models in Principal Stretches1 Mar 2025
- 2025Input Specific Neural Networks1 Mar 2025
- 2025Input convex neural networks: universal approximation theorem and implementation for isotropic polyconvex hyperelastic energies12 Feb 2025
- 2024Accounting for plasticity: An extension of inelastic Constitutive Artificial Neural Networks27 Jul 2024
12 newest of 16 All 16 (JSON)