Neural Networks for Generating Better Local Optima in Topology Optimization
Not on the map. Why?
Abstract (arXiv)
Neural networks have recently been employed as material discretizations within adjoint optimization frameworks for inverse problems and topology optimization. While advantageous regularization effects and better optima have been found for some inverse problems, the benefit for topology optimization has been limited -- where the focus of investigations has been the compliance problem. We demonstrate how neural network material discretizations can, under certain conditions, find better local optima in more challenging optimization problems, where we here specifically consider acoustic topology optimization. The chances of identifying a better optimum can significantly be improved by running multiple partial optimizations with different neural network initializations. Furthermore, we show that the neural network material discretization's advantage comes from the interplay with the Adam optimizer and emphasize its current limitations when competing with constrained and higher-order optimization techniques. At the moment, this discretization has only been shown to be beneficial for unconstrained first-order optimization.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 33 of its 112 references that are in the map. First posted on arXiv 25 Jul 2024.
Builds on
33 of 112 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2014How transferable are features in deep neural networks?cited by 1,216
- 2015Automatic differentiation in machine learning: a surveycited by 846
- 2019Why gradient clipping accelerates training: A theoretical justification for adaptivitycited by 335
21 more
- 2020Model Reduction and Neural Networks for Parametric PDEscited by 257
- 2018Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flowscited by 147
- 2021Polyconvex anisotropic hyperelasticity with neural networkscited by 54
- 2020Unsupervised discovery of interpretable hyperelastic constitutive lawscited by 51
- 2023Inverse-design of nonlinear mechanical metamaterials via video denoising diffusion modelscited by 48
- 2023Neural networks meet hyperelasticity: A guide to enforcing physicscited by 45
- 2019Neural reparameterization improves structural optimizationcited by 44
- 2018Deep learning for determining a near-optimal topological design without any iterationcited by 40
- 2022On the use of Artificial Neural Networks in Topology Optimisationcited by 35
- 2018Stress Field Prediction in Cantilevered Structures Using Convolutional Neural Networkscited by 25
- 2023A Comprehensive Survey of Deep Transfer Learning for Anomaly Detection in Industrial Time Series: Methods, Applications, and Directionscited by 22
- 2023Deep Learning in Deterministic Computational Mechanicscited by 21
- 2021A Deep Neural Network Surrogate Modeling Benchmark for Temperature Field Prediction of Heat Source Layoutcited by 15
- 2021Real-Time Topology Optimization in 3D via Deep Transfer Learningcited by 14
- 2024Neural topology optimization: the good, the bad, and the uglycited by 9
- 2021Quantitative reconstruction of defects in multi-layered bonded composites using fully convolutional network-based ultrasonic inversioncited by 5
- 2023On the Use of Neural Networks for Full Waveform Inversioncited by 5
- 2023Transfer Learning Enhanced Full Waveform Inversioncited by 4
- 2023Neural Level Set Topology Optimization Using Unfitted Finite Elementscited by 3
- 2021GANTL: Towards Practical and Real-Time Topology Optimization with Conditional GANs and Transfer Learningcited by 1
- 2021Revisiting Non-Convexity in Topology Optimization of Compliance Minimization Problemscited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 2.
3 papers.