Enhancing Inverse Problem Solutions with Accurate Surrogate Simulators and Promising Candidates
Not on the map. Why?
Abstract (arXiv)
Deep-learning inverse techniques have attracted significant attention in recent years. Among them, the neural adjoint (NA) method, which employs a neural network surrogate simulator, has demonstrated impressive performance in the design tasks of artificial electromagnetic materials (AEM). However, the impact of the surrogate simulators' accuracy on the solutions in the NA method remains uncertain. Furthermore, achieving sufficient optimization becomes challenging in this method when the surrogate simulator is large, and computational resources are limited. Additionally, the behavior under constraints has not been studied, despite its importance from the engineering perspective. In this study, we investigated the impact of surrogate simulators' accuracy on the solutions and discovered that the more accurate the surrogate simulator is, the better the solutions become. We then developed an extension of the NA method, named Neural Lagrangian (NeuLag) method, capable of efficiently optimizing a sufficient number of solution candidates. We then demonstrated that the NeuLag method can find optimal solutions even when handling sufficient candidates is difficult due to the use of a large and accurate surrogate simulator. The resimulation errors of the NeuLag method were approximately 1/50 compared to previous methods for three AEM tasks. Finally, we performed optimization under constraint using NA and NeuLag, and confirmed their potential in optimization with soft or hard constraints. We believe our method holds potential in areas that require large and accurate surrogate simulators.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 49 references that are in the map. First posted on arXiv 26 Apr 2023.
Builds on
19 of 49 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2016Layer Normalizationcited by 5,669
- 2022Generative Adversarial Networkscited by 5,627
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2019Big Transfer (BiT): General Visual Representation Learningcited by 769
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
7 more
- 2018Analyzing Inverse Problems with Invertible Neural Networkscited by 242
- 2019Ab-Initio Solution of the Many-Electron Schr"odinger Equation with Deep Neural Networkscited by 200
- 2019Deep neural network solution of the electronic Schr"odinger equationcited by 127
- 2020Benchmarking deep inverse models over time, and the neural-adjoint methodcited by 28
- 2021Benchmarking Invertible Architectures on Inverse Problemscited by 25
- 2019Designing nanophotonic structures using conditional-deep convolutional generative adversarial networkscited by 16
- 2021Inverse deep learning methods and benchmarks for artificial electromagnetic material designcited by 10
Built on by
Citing papers per year: 2024: 1.
1 paper.