Amortized Synthesis of Constrained Configurations Using a Differentiable Surrogate
Not on the map. Why?
Abstract (arXiv)
In design, fabrication, and control problems, we are often faced with the task of synthesis, in which we must generate an object or configuration that satisfies a set of constraints while maximizing one or more objective functions. The synthesis problem is typically characterized by a physical process in which many different realizations may achieve the goal. This many-to-one map presents challenges to the supervised learning of feed-forward synthesis, as the set of viable designs may have a complex structure. In addition, the non-differentiable nature of many physical simulations prevents efficient direct optimization. We address both of these problems with a two-stage neural network architecture that we may consider to be an autoencoder. We first learn the decoder: a differentiable surrogate that approximates the many-to-one physical realization process. We then learn the encoder, which maps from goal to design, while using the fixed decoder to evaluate the quality of the realization. We evaluate the approach on two case studies: extruder path planning in additive manufacturing and constrained soft robot inverse kinematics. We compare our approach to direct optimization of the design using the learned surrogate, and to supervised learning of the synthesis problem. We find that our approach produces higher quality solutions than supervised learning, while being competitive in quality with direct optimization, at a greatly reduced computational cost.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 22 of its 101 references that are in the map. First posted on arXiv 16 Jun 2021.
Builds on
22 of 101 references.
References · 22
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
- 2018Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understandingcited by 304
- 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
- 2019Conditioning by adaptive sampling for robust designcited by 110
- 2017MarrNet: 3D Shape Reconstruction via 2.5D Sketchescited by 108
- 2018Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learningcited by 101
- 2019Learning to Infer and Execute 3D Shape Programscited by 68
- 2020Autofocused oracles for model-based designcited by 50
- 2017Latent Constraints: Learning to Generate Conditionally from Unconditional Generative Modelscited by 39
10 more
- 2021Offline Model-Based Optimization via Normalized Maximum Likelihood Estimationcited by 38
- 2020Calibrated Surrogate Losses for Adversarially Robust Classificationcited by 36
- 2018Design by adaptive samplingcited by 31
- 2017Generating and designing DNA with deep generative modelscited by 30
- 2019Learning Surrogate Lossescited by 21
- 2019Discrete Object Generation with Reversible Inductive Constructioncited by 16
- 2020DiffTune: Optimizing CPU Simulator Parameters with Learned Differentiable Surrogatescited by 14
- 2020Learning Surrogates via Deep Embeddingcited by 11
- 2020FAME: 3D Shape Generation via Functionality-Aware Model Evolutioncited by 8
- 2020A Unified Framework of Surrogate Loss by Refactoring and Interpolationcited by 5
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 0; 2024: 0; 2025: 0; 2026: 2.
6 papers.
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2022Bi-level Physics-Informed Neural Networks for PDE Constrained Optimization using Broyden's Hypergradientscited by 17
- 2022Autoinverse: Uncertainty Aware Inversion of Neural Networkscited by 16
- 2021Mixed Integer Neural Inverse Designcited by 3
- 2026Reduced-order Neural Modeling with Differentiable Simulation for High-Detail Tactile Perceptioncited by 0
- 2026Amortized Neural Optimization for Pre-Layout Signal Integrity Design Space Exploration using Differentiable Surrogatescited by 0
- 2026Amortized Neural Optimization for Pre-Layout Signal Integrity Design Space Exploration using Differentiable Surrogates5 Jun 2026
- 2026Reduced-order Neural Modeling with Differentiable Simulation for High-Detail Tactile Perception6 May 2026
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications15 Nov 2022
- 2022Bi-level Physics-Informed Neural Networks for PDE Constrained Optimization using Broyden's Hypergradients15 Sep 2022
- 2022Autoinverse: Uncertainty Aware Inversion of Neural Networks29 Aug 2022
- 2021Mixed Integer Neural Inverse Design27 Sep 2021