Design Strategy Network: A deep hierarchical framework to represent generative design strategies in complex action spaces
Not on the map. Why?
Abstract (arXiv)
Generative design problems often encompass complex action spaces that may be divergent over time, contain state-dependent constraints, or involve hybrid (discrete and continuous) domains. To address those challenges, this work introduces Design Strategy Network (DSN), a data-driven deep hierarchical framework that can learn strategies over these arbitrary complex action spaces. The hierarchical architecture decomposes every action decision into first predicting a preferred spatial region in the design space and then outputting a probability distribution over a set of possible actions from that region. This framework comprises a convolutional encoder to work with image-based design state representations, a multi-layer perceptron to predict a spatial region, and a weight-sharing network to generate a probability distribution over unordered set-based inputs of feasible actions. Applied to a truss design study, the framework learns to predict the actions of human designers in the study, capturing their truss generation strategies in the process. Results show that DSNs significantly outperform non-hierarchical methods of policy representation, demonstrating their superiority in complex action space problems.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 30 of its 73 references that are in the map. First posted on arXiv 7 Oct 2021.
Builds on
30 of 73 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2016Generative Adversarial Imitation Learningcited by 1,597
- 2017Deep Setscited by 1,421
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
- 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,103
18 more
- 2016End to End Learning for Self-Driving Carscited by 1,009
- 2014Striving for Simplicity: The All Convolutional Netcited by 990
- 2018Image Transformercited by 772
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2014Recurrent Models of Visual Attentioncited by 349
- 2017Thinking Fast and Slow with Deep Learning and Tree Searchcited by 252
- 2019Towards Interpretable Reinforcement Learning Using Attention Augmented Agentscited by 82
- 2020In the Eye of the Beholder: Gaze and Actions in First Person Videocited by 69
- 2015Deep Reinforcement Learning in Parameterized Action Spacecited by 68
- 2015Reinforcement Learning with Parameterized Actionscited by 63
- 2018Parametrized Deep Q-Networks Learning: Reinforcement Learning with Discrete-Continuous Hybrid Action Spacecited by 58
- 2019Discrete and Continuous Action Representation for Practical RL in Video Gamescited by 39
- 20193D Shape Synthesis for Conceptual Design and Optimization Using Variational Autoencoderscited by 18
- 2019On Deep Set Learning and the Choice of Aggregationscited by 13
- 2020Attention Routing: track-assignment detailed routing using attention-based reinforcement learningcited by 11
- 2019Gaze Training by Modulated Dropout Improves Imitation Learningcited by 10
- 2019Learning to design from humans: Imitating human designers through deep learningcited by 8
- 2016Learning an Optimization Algorithm through Human Design Iterationscited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 1.
4 papers.
- 2023Conceptual Design Generation Using Large Language Modelscited by 13
- 2024Generative AI and Process Systems Engineering: The Next Frontiercited by 9
- 2023Opportunities for Large Language Models and Discourse in Engineering Designcited by 6
- 2022Learning to design without prior data: Discovering generalizable design strategies using deep learning and tree searchcited by 5
- 2024Generative AI and Process Systems Engineering: The Next Frontier15 Feb 2024
- 2023Opportunities for Large Language Models and Discourse in Engineering Design15 Jun 2023
- 2023Conceptual Design Generation Using Large Language Models30 May 2023
- 2022Learning to design without prior data: Discovering generalizable design strategies using deep learning and tree search28 Nov 2022