mlsanityData to 14 Oct 2026

Design Strategy Network: A deep hierarchical framework to represent generative design strategies in complex action spaces

arXiv 2110.03760 ↗First posted 7 Oct 2021cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Generative design problems often encompass complex action spaces that may be divergent over time, contain state-dependent constraints, or involve hybrid (discrete and continuous) domains. To address those challenges, this work introduces Design Strategy Network (DSN), a data-driven deep hierarchical framework that can learn strategies over these arbitrary complex action spaces. The hierarchical architecture decomposes every action decision into first predicting a preferred spatial region in the design space and then outputting a probability distribution over a set of possible actions from that region. This framework comprises a convolutional encoder to work with image-based design state representations, a multi-layer perceptron to predict a spatial region, and a weight-sharing network to generate a probability distribution over unordered set-based inputs of feasible actions. Applied to a truss design study, the framework learns to predict the actions of human designers in the study, capturing their truss generation strategies in the process. Results show that DSNs significantly outperform non-hierarchical methods of policy representation, demonstrating their superiority in complex action space problems.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 30 of its 73 references that are in the map. First posted on arXiv 7 Oct 2021.

Builds on

30 of 73 references.

References · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  6. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  7. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  8. 2015Continuous control with deep reinforcement learningcited by 3,407
  9. 2016Generative Adversarial Imitation Learningcited by 1,597
  10. 2017Deep Setscited by 1,421
  11. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
  12. 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,103
18 more
  1. 2016End to End Learning for Self-Driving Carscited by 1,009
  2. 2014Striving for Simplicity: The All Convolutional Netcited by 990
  3. 2018Image Transformercited by 772
  4. 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
  5. 2014Recurrent Models of Visual Attentioncited by 349
  6. 2017Thinking Fast and Slow with Deep Learning and Tree Searchcited by 252
  7. 2019Towards Interpretable Reinforcement Learning Using Attention Augmented Agentscited by 82
  8. 2020In the Eye of the Beholder: Gaze and Actions in First Person Videocited by 69
  9. 2015Deep Reinforcement Learning in Parameterized Action Spacecited by 68
  10. 2015Reinforcement Learning with Parameterized Actionscited by 63
  11. 2018Parametrized Deep Q-Networks Learning: Reinforcement Learning with Discrete-Continuous Hybrid Action Spacecited by 58
  12. 2019Discrete and Continuous Action Representation for Practical RL in Video Gamescited by 39
  13. 20193D Shape Synthesis for Conceptual Design and Optimization Using Variational Autoencoderscited by 18
  14. 2019On Deep Set Learning and the Choice of Aggregationscited by 13
  15. 2020Attention Routing: track-assignment detailed routing using attention-based reinforcement learningcited by 11
  16. 2019Gaze Training by Modulated Dropout Improves Imitation Learningcited by 10
  17. 2019Learning to design from humans: Imitating human designers through deep learningcited by 8
  18. 2016Learning an Optimization Algorithm through Human Design Iterationscited by 3

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 2; 2024: 1.

4 papers.