mlsanityData to 7 Oct 2026

Biologically Inspired Design Concept Generation Using Generative Pre-Trained Transformers

arXiv 2212.13196 ↗First posted 26 Dec 2022cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

Biological systems in nature have evolved for millions of years to adapt and survive the environment. Many features they developed can be inspirational and beneficial for solving technical problems in modern industries. This leads to a specific form of design-by-analogy called bio-inspired design (BID). Although BID as a design method has been proven beneficial, the gap between biology and engineering continuously hinders designers from effectively applying the method. Therefore, we explore the recent advance of artificial intelligence (AI) for a data-driven approach to bridge the gap. This paper proposes a generative design approach based on the generative pre-trained language model (PLM) to automatically retrieve and map biological analogy and generate BID in the form of natural language. The latest generative pre-trained transformer, namely GPT-3, is used as the base PLM. Three types of design concept generators are identified and fine-tuned from the PLM according to the looseness of the problem space representation. Machine evaluators are also fine-tuned to assess the mapping relevancy between the domains within the generated BID concepts. The approach is evaluated and then employed in a real-world project of designing light-weighted flying cars during its conceptual design phase The results show our approach can generate BID concepts with good performance.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 16 of its 61 references that are in the map. First posted on arXiv 26 Dec 2022.

Builds on

16 of 61 references.

References · 16

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  6. 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 271
  7. 2021Deep Generative Models in Engineering Design: A Reviewcited by 103
  8. 2016Re-evaluating Automatic Metrics for Image Captioningcited by 45
  9. 2021Data-Driven Design-by-Analogy: State of the Art and Future Directionscited by 18
  10. 2021Engineering Knowledge Graph from Patent Databasecited by 18
  11. 2021Generative Pre-Trained Transformer for Design Concept Generation: An Explorationcited by 17
  12. 2021Natural Language Processing in-and-for Design Researchcited by 15
4 more
  1. 2022Data-Driven Innovation: What Is Itcited by 10
  2. 2022Guiding Data-Driven Design Ideation by Knowledge Distancecited by 10
  3. 2022Generative Design Ideation: A Natural Language Generation Approachcited by 5
  4. 2022Intelligent Amphibious Ground-Aerial Vehicles: State of the Art Technology for Future Transportationcited by 5

Built on by

Cited by year

Citing papers per year: 2023: 7; 2024: 4; 2025: 2.

13 papers.

Sort:

By area: