Biologically Inspired Design Concept Generation Using Generative Pre-Trained Transformers
Not on the map. Why?
Abstract (arXiv)
Biological systems in nature have evolved for millions of years to adapt and survive the environment. Many features they developed can be inspirational and beneficial for solving technical problems in modern industries. This leads to a specific form of design-by-analogy called bio-inspired design (BID). Although BID as a design method has been proven beneficial, the gap between biology and engineering continuously hinders designers from effectively applying the method. Therefore, we explore the recent advance of artificial intelligence (AI) for a data-driven approach to bridge the gap. This paper proposes a generative design approach based on the generative pre-trained language model (PLM) to automatically retrieve and map biological analogy and generate BID in the form of natural language. The latest generative pre-trained transformer, namely GPT-3, is used as the base PLM. Three types of design concept generators are identified and fine-tuned from the PLM according to the looseness of the problem space representation. Machine evaluators are also fine-tuned to assess the mapping relevancy between the domains within the generated BID concepts. The approach is evaluated and then employed in a real-world project of designing light-weighted flying cars during its conceptual design phase The results show our approach can generate BID concepts with good performance.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 16 of its 61 references that are in the map. First posted on arXiv 26 Dec 2022.
Builds on
16 of 61 references.
References · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 271
- 2021Deep Generative Models in Engineering Design: A Reviewcited by 103
- 2016Re-evaluating Automatic Metrics for Image Captioningcited by 45
- 2021Data-Driven Design-by-Analogy: State of the Art and Future Directionscited by 18
- 2021Engineering Knowledge Graph from Patent Databasecited by 18
- 2021Generative Pre-Trained Transformer for Design Concept Generation: An Explorationcited by 17
- 2021Natural Language Processing in-and-for Design Researchcited by 15
4 more
- 2022Data-Driven Innovation: What Is Itcited by 10
- 2022Guiding Data-Driven Design Ideation by Knowledge Distancecited by 10
- 2022Generative Design Ideation: A Natural Language Generation Approachcited by 5
- 2022Intelligent Amphibious Ground-Aerial Vehicles: State of the Art Technology for Future Transportationcited by 5
Built on by
Citing papers per year: 2023: 7; 2024: 4; 2025: 2.
13 papers.
Sort:
By area:
- 2023Multi-modal Machine Learning in Engineering Design: A Review and Future Directionscited by 27
- 2023Fluid Transformers and Creative Analogies: Exploring Large Language Models' Capacity for Augmenting Cross-Domain Analogical Creativitycited by 23
- 2023Conceptual Design Generation Using Large Language Modelscited by 13
- 2024AutoTRIZ: Automating Engineering Innovation with TRIZ and Large Language Modelscited by 8
- 2023Toward Artificial Empathy for Human-Centered Design: A Frameworkcited by 6
- 2023Opportunities for Large Language Models and Discourse in Engineering Designcited by 6
- 2023Elucidating STEM Concepts through Generative AI: A Multi-modal Exploration of Analogical Reasoningcited by 3
- 2024Inspired by AI? A Novel Generative AI System To Assist Conceptual Automotive Designcited by 3
- 2023The Innovation Paradox: Concept Space Expansion with Diminishing Originality and the Promise of Creative AIcited by 2
- 2024Exploring the Capabilities of Large Language Models for Generating Diverse Design Solutionscited by 2
- 2025Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Modelscited by 2
- 2024Bridging Design Gaps: A Parametric Data Completion Approach With Graph Guided Diffusion Modelscited by 1
1 more
- 2025Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Models6 Sep 2025
- 2025Intelligent Design 4.0: Paradigm Evolution Toward the Agentic AI Era11 Jun 2025
- 2024Bridging Design Gaps: A Parametric Data Completion Approach With Graph Guided Diffusion Models17 Jun 2024
- 2024Inspired by AI? A Novel Generative AI System To Assist Conceptual Automotive Design6 Jun 2024
- 2024Exploring the Capabilities of Large Language Models for Generating Diverse Design Solutions2 May 2024
- 2024AutoTRIZ: Automating Engineering Innovation with TRIZ and Large Language Models13 Mar 2024
- 2023Elucidating STEM Concepts through Generative AI: A Multi-modal Exploration of Analogical Reasoning21 Aug 2023
- 2023Opportunities for Large Language Models and Discourse in Engineering Design15 Jun 2023
- 2023Conceptual Design Generation Using Large Language Models30 May 2023
- 2023The Innovation Paradox: Concept Space Expansion with Diminishing Originality and the Promise of Creative AI23 Mar 2023
- 2023Toward Artificial Empathy for Human-Centered Design: A Framework19 Mar 2023
- 2023Fluid Transformers and Creative Analogies: Exploring Large Language Models' Capacity for Augmenting Cross-Domain Analogical Creativity27 Feb 2023
1 more
- 2023Multi-modal Machine Learning in Engineering Design: A Review and Future Directionscited by 27
- 2023Conceptual Design Generation Using Large Language Modelscited by 13
- 2024AutoTRIZ: Automating Engineering Innovation with TRIZ and Large Language Modelscited by 8
- 2023Toward Artificial Empathy for Human-Centered Design: A Frameworkcited by 6
- 2023Opportunities for Large Language Models and Discourse in Engineering Designcited by 6
- 2024Inspired by AI? A Novel Generative AI System To Assist Conceptual Automotive Designcited by 3
- 2023The Innovation Paradox: Concept Space Expansion with Diminishing Originality and the Promise of Creative AIcited by 2
- 2024Exploring the Capabilities of Large Language Models for Generating Diverse Design Solutionscited by 2
- 2025Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Modelscited by 2
- 2025Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Models6 Sep 2025
- 2024Inspired by AI? A Novel Generative AI System To Assist Conceptual Automotive Design6 Jun 2024
- 2024Exploring the Capabilities of Large Language Models for Generating Diverse Design Solutions2 May 2024
- 2024AutoTRIZ: Automating Engineering Innovation with TRIZ and Large Language Models13 Mar 2024
- 2023Opportunities for Large Language Models and Discourse in Engineering Design15 Jun 2023
- 2023Conceptual Design Generation Using Large Language Models30 May 2023
- 2023The Innovation Paradox: Concept Space Expansion with Diminishing Originality and the Promise of Creative AI23 Mar 2023
- 2023Toward Artificial Empathy for Human-Centered Design: A Framework19 Mar 2023
- 2023Multi-modal Machine Learning in Engineering Design: A Review and Future Directions14 Feb 2023