Creation of Novel Soft Robot Designs using Generative AI
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Soft robotics has emerged as a promising field with the potential to revolutionize industries such as healthcare and manufacturing. However, designing effective soft robots presents challenges, particularly in managing the complex interplay of material properties, structural design, and control strategies. Traditional design methods are often time-consuming and may not yield optimal designs. In this paper, we explore the use of generative AI to create 3D models of soft actuators. We create a dataset of over 70 text-shape pairings of soft pneumatic robot actuator designs, and adapt a latent diffusion model (SDFusion) to learn the data distribution and generate novel designs from it. By employing transfer learning and data augmentation techniques, we significantly improve the performance of the diffusion model. These findings highlight the potential of generative AI in designing complex soft robotic systems, paving the way for future advancements in the field.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 11 of its 20 references that are in the map. First posted on arXiv 3 May 2024.
Builds on
11 of 20 references.
Closest ancestors · 1
Same direction, newest first
Other references · 10
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2017Neural Discrete Representation Learningcited by 4,712
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
- 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 260
- 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Natural Selection via Foundation Models for Soft Robot Evolution
- 2024A Dataset for Mechanical Mechanisms
- 2026Generative AI for material design: A mechanics perspective from burgers to matter
- 2024Mastering Contact-rich Tasks by Combining Soft and Rigid Robotics with Imitation Learning
- 2026Generalized Task-Driven Design of Soft Robots via Reduced-Order FEM-based Surrogate Modeling ↗
- 2026A Comprehensive Review of Generative Physical Artificial Intelligence
- 2024DittoGym: Learning to Control Soft Shape-Shifting Robots
- 2024Towards Interpretable Visuo-Tactile Predictive Models for Soft Robot Interactions