VIRL: Volume-Informed Representation Learning towards Few-shot Manufacturability Estimation
Not on the map. Why?
Abstract (arXiv)
Designing for manufacturing poses significant challenges in part due to the computation bottleneck of Computer-Aided Manufacturing (CAM) simulations. Although deep learning as an alternative offers fast inference, its performance is dependently bounded by the need for abundant training data. Representation learning, particularly through pre-training, offers promise for few-shot learning, aiding in manufacturability tasks where data can be limited. This work introduces VIRL, a Volume-Informed Representation Learning approach to pre-train a 3D geometric encoder. The pretrained model is evaluated across four manufacturability indicators obtained from CAM simulations: subtractive machining (SM) time, additive manufacturing (AM) time, residual von Mises stress, and blade collisions during Laser Power Bed Fusion process. Across all case studies, the model pre-trained by VIRL shows substantial enhancements on demonstrating improved generalizability with limited data and superior performance with larger datasets. Regarding deployment strategy, case-specific phenomenon exists where finetuning VIRL-pretrained models adversely affects AM tasks with limited data but benefits SM time prediction. Moreover, the efficacy of Low-rank adaptation (LoRA), which balances between probing and finetuning, is explored. LoRA shows stable performance akin to probing with limited data, while achieving a higher upper bound than probing as data size increases, without the computational costs of finetuning. Furthermore, static normalization of manufacturing indicators consistently performs well across tasks, while dynamic normalization enhances performance when a reliable task dependent input is available.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 27 of its 87 references that are in the map. First posted on arXiv 18 Jun 2024.
Builds on
27 of 87 references.
References · 27
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
15 more
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2020Few-Shot Learning via Learning the Representation, Provablycited by 213
- 2019To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Taskscited by 167
- 2021BRepNet: A topological message passing system for solid modelscited by 92
- 2024Convolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Modelcited by 67
- 2020Pretrained Language Model Embryology: The Birth of ALBERTcited by 30
- 2023AdapterGNN: Parameter-Efficient Fine-Tuning Improves Generalization in GNNscited by 26
- 2018Stress Field Prediction in Cantilevered Structures Using Convolutional Neural Networkscited by 25
- 2022Self-Supervised Representation Learning for CADcited by 22
- 2020Explainable Artificial Intelligence for Manufacturing Cost Estimation and Machining Feature Visualizationcited by 15
- 2021AutoMate: A Dataset and Learning Approach for Automatic Mating of CAD Assembliescited by 13
- 2022Component Segmentation of Engineering Drawings Using Graph Convolutional Networkscited by 5
- 2023Automating Style Analysis and Visualization With Explainable AI -- Case Studies on Brand Recognitioncited by 3
- 2021Machining Cycle Time Prediction: Data-driven Modelling of Machine Tool Feedrate Behavior with Neural Networkscited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 2.
4 papers.
- 2024Topology-Agnostic Graph U-Nets for Scalar Field Prediction on Unstructured Meshescited by 2
- 2026BenDFM: A taxonomy and synthetic CAD dataset for manufacturability assessment in sheet metal bendingcited by 2
- 2025Attention to Detail: Fine-Scale Feature Preservation-Oriented Geometric Pre-training for AI-Driven Surrogate Modelingcited by 0
- 2026Kolmogorov-Arnold Networks-Based Tolerance-Aware Manufacturability Assessment Integrating Design-for-Manufacturing Principlescited by 0
- 2026BenDFM: A taxonomy and synthetic CAD dataset for manufacturability assessment in sheet metal bending13 Mar 2026
- 2026Kolmogorov-Arnold Networks-Based Tolerance-Aware Manufacturability Assessment Integrating Design-for-Manufacturing Principles9 Jan 2026
- 2025Attention to Detail: Fine-Scale Feature Preservation-Oriented Geometric Pre-training for AI-Driven Surrogate Modeling27 Apr 2025
- 2024Topology-Agnostic Graph U-Nets for Scalar Field Prediction on Unstructured Meshes8 Oct 2024