mlsanityData to 7 Oct 2026

VIRL: Volume-Informed Representation Learning towards Few-shot Manufacturability Estimation

arXiv 2406.12286 ↗First posted 18 Jun 2024cs.LG cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Designing for manufacturing poses significant challenges in part due to the computation bottleneck of Computer-Aided Manufacturing (CAM) simulations. Although deep learning as an alternative offers fast inference, its performance is dependently bounded by the need for abundant training data. Representation learning, particularly through pre-training, offers promise for few-shot learning, aiding in manufacturability tasks where data can be limited. This work introduces VIRL, a Volume-Informed Representation Learning approach to pre-train a 3D geometric encoder. The pretrained model is evaluated across four manufacturability indicators obtained from CAM simulations: subtractive machining (SM) time, additive manufacturing (AM) time, residual von Mises stress, and blade collisions during Laser Power Bed Fusion process. Across all case studies, the model pre-trained by VIRL shows substantial enhancements on demonstrating improved generalizability with limited data and superior performance with larger datasets. Regarding deployment strategy, case-specific phenomenon exists where finetuning VIRL-pretrained models adversely affects AM tasks with limited data but benefits SM time prediction. Moreover, the efficacy of Low-rank adaptation (LoRA), which balances between probing and finetuning, is explored. LoRA shows stable performance akin to probing with limited data, while achieving a higher upper bound than probing as data size increases, without the computational costs of finetuning. Furthermore, static normalization of manufacturing indicators consistently performs well across tasks, while dynamic normalization enhances performance when a reliable task dependent input is available.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 27 of its 87 references that are in the map. First posted on arXiv 18 Jun 2024.

Builds on

27 of 87 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  7. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  8. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  9. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  10. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  11. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  12. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
15 more
  1. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
  2. 2021Graph Self-Supervised Learning: A Surveycited by 289
  3. 2020Few-Shot Learning via Learning the Representation, Provablycited by 213
  4. 2019To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Taskscited by 167
  5. 2021BRepNet: A topological message passing system for solid modelscited by 92
  6. 2024Convolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Modelcited by 67
  7. 2020Pretrained Language Model Embryology: The Birth of ALBERTcited by 30
  8. 2023AdapterGNN: Parameter-Efficient Fine-Tuning Improves Generalization in GNNscited by 26
  9. 2018Stress Field Prediction in Cantilevered Structures Using Convolutional Neural Networkscited by 25
  10. 2022Self-Supervised Representation Learning for CADcited by 22
  11. 2020Explainable Artificial Intelligence for Manufacturing Cost Estimation and Machining Feature Visualizationcited by 15
  12. 2021AutoMate: A Dataset and Learning Approach for Automatic Mating of CAD Assembliescited by 13
  13. 2022Component Segmentation of Engineering Drawings Using Graph Convolutional Networkscited by 5
  14. 2023Automating Style Analysis and Visualization With Explainable AI -- Case Studies on Brand Recognitioncited by 3
  15. 2021Machining Cycle Time Prediction: Data-driven Modelling of Machine Tool Feedrate Behavior with Neural Networkscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 2.

4 papers.