mlsanityData to 14 Oct 2026

Attention to Detail: Fine-Scale Feature Preservation-Oriented Geometric Pre-training for AI-Driven Surrogate Modeling

arXiv 2504.20110 ↗First posted 27 Apr 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

AI-driven surrogate modeling has become an increasingly effective alternative to physics-based simulations for 3D design, analysis, and manufacturing. These models leverage data-driven methods to predict physical quantities traditionally requiring computationally expensive simulations. However, the scarcity of labeled CAD-to-simulation datasets has driven recent advancements in self-supervised and foundation models, where geometric representation learning is performed offline and later fine-tuned for specific downstream tasks. While these approaches have shown promise, their effectiveness is limited in applications requiring fine-scale geometric detail preservation. This work introduces a self-supervised geometric representation learning method designed to capture fine-scale geometric features from non-parametric 3D models. Unlike traditional end-to-end surrogate models, this approach decouples geometric feature extraction from downstream physics tasks, learning a latent space embedding guided by geometric reconstruction losses. Key elements include the essential use of near-zero level sampling and the innovative batch-adaptive attention-weighted loss function, which enhance the encoding of intricate design features. The proposed method is validated through case studies in structural mechanics, demonstrating strong performance in capturing design features and enabling accurate few-shot physics predictions. Comparisons with traditional parametric surrogate modeling highlight its potential to bridge the gap between geometric and physics-based representations, providing an effective solution for surrogate modeling in data-scarce scenarios.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 47 references that are in the map. First posted on arXiv 27 Apr 2025.

Builds on

18 of 47 references.

References · 18

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  5. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  6. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  7. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
  8. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
  9. 2018On the Spectral Bias of Neural Networkscited by 1,341
  10. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
  11. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
  12. 2020Frequency Bias in Neural Networks for Input of Non-Uniform Densitycited by 140
6 more
  1. 2021BRepNet: A topological message passing system for solid modelscited by 95
  2. 2022Self-Supervised Representation Learning for CADcited by 22
  3. 2020Explainable Artificial Intelligence for Manufacturing Cost Estimation and Machining Feature Visualizationcited by 15
  4. 2023Graph Neural Network Based Surrogate Model of Physics Simulations for Geometry Designcited by 5
  5. 2024VIRL: Volume-Informed Representation Learning towards Few-shot Manufacturability Estimationcited by 4
  6. 2024Topology-Agnostic Graph U-Nets for Scalar Field Prediction on Unstructured Meshescited by 2

Built on by

Not cited yet.