mlsanityData to 7 Oct 2026

Scaling Law of Sim2Real Transfer Learning in Expanding Computational Materials Databases for Real-World Predictions

arXiv 2408.04042 ↗First posted 7 Aug 2024cond-mat.mtrl-sci cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

To address the challenge of limited experimental materials data, extensive physical property databases are being developed based on high-throughput computational experiments, such as molecular dynamics simulations. Previous studies have shown that fine-tuning a predictor pretrained on a computational database to a real system can result in models with outstanding generalization capabilities compared to learning from scratch. This study demonstrates the scaling law of simulation-to-real (Sim2Real) transfer learning for several machine learning tasks in materials science. Case studies of three prediction tasks for polymers and inorganic materials reveal that the prediction error on real systems decreases according to a power-law as the size of the computational data increases. Observing the scaling behavior offers various insights for database development, such as determining the sample size necessary to achieve a desired performance, identifying equivalent sample sizes for physical and computational experiments, and guiding the design of data production protocols for downstream real-world tasks.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 6 of its 53 references that are in the map. First posted on arXiv 7 Aug 2024.

Builds on

6 of 53 references.

References · 6

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2018Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomizationcited by 292
  3. 2015Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Viewscited by 94
  4. 2017Synthesizing Training Data for Object Detection in Indoor Scenescited by 48
  5. 2016How useful is photo-realistic rendering for visual learning?cited by 22
  6. 2021A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your Pre-training Effective?cited by 14

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.