mlsanityData to 14 Oct 2026

Information fusion strategy integrating pre-trained language model and contrastive learning for materials knowledge mining

arXiv 2506.12516 ↗First posted 14 Jun 2025cond-mat.mtrl-sci cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine learning has revolutionized materials design, yet predicting complex properties like alloy ductility remains challenging due to the influence of processing conditions and microstructural features that resist quantification through traditional reductionist approaches. Here, we present an innovative information fusion architecture that integrates domain-specific texts from materials science literature with quantitative physical descriptors to overcome these limitations. Our framework employs MatSciBERT for advanced textual comprehension and incorporates contrastive learning to automatically extract implicit knowledge regarding processing parameters and microstructural characteristics. Through rigorous ablation studies and comparative experiments, the model demonstrates superior performance, achieving coefficient of determination (R2) values of 0.849 and 0.680 on titanium alloy validation set and refractory multi-principal-element alloy test set. This systematic approach provides a holistic framework for property prediction in complex material systems where quantitative descriptors are incomplete and establishes a foundation for knowledge-guided materials design and informatics-driven materials discovery.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 56 references that are in the map. First posted on arXiv 14 Jun 2025.

Builds on

10 of 56 references.

References · 10

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  4. 2023Towards Accurate Differential Diagnosis with Large Language Modelscited by 116
  5. 2023Extracting Accurate Materials Data from Research Papers with Conversational Language Models and Prompt Engineeringcited by 86
  6. 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 83
  7. 2022polyBERT: A chemical language model to enable fully machine-driven ultrafast polymer informaticscited by 48
  8. 2022A general-purpose material property data extraction pipeline from large polymer corpora using Natural Language Processingcited by 22
  9. 2024Construction and Application of Materials Knowledge Graph in Multidisciplinary Materials Science via Large Language Modelcited by 15
  10. 2024Unveiling Processing--Property Relationships in Laser Powder Bed Fusion: The Synergy of Machine Learning and High-throughput Experimentscited by 3

Built on by

Not cited yet.