mlsanityData to 14 Oct 2026

Physics-Distilled Neural Network enabled by Large Language Models for Manufacturing Process-Property Predictive Modeling

arXiv 2606.11605 ↗First posted 10 Jun 2026cs.LG cs.AIcited by 0

On the map: Knowledge distillation → General knowledge distillation methods

Abstract (arXiv)

Predicting process-property relationships in manufacturing is often challenged by high experimental costs and the limited interpretability of complex 'black-box' models. This paper proposes a novel knowledge distillation framework designed to achieve high-accuracy predictions in data-scarce scenarios. The framework integrates analytical physics priors, which are systematically extracted from scientific literature via Large Language Models, into a privileged teacher model. We employ a Graph-Masked Attention layer to capture the complex physical dependencies among input variables showing strict setpoints or a combination of static and high-frequency temporal signatures. This privileged knowledge is distilled into a lightweight student predictor for inference. The feasibility and robustness of the framework are evaluated through a comprehensive experiment across five diverse manufacturing processes. To ensure statistical reliability, given the small dataset sizes, a repeated K-fold cross-validation technique is employed to quantify model stability and generalization. Results indicate that the proposed framework consistently achieves high predictive accuracy across all evaluated domains. Most importantly, the architecture demonstrates significant fault tolerance by maintaining robust predictive performance even in scenarios where LLM-derived analytical priors are suboptimal or incomplete. Furthermore, the student predictor achieves an inference frequency exceeding 6000 Hz, which facilitates real-time edge deployment on standard industrial hardware. This work provides a scalable solution for bridging the gap between theoretical physics and real-time industrial monitoring in data-limited environments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General knowledge distillation methods, one of 12 directions in Knowledge distillation. Builds on 15 of its 62 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

15 of 62 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  5. 2020Knowledge Distillation: A Surveycited by 1,603
  6. 2023Large Language Models for Information Retrieval: A Surveycited by 331
  7. 2024LLM-SR: Scientific Equation Discovery via Programming with Large Language Modelscited by 133
  8. 2024DesignQA: A Multimodal Benchmark for Evaluating Large Language Models' Understanding of Engineering Documentationcited by 32
  9. 2024AMGPT: a Large Language Model for Contextual Querying in Additive Manufacturingcited by 23
  10. 2023Learning to Extrapolate: A Transductive Approachcited by 19
  11. 2025AdditiveLLM: Large Language Models Predict Defects in Additive Manufacturingcited by 5
  12. 2023Knowledge Distillation-based Information Sharing for Online Process Monitoring in Decentralized Manufacturing Systemcited by 4
3 more
  1. 2025Large Language Models for Extrapolative Modeling of Manufacturing Processescited by 4
  2. 2025Knowledge Graph Fusion with Large Language Models for Accurate, Explainable Manufacturing Process Planningcited by 3
  3. 2026MCERF: Advancing Multimodal LLM Evaluation of Engineering Documentation with Enhanced Retrievalcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026little m: An AI Agent for Industrial Process Optimization
  2. 2025Learning Actionable World Models for Industrial Process Control
  3. 2026Domain-informed Adaptive Sampling for Generalizable PINNs in Metal Additive Manufacturing via Conditional Flow Matching
  4. 2025AutoChemSchematic AI: Agentic Physics-Aware Automation for Chemical Manufacturing Scale-Up
  5. 2025Fault Cause Identification across Manufacturing Lines through Ontology-Guided and Process-Aware FMEA Graph Learning with LLMs ↗
  6. 2025KD-PINN: Knowledge-Distilled PINNs for ultra-low-latency real-time neural PDE solvers
  7. 2025From Physics to Machine Learning and Back: Part II - Learning and Observational Bias in PHM
  8. 2025A Soft Sensor Method with Uncertainty-Awareness and Self-Explanation Based on Large Language Models Enhanced by Domain Knowledge Retrieval