mlsanityData to 7 Oct 2026

Towards Foundation Model for Chemical Reactor Modeling: Meta-Learning with Physics-Informed Adaptation

arXiv 2405.11752 ↗First posted 20 May 2024cs.CE cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Developing accurate models for chemical reactors is often challenging due to the complexity of reaction kinetics and process dynamics. Traditional approaches require retraining models for each new system, limiting generalizability and efficiency. In this work, we take a step toward foundation models for chemical reactor modeling by introducing a neural network framework that generalizes across diverse reactor types and rapidly adapts to new chemical processes. Our approach leverages meta-learning to pretrain the model on a broad set of reactor dynamics, enabling efficient adaptation to unseen reactions with minimal data. To further enhance generalizability, we incorporate physics-informed fine-tuning, ensuring physically consistent adaptation to new reactor conditions. Our framework is evaluated across three integer-order fundamental reactor types - continuous stirred tank reactors, batch reactors, and plug flow reactors - demonstrating superior few-shot adaptation compared to conventional data-driven, physics-informed, and transfer learning approaches. By combining meta-learning with physics-informed adaptation, this work lays the foundation for a generalizable modeling framework, advancing the development of foundation models for chemical engineering applications. Source code is available at https://github.com/killingbear999/chemical-reactor-foundation-model.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 61 references that are in the map. First posted on arXiv 20 May 2024.

Builds on

29 of 61 references.

References · 29

  1. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  4. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  5. 2019A Comprehensive Survey on Transfer Learningcited by 1,154
  6. 2018On First-Order Meta-Learning Algorithmscited by 1,003
  7. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  8. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
  9. 2019Meta-Learning with Implicit Gradientscited by 523
  10. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  11. 2018Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interferencecited by 511
  12. 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 397
17 more
  1. 2018Probabilistic Model-Agnostic Meta-Learningcited by 254
  2. 2019Meta-Learning Representations for Continual Learningcited by 189
  3. 2019Adaptive Gradient-Based Meta-Learning Methodscited by 183
  4. 2019Online Meta-Learningcited by 137
  5. 2022ChemBERTa-2: Towards Chemical Foundation Modelscited by 123
  6. 2024Challenges in Training PINNs: A Loss Landscape Perspectivecited by 109
  7. 2023Multiple Physics Pretraining for Physical Surrogate Modelscited by 90
  8. 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
  9. 2021UnICORNN: A recurrent model for learning very long time dependenciescited by 56
  10. 2024Are LLMs Ready for Real-World Materials Discovery?cited by 40
  11. 2021A novel meta-learning initialization method for physics-informed neural networkscited by 35
  12. 2021A Metalearning Approach for Physics-Informed Neural Networks (PINNs): Application to Parameterized PDEscited by 31
  13. 2023nach0: Multimodal Natural and Chemical Languages Foundation Modelcited by 26
  14. 2022Meta-PDE: Learning to Solve PDEs Quickly Without a Meshcited by 18
  15. 2024Generative AI and Process Systems Engineering: The Next Frontiercited by 8
  16. 2023Real-Time Machine-Learning-Based Optimization Using Input Convex Long Short-Term Memory Networkcited by 3
  17. 2023State estimation of a carbon capture process through POD model reduction and neural network approximationcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.