Federated Learning from Molecules to Processes: A Perspective
Not on the map. Why?
Abstract (arXiv)
We present a perspective on federated learning in chemical engineering that envisions collaborative efforts in machine learning (ML) developments within the chemical industry. Large amounts of chemical and process data are proprietary to chemical companies and are therefore locked in data silos, hindering the training of ML models on large data sets in chemical engineering. Recently, the concept of federated learning has gained increasing attention in ML research, enabling organizations to jointly train machine learning models without disclosure of their individual data. We discuss potential applications of federated learning in several fields of chemical engineering, from the molecular to the process scale. In addition, we apply federated learning in two exemplary case studies that simulate practical scenarios of multiple chemical companies holding proprietary data sets: (i) prediction of binary mixture activity coefficients with graph neural networks and (ii) system identification of a distillation column with autoencoders. Our results indicate that ML models jointly trained with federated learning yield significantly higher accuracy than models trained by each chemical company individually and can perform similarly to models trained on combined datasets from all companies. Federated learning has therefore great potential to advance ML models in chemical engineering while respecting corporate data privacy, making it promising for future industrial applications.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 85 of its 213 references that are in the map. First posted on arXiv 23 Jun 2025.
Builds on
85 of 213 references.
References · 85
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
- 2021Scaling Vision Transformerscited by 999
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 765
- 2018How To Backdoor Federated Learningcited by 765
- 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 712
- 2023A decoder-only foundation model for time-series forecastingcited by 692
38 more
- 2017Federated Multi-Task Learningcited by 672
- 2020The Future of Digital Health with Federated Learningcited by 633
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
- 2017Deep Learning Scaling is Predictable, Empiricallycited by 582
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 568
- 2019Federated Learning with Personalization Layerscited by 541
- 2019Federated Learning with Differential Privacy: Algorithms and Performance Analysiscited by 536
- 2020Flower: A Friendly Federated Learning Research Frameworkcited by 455
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
- 2018Applied Federated Learning: Improving Google Keyboard Query Suggestionscited by 204
- 2021FedKD: Communication Efficient Federated Learning via Knowledge Distillationcited by 187
- 2021Federated Learning for Smart Healthcare: A Surveycited by 184
- 2022Graph neural networks for materials science and chemistrycited by 182
- 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
- 2022Federated Learning with Partial Model Personalizationcited by 114
- 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmarkcited by 99
- 2023Federated Learning for Medical Image Analysis: A Surveycited by 78
- 2020Federated Learning for Computational Pathology on Gigapixel Whole Slide Imagescited by 54
- 2022Federated Graph Neural Networks: Overview, Techniques and Challengescited by 52
- 2021Incentive Mechanisms for Federated Learning: From Economic and Game Theoretic Perspectivecited by 47
- 2023Recent Advances on Federated Learning: A Systematic Surveycited by 41
- 2020Robust Federated Learning with Noisy Labelscited by 40
- 2022On the Unreasonable Effectiveness of Federated Averaging with Heterogeneous Datacited by 38
- 2022Cross-Silo Federated Learning: Challenges and Opportunitiescited by 38
- 2022Federated Learning for Medical Applications: A Taxonomy, Current Trends, Challenges, and Future Research Directionscited by 35
- 2018Global Deterministic Optimization with Artificial Neural Networks Embeddedcited by 33
- 2024Physics-Informed Neural Networks with Hard Linear Equality Constraintscited by 30
- 2024The Future of Large Language Model Pre-training is Federatedcited by 30
- 2023A Comprehensive Survey of Deep Transfer Learning for Anomaly Detection in Industrial Time Series: Methods, Applications, and Directionscited by 22
- 2023A Survey of What to Share in Federated Learning: Perspectives on Model Utility, Privacy Leakage, and Communication Efficiencycited by 21
- 2020Machine Learning in Thermodynamics: Prediction of Activity Coefficients by Matrix Completioncited by 19
- 2021Federated Learning of Molecular Properties with Graph Neural Networks in a Heterogeneous Settingcited by 19
- 2022A smile is all you need: Predicting limiting activity coefficients from SMILES with natural language processingcited by 19
- 2022Industry-Scale Orchestrated Federated Learning for Drug Discoverycited by 19
- 2022Maximizing information from chemical engineering data sets: Applications to machine learningcited by 17
- 2023Gibbs-Duhem-Informed Neural Networks for Binary Activity Coefficient Predictioncited by 17
- 2024HANNA: Hard-constraint Neural Network for Consistent Activity Coefficient Predictioncited by 17
50 most cited of 85 All 85 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025Molecular Machine Learning in Chemical Process Designcited by 5
- 2025Dynamic Graph Neural Networks for Physiological Based Pharmacokinetic Modeling: A Novel Data Driven Approach to Drug Concentration Predictioncited by 0
- 2026Privacy-Preserving Federated Learning Framework for Distributed Chemical Process Optimizationcited by 0
- 2026Privacy-Preserving Federated Learning Framework for Distributed Chemical Process Optimization28 Apr 2026
- 2025Dynamic Graph Neural Networks for Physiological Based Pharmacokinetic Modeling: A Novel Data Driven Approach to Drug Concentration Prediction25 Oct 2025
- 2025Molecular Machine Learning in Chemical Process Design28 Aug 2025