mlsanityData to 14 Oct 2026

Federated Learning from Molecules to Processes: A Perspective

arXiv 2506.18525 ↗First posted 23 Jun 2025cs.LG physics.chem-phcited by 3

Not on the map. Why?

Abstract (arXiv)

We present a perspective on federated learning in chemical engineering that envisions collaborative efforts in machine learning (ML) developments within the chemical industry. Large amounts of chemical and process data are proprietary to chemical companies and are therefore locked in data silos, hindering the training of ML models on large data sets in chemical engineering. Recently, the concept of federated learning has gained increasing attention in ML research, enabling organizations to jointly train machine learning models without disclosure of their individual data. We discuss potential applications of federated learning in several fields of chemical engineering, from the molecular to the process scale. In addition, we apply federated learning in two exemplary case studies that simulate practical scenarios of multiple chemical companies holding proprietary data sets: (i) prediction of binary mixture activity coefficients with graph neural networks and (ii) system identification of a distillation column with autoencoders. Our results indicate that ML models jointly trained with federated learning yield significantly higher accuracy than models trained by each chemical company individually and can perform similarly to models trained on combined datasets from all companies. Federated learning has therefore great potential to advance ML models in chemical engineering while respecting corporate data privacy, making it promising for future industrial applications.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 85 of its 213 references that are in the map. First posted on arXiv 23 Jun 2025.

Builds on

85 of 213 references.

References · 85

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  2. 2020Scaling Laws for Neural Language Modelscited by 6,586
  3. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  4. 2019Advances and Open Problems in Federated Learningcited by 3,046
  5. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  6. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  7. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  8. 2021Scaling Vision Transformerscited by 999
  9. 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 765
  10. 2018How To Backdoor Federated Learningcited by 765
  11. 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 712
  12. 2023A decoder-only foundation model for time-series forecastingcited by 692
38 more
  1. 2017Federated Multi-Task Learningcited by 672
  2. 2020The Future of Digital Health with Federated Learningcited by 633
  3. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
  4. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
  5. 2017Deep Learning Scaling is Predictable, Empiricallycited by 582
  6. 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 568
  7. 2019Federated Learning with Personalization Layerscited by 541
  8. 2019Federated Learning with Differential Privacy: Algorithms and Performance Analysiscited by 536
  9. 2020Flower: A Friendly Federated Learning Research Frameworkcited by 455
  10. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
  11. 2018Applied Federated Learning: Improving Google Keyboard Query Suggestionscited by 204
  12. 2021FedKD: Communication Efficient Federated Learning via Knowledge Distillationcited by 187
  13. 2021Federated Learning for Smart Healthcare: A Surveycited by 184
  14. 2022Graph neural networks for materials science and chemistrycited by 182
  15. 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
  16. 2022Federated Learning with Partial Model Personalizationcited by 114
  17. 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmarkcited by 99
  18. 2023Federated Learning for Medical Image Analysis: A Surveycited by 78
  19. 2020Federated Learning for Computational Pathology on Gigapixel Whole Slide Imagescited by 54
  20. 2022Federated Graph Neural Networks: Overview, Techniques and Challengescited by 52
  21. 2021Incentive Mechanisms for Federated Learning: From Economic and Game Theoretic Perspectivecited by 47
  22. 2023Recent Advances on Federated Learning: A Systematic Surveycited by 41
  23. 2020Robust Federated Learning with Noisy Labelscited by 40
  24. 2022On the Unreasonable Effectiveness of Federated Averaging with Heterogeneous Datacited by 38
  25. 2022Cross-Silo Federated Learning: Challenges and Opportunitiescited by 38
  26. 2022Federated Learning for Medical Applications: A Taxonomy, Current Trends, Challenges, and Future Research Directionscited by 35
  27. 2018Global Deterministic Optimization with Artificial Neural Networks Embeddedcited by 33
  28. 2024Physics-Informed Neural Networks with Hard Linear Equality Constraintscited by 30
  29. 2024The Future of Large Language Model Pre-training is Federatedcited by 30
  30. 2023A Comprehensive Survey of Deep Transfer Learning for Anomaly Detection in Industrial Time Series: Methods, Applications, and Directionscited by 22
  31. 2023A Survey of What to Share in Federated Learning: Perspectives on Model Utility, Privacy Leakage, and Communication Efficiencycited by 21
  32. 2020Machine Learning in Thermodynamics: Prediction of Activity Coefficients by Matrix Completioncited by 19
  33. 2021Federated Learning of Molecular Properties with Graph Neural Networks in a Heterogeneous Settingcited by 19
  34. 2022A smile is all you need: Predicting limiting activity coefficients from SMILES with natural language processingcited by 19
  35. 2022Industry-Scale Orchestrated Federated Learning for Drug Discoverycited by 19
  36. 2022Maximizing information from chemical engineering data sets: Applications to machine learningcited by 17
  37. 2023Gibbs-Duhem-Informed Neural Networks for Binary Activity Coefficient Predictioncited by 17
  38. 2024HANNA: Hard-constraint Neural Network for Consistent Activity Coefficient Predictioncited by 17

50 most cited of 85 All 85 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.