Leveraging Chemistry Foundation Models to Facilitate Structure Focused Retrieval Augmented Generation in Multi-Agent Workflows for Catalyst and Materials Design
On the map: Retrieval-augmented generation → Medical and biomedical RAG
also in 1 more
Abstract (arXiv)
Molecular property prediction and generative design via deep learning models has been the subject of intense research given its potential to accelerate development of new, high-performance materials. More recently, these workflows have been significantly augmented with the advent of large language models (LLMs) and systems of autonomous agents capable of utilizing pre-trained models to make predictions in the context of more complex research tasks. While effective, there is still room for substantial improvement within agentic systems on the retrieval of salient information for material design tasks. Within this context, alternative uses of predictive deep learning models, such as leveraging their latent representations to facilitate cross-modal retrieval augmented generation within agentic systems for task-specific materials design, has remained unexplored. Herein, we demonstrate that large, pre-trained chemistry foundation models can serve as a basis for enabling structure-focused, semantic chemistry information retrieval for both small-molecules, complex polymeric materials, and reactions. Additionally, we show the use of chemistry foundation models in conjunction with multi-modal models such as OpenCLIP facilitate unprecedented queries and information retrieval across multiple characterization data domains. Finally, we demonstrate the integration of these models within multi-agent systems to facilitate structure and topological-based natural language queries and information retrieval for different research tasks.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Medical and biomedical RAG, one of 15 directions in Retrieval-augmented generation. Builds on 21 of its 44 references that are in the map. First posted on arXiv 21 Aug 2024.
Builds on
21 of 44 references.
References · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
- 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 225
- 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 203
- 2022A Survey on Retrieval-Augmented Text Generationcited by 157
- 2022ChemBERTa-2: Towards Chemical Foundation Modelscited by 123
- 2020Mapping the Space of Chemical Reactions Using Attention-Based Neural Networkscited by 70
9 more
- 2024ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learningcited by 63
- 2023ChatGPT Chemistry Assistant for Text Mining and Prediction of MOF Synthesiscited by 50
- 2022TransPolymer: a Transformer-based language model for polymer property predictionscited by 43
- 2024AtomAgents: Alloy design and discovery through physics-aware multi-modal multi-agent artificial intelligencecited by 36
- 2024LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillationcited by 32
- 2015Take and Took, Gaggle and Goose, Book and Read: Evaluating the Utility of Vector Differences for Lexical Relation Learningcited by 29
- 2022A graph representation of molecular ensembles for polymer property predictioncited by 20
- 2023GPT-MolBERTa: GPT Molecular Features Language Model for molecular property predictioncited by 13
- 2023Transformers and Large Language Models for Chemistry and Drug Discoverycited by 13
Built on by
Citing papers per year: 2024: 1; 2025: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Agentic Mixture-of-Workflows for Multi-Modal Chemical Search
- 2026GraphAgents: Knowledge Graph-Guided Agentic AI for Cross-Domain Materials Design
- 2023Agent-based Learning of Materials Datasets from Scientific Literature
- 2025A Survey of AI for Materials Science: Foundation Models, LLM Agents, Datasets, and Tools
- 2025Large language models in materials science and the need for open-source approaches
- 2026Towards Agentic Intelligence for Materials Science
- 2023Generative retrieval-augmented ontologic graph and multi-agent strategies for interpretive large language model-based materials design
- 2026Agentic Design of Compositional Descriptors via Autoresearch for Materials Science Applications