Opportunities for Retrieval and Tool Augmented Large Language Models in Scientific Facilities
Not on the map. Why?
Abstract (arXiv)
Upgrades to advanced scientific user facilities such as next-generation x-ray light sources, nanoscience centers, and neutron facilities are revolutionizing our understanding of materials across the spectrum of the physical sciences, from life sciences to microelectronics. However, these facility and instrument upgrades come with a significant increase in complexity. Driven by more exacting scientific needs, instruments and experiments become more intricate each year. This increased operational complexity makes it ever more challenging for domain scientists to design experiments that effectively leverage the capabilities of and operate on these advanced instruments. Large language models (LLMs) can perform complex information retrieval, assist in knowledge-intensive tasks across applications, and provide guidance on tool usage. Using x-ray light sources, leadership computing, and nanoscience centers as representative examples, we describe preliminary experiments with a Context-Aware Language Model for Science (CALMS) to assist scientists with instrument operations and complex experimentation. With the ability to retrieve relevant information from facility documentation, CALMS can answer simple questions on scientific capabilities and other operational procedures. With the ability to interface with software tools and experimental hardware, CALMS can conversationally operate scientific instruments. By making information more accessible and acting on user needs, LLMs could expand and diversify scientific facilities' users and accelerate scientific output.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Dec 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 1; 2024: 7; 2025: 16; 2026: 3.
27 papers.
Sort:
By area:
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
- 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 96
- 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directionscited by 74
- 2024Feedback-Guided Extraction of Knowledge Base from Retrieval-Augmented LLM Applicationscited by 36
- 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoningcited by 33
- 2025One Shot Dominance: Knowledge Poisoning Attack on Retrieval-Augmented Generation Systemscited by 28
- 2025Hyper-RAG: Combating LLM Hallucinations using Hypergraph-Driven Retrieval-Augmented Generationcited by 23
- 2025MDCrow: Automating Molecular Dynamics Workflows with Large Language Modelscited by 22
- 2024MeMemo: On-device Retrieval Augmentation for Private and Personalized Text Generationcited by 12
- 2024VISION: A Modular AI Assistant for Natural Human-Instrument Interaction at Scientific User Facilitiescited by 10
- 2025From Screens to Scenes: A Survey of Embodied AI in Healthcarecited by 10
- 2025Keyword search is all you need: Achieving RAG-Level Performance without vector databases using agentic tool usecited by 10
15 more
- 2024MetaScientist: A Human-AI Synergistic Framework for Automated Mechanical Metamaterial Designcited by 8
- 2025Generative AI Uses and Risks for Knowledge Workers in a Science Organizationcited by 5
- 2025CtrlRAG: Black-box Document Poisoning Attacks for Retrieval-Augmented Generation of Large Language Modelscited by 5
- 2025FIRST: Federated Inference Resource Scheduling Toolkit for Scientific AI Model Accesscited by 5
- 2025VASP Agent: An Agentic Framework for Autonomous First-principles Calculationscited by 4
- 2024Towards a Science Exocortexcited by 3
- 2023Virtual Scientific Companion for Synchrotron Beamlines: A Prototypecited by 2
- 2025Towards an automated workflow in materials science for combining multi-modal simulative and experimental information using data mining and large language modelscited by 2
- 2025GRETEL: A Goal-driven Retrieval and Execution-based Trial Framework for LLM Tool Selection Enhancingcited by 2
- 2025Active Inference AI Systems for Scientific Discoverycited by 1
- 2026EAA: Automating materials characterization with vision language model agentscited by 1
- 2025Missing vs. Unused Knowledge Hypothesis for Language Model Bottlenecks in Patent Understandingcited by 0
- 2025Language-Native Materials Processing Design by Lightly Structured Text Database and Reasoning Large Language Modelcited by 0
- 2026HPC-LLM: Practical Domain Adaptation and Retrieval-Augmented Generation for HPC Supportcited by 0
- 2026A corrective agentic hybrid RAG and an operations-grounded evaluation for a scientific facilitycited by 0
- 2026A corrective agentic hybrid RAG and an operations-grounded evaluation for a scientific facility27 Jul 2026
- 2026HPC-LLM: Practical Domain Adaptation and Retrieval-Augmented Generation for HPC Support8 May 2026
- 2026EAA: Automating materials characterization with vision language model agents17 Feb 2026
- 2025VASP Agent: An Agentic Framework for Autonomous First-principles Calculations22 Dec 2025
- 2025Keyword search is all you need: Achieving RAG-Level Performance without vector databases using agentic tool use19 Dec 2025
- 2025FIRST: Federated Inference Resource Scheduling Toolkit for Scientific AI Model Access15 Oct 2025
- 2025GRETEL: A Goal-driven Retrieval and Execution-based Trial Framework for LLM Tool Selection Enhancing10 Oct 2025
- 2025Language-Native Materials Processing Design by Lightly Structured Text Database and Reasoning Large Language Model7 Sep 2025
- 2025Active Inference AI Systems for Scientific Discovery26 Jun 2025
- 2025Missing vs. Unused Knowledge Hypothesis for Language Model Bottlenecks in Patent Understanding18 May 2025
- 2025One Shot Dominance: Knowledge Poisoning Attack on Retrieval-Augmented Generation Systems15 May 2025
- 2025Hyper-RAG: Combating LLM Hallucinations using Hypergraph-Driven Retrieval-Augmented Generation30 Mar 2025
15 more
- 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directions12 Mar 2025
- 2025CtrlRAG: Black-box Document Poisoning Attacks for Retrieval-Augmented Generation of Large Language Models10 Mar 2025
- 2025Towards an automated workflow in materials science for combining multi-modal simulative and experimental information using data mining and large language models18 Feb 2025
- 2025MDCrow: Automating Molecular Dynamics Workflows with Large Language Models13 Feb 2025
- 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning5 Feb 2025
- 2025Generative AI Uses and Risks for Knowledge Workers in a Science Organization27 Jan 2025
- 2025From Screens to Scenes: A Survey of Embodied AI in Healthcare13 Jan 2025
- 2024VISION: A Modular AI Assistant for Natural Human-Instrument Interaction at Scientific User Facilities24 Dec 2024
- 2024MetaScientist: A Human-AI Synergistic Framework for Automated Mechanical Metamaterial Design20 Dec 2024
- 2024Feedback-Guided Extraction of Knowledge Base from Retrieval-Augmented LLM Applications21 Nov 2024
- 2024MeMemo: On-device Retrieval Augmentation for Private and Personalized Text Generation2 Jul 2024
- 2024A Review of Large Language Models and Autonomous Agents in Chemistry26 Jun 2024
- 2024Towards a Science Exocortex24 Jun 2024
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models12 Feb 2024
- 2023Virtual Scientific Companion for Synchrotron Beamlines: A Prototype28 Dec 2023
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
- 2024Feedback-Guided Extraction of Knowledge Base from Retrieval-Augmented LLM Applicationscited by 36
- 2025One Shot Dominance: Knowledge Poisoning Attack on Retrieval-Augmented Generation Systemscited by 28
- 2025Hyper-RAG: Combating LLM Hallucinations using Hypergraph-Driven Retrieval-Augmented Generationcited by 23
- 2024MeMemo: On-device Retrieval Augmentation for Private and Personalized Text Generationcited by 12
- 2025Keyword search is all you need: Achieving RAG-Level Performance without vector databases using agentic tool usecited by 10
- 2025CtrlRAG: Black-box Document Poisoning Attacks for Retrieval-Augmented Generation of Large Language Modelscited by 5
- 2026HPC-LLM: Practical Domain Adaptation and Retrieval-Augmented Generation for HPC Supportcited by 0
- 2026A corrective agentic hybrid RAG and an operations-grounded evaluation for a scientific facilitycited by 0
- 2026A corrective agentic hybrid RAG and an operations-grounded evaluation for a scientific facility27 Jul 2026
- 2026HPC-LLM: Practical Domain Adaptation and Retrieval-Augmented Generation for HPC Support8 May 2026
- 2025Keyword search is all you need: Achieving RAG-Level Performance without vector databases using agentic tool use19 Dec 2025
- 2025One Shot Dominance: Knowledge Poisoning Attack on Retrieval-Augmented Generation Systems15 May 2025
- 2025Hyper-RAG: Combating LLM Hallucinations using Hypergraph-Driven Retrieval-Augmented Generation30 Mar 2025
- 2025CtrlRAG: Black-box Document Poisoning Attacks for Retrieval-Augmented Generation of Large Language Models10 Mar 2025
- 2024Feedback-Guided Extraction of Knowledge Base from Retrieval-Augmented LLM Applications21 Nov 2024
- 2024MeMemo: On-device Retrieval Augmentation for Private and Personalized Text Generation2 Jul 2024
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models12 Feb 2024
- 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 96
- 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directionscited by 74
- 2025VASP Agent: An Agentic Framework for Autonomous First-principles Calculationscited by 4
- 2026EAA: Automating materials characterization with vision language model agentscited by 1
- 2026EAA: Automating materials characterization with vision language model agents17 Feb 2026
- 2025VASP Agent: An Agentic Framework for Autonomous First-principles Calculations22 Dec 2025
- 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directions12 Mar 2025
- 2024A Review of Large Language Models and Autonomous Agents in Chemistry26 Jun 2024
- 2025MDCrow: Automating Molecular Dynamics Workflows with Large Language Modelscited by 22
- 2024VISION: A Modular AI Assistant for Natural Human-Instrument Interaction at Scientific User Facilitiescited by 10
- 2025From Screens to Scenes: A Survey of Embodied AI in Healthcarecited by 10
- 2024MetaScientist: A Human-AI Synergistic Framework for Automated Mechanical Metamaterial Designcited by 8
- 2025Generative AI Uses and Risks for Knowledge Workers in a Science Organizationcited by 5
- 2025FIRST: Federated Inference Resource Scheduling Toolkit for Scientific AI Model Accesscited by 5
- 2024Towards a Science Exocortexcited by 3
- 2023Virtual Scientific Companion for Synchrotron Beamlines: A Prototypecited by 2
- 2025Towards an automated workflow in materials science for combining multi-modal simulative and experimental information using data mining and large language modelscited by 2
- 2025GRETEL: A Goal-driven Retrieval and Execution-based Trial Framework for LLM Tool Selection Enhancingcited by 2
- 2025Active Inference AI Systems for Scientific Discoverycited by 1
- 2025Missing vs. Unused Knowledge Hypothesis for Language Model Bottlenecks in Patent Understandingcited by 0
- 2025FIRST: Federated Inference Resource Scheduling Toolkit for Scientific AI Model Access15 Oct 2025
- 2025GRETEL: A Goal-driven Retrieval and Execution-based Trial Framework for LLM Tool Selection Enhancing10 Oct 2025
- 2025Active Inference AI Systems for Scientific Discovery26 Jun 2025
- 2025Missing vs. Unused Knowledge Hypothesis for Language Model Bottlenecks in Patent Understanding18 May 2025
- 2025Towards an automated workflow in materials science for combining multi-modal simulative and experimental information using data mining and large language models18 Feb 2025
- 2025MDCrow: Automating Molecular Dynamics Workflows with Large Language Models13 Feb 2025
- 2025Generative AI Uses and Risks for Knowledge Workers in a Science Organization27 Jan 2025
- 2025From Screens to Scenes: A Survey of Embodied AI in Healthcare13 Jan 2025
- 2024VISION: A Modular AI Assistant for Natural Human-Instrument Interaction at Scientific User Facilities24 Dec 2024
- 2024MetaScientist: A Human-AI Synergistic Framework for Automated Mechanical Metamaterial Design20 Dec 2024
- 2024Towards a Science Exocortex24 Jun 2024
- 2023Virtual Scientific Companion for Synchrotron Beamlines: A Prototype28 Dec 2023