Agentic AI for operating scientific instruments for nanoscale characterization
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Operating a scientific instrument such as an atomic force microscope (AFM) requires continuous expert decision-making. A trained user defines the experimental intent, translates it into instrument commands, assesses incoming data, adjusts imaging parameters, and post-processes the final image. Existing automation usually addresses only parts of this workflow through hard-coded routines, task-specific controllers, or trained machine-learning models. Here we present an agentic-AI framework that operates the executable part of the AFM workflow using a general-purpose, tool-augmented large language model connected to instrument functions through the Model Context Protocol (MCP). The framework consists of 3 MCP-based agents: AFM Messenger converts natural-language instructions into checked instrument commands; AFM Pilot assesses image quality through a large language model (LLM) and, if necessary, adapts imaging parameters; and AFM Doctor diagnoses image artifacts and applies transparent post-processing from a pre-approved tool set. Because the language model performs image assessment rather than a fixed scalar objective or external optimizer, the same strategy can be applied across sample types and imaging modes without specific retraining. Safe hardware operation is enforced through an ambiguity check layer before execution. Benchmarking against fine-tuned and off-the-shelf tool-using models shows that this guarded execution layer, rather than model capability alone, reduces wrong-command execution to zero. In live experiments on different samples, AFM Pilot matched expert operators in image quality, iteration count, and tuning time, with no significant difference. These results demonstrate a safe route to agentic operation of scientific instruments, where experimental intent remains human-defined while command execution, image-based tuning, and post-processing are delegated to AI agents.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 8 of its 58 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
8 of 58 references.
References · 8
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
- 2024ORGANA: A Robotic Assistant for Automated Chemistry Experimentation and Characterizationcited by 60
- 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directionscited by 46
- 2025Advancing Multi-Agent Systems Through Model Context Protocol: Architecture, Implementation, and Applicationscited by 23
- 2024Synergizing Human Expertise and AI Efficiency with Language Model for Microscopy Operation and Automated Experiment Designcited by 9
- 2024Applying Fine-Tuned LLMs for Reducing Data Needs in Load Profile Analysiscited by 2
- 2019Adaptive Scan for Atomic Force Microscopy Based on Online Optimisation: Theory and Experimentcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Autonomous Microscopy Experiments through Large Language Model Agents
- 2026EAA: Automating materials characterization with vision language model agents
- 2026Agentic self-driving microscopy benchmarks support qualification but do not necessarily generalize to unseen tasks
- 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directions
- 2026OpenQlaw: An Agentic AI Assistant for Analysis of 2D Quantum Materials
- 2025Operationalizing Serendipity: Multi-Agent AI Workflows for Enhanced Materials Characterization with Theory-in-the-Loop
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery
- 2026Agentic-J: An AI Agent for Biological Microscopy Image Analysis