Perspective on Utilizing Foundation Models for Laboratory Automation in Materials Research
Not on the map. Why?
Abstract (arXiv)
This review explores the potential of foundation models to advance laboratory automation in the materials and chemical sciences. It emphasizes the dual roles of these models: cognitive functions for experimental planning and data analysis, and physical functions for hardware operations. While traditional laboratory automation has relied heavily on specialized, rigid systems, foundation models offer adaptability through their general-purpose intelligence and multimodal capabilities. Recent advancements have demonstrated the feasibility of using large language models (LLMs) and multimodal robotic systems to handle complex and dynamic laboratory tasks. However, significant challenges remain, including precision manipulation of hardware, integration of multimodal data, and ensuring operational safety. This paper outlines a roadmap highlighting future directions, advocating for close interdisciplinary collaboration, benchmark establishment, and strategic human-AI integration to realize fully autonomous experimental laboratories.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 69 of its 157 references that are in the map. First posted on arXiv 14 Jun 2025.
Builds on
69 of 157 references.
References · 69
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Segment Anythingcited by 8,234
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
38 more
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2022A Generalist Agentcited by 808
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 765
- 2022Galactica: A Large Language Model for Sciencecited by 744
- 2024Large Language Models: A Surveycited by 525
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
- 2024Titans: Learning to Memorize at Test Timecited by 328
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 235
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 216
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 176
- 2024Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Lawscited by 144
- 2024ALOHA Unleashed: A Simple Recipe for Robot Dexteritycited by 134
- 2023Emergent autonomous scientific research capabilities of large language modelscited by 132
- 2024Empowering Biomedical Discovery with AI Agentscited by 118
- 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 111
- 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 104
- 2025A survey of agent interoperability protocols: Model Context Protocol (MCP), Agent Communication Protocol (ACP), Agent-to-Agent Protocol (A2A), and Agent Network Protocol (ANP)cited by 101
- 2024DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agentscited by 100
- 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 99
- 2024AgentReview: Exploring Peer Review Dynamics with LLM Agentscited by 93
- 2022DataPerf: Benchmarks for Data-Centric AI Developmentcited by 90
- 2024Recent Advances in Speech Language Models: A Surveycited by 87
- 2024ORGANA: A Robotic Assistant for Automated Chemistry Experimentation and Characterizationcited by 61
- 2024Real-World Robot Applications of Foundation Models: A Reviewcited by 61
- 2025Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learningcited by 61
- 2025Parameter-Efficient Fine-Tuning for Foundation Modelscited by 45
- 2023LLM A*: Human in the Loop Large Language Models Enabled A* Search for Roboticscited by 26
- 2023Chemist-X: Large Language Model-empowered Agent for Reaction Condition Recommendation in Chemical Synthesiscited by 25
50 most cited of 69 All 69 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.