MDForge: Agentic Molecular Dynamics Pipeline Design under Sparse Simulator Feedback
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Molecular dynamics (MD) is the canonical in-silico method for atomistic molecular science, simulating molecular behavior from first-principle physics. Designing an MD pipeline for a new system requires substantial expert knowledge: running it on even one molecule is expensive, ruling out trial-and-error. We automate this expert pipeline-design process with an LLM agent. Unlike existing MD agents that orchestrate a predefined tool set, we treat pipeline design as open-ended code generation in which the agent's behavior is reshaped online by verbal reward. Specifically, we build MDForge, an LLM agent whose in-context update rule densifies the sparse reward via a multi-agent debate among physics experts. On three SAMPL host-guest binding free-energy benchmarks, MDForge automatically designs MD pipelines competitive with human experts. Deployed on a library of unseen candidate guests, its CB[7] pipeline discovers a novel binder that wet-lab competition NMR confirms is a high-affinity, picomolar CB[7] binder. Our data and code are available at https://github.com/Zehong-Wang/MDForge.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 60 of its 111 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
60 of 111 references.
Closest ancestors · 1
Same direction, newest first
- 2026QUASAR: A Universal Autonomous System for Atomistic Simulation and a Benchmark of Its Capabilities30 Jan
Other references · 59
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2023Let's Verify Step by Stepcited by 3,789
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
38 more
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,194
- 2017Hindsight Experience Replaycited by 1,136
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2018Exploration by Random Network Distillationcited by 993
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
- 2021Linear Transformers Are Secretly Fast Weight Programmerscited by 502
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 441
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
- 2025The Lessons of Developing Process Reward Models in Mathematical Reasoningcited by 415
- 2019Analyzing Learned Molecular Representations for Property Predictioncited by 375
- 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 344
- 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 337
- 2024ProcessBench: Identifying Process Errors in Mathematical Reasoningcited by 292
- 2020Machine Learning Force Fieldscited by 207
- 2018RUDDER: Return Decomposition for Delayed Rewardscited by 173
- 2016Using Fast Weights to Attend to the Recent Pastcited by 170
- 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecyclecited by 137
- 2025Process Reward Models That Thinkcited by 118
- 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoMLcited by 87
- 2024AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learningcited by 61
- 2025Contextual Experience Replay for Self-Improvement of Language Agentscited by 48
- 2023BioPlanner: Automatic Evaluation of LLMs on Protocol Planning in Biologycited by 43
- 2025AutoData: A Multi-Agent System for Open Web Data Collectioncited by 25
- 2026Why Reasoning Fails to Plan: A Planning-Centric Analysis of Long-Horizon Decision Making in LLM Agentscited by 23
- 2025Language Models Can Learn from Verbal Feedback Without Scalar Rewardscited by 18
- 2026Toward Autonomous Long-Horizon Engineering for ML Researchcited by 17
- 2025LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet?cited by 14
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025MDCrow: Automating Molecular Dynamics Workflows with Large Language Models
- 2026MDGYM: Benchmarking AI Agents on Molecular Simulations
- 2026Molecular LLM Agents: From Architectural Design to Scientific Autonomy
- 2026MDArena: Evaluating Coding Agents on Realistic Molecular Dynamics Workflows
- 2025DynaMate: An Autonomous Agent for Protein-Ligand Molecular Dynamics Simulations
- 2026Agent-MD: Selective LLM Intervention with Event-Driven Escalation for Stateful GCMC--MD Campaigns
- 2026MARCO: Multi-Round Agentic Reinforcement for Conditional Molecular Optimization
- 2025MT-Mol:Multi Agent System with Tool-based Reasoning for Molecular Optimization