mlsanityData to 7 Oct 2026

BaT: Towards Self-Evolving Medical Research Agent with Stage Rubrics

arXiv 2608.16211 ↗First posted 17 Aug 2026cs.AIcited by 0

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Long-horizon agents are beginning to automate complete workflows that produce code, reports, and research artifacts. Medical imaging workflows are multi-stage and data-sensitive, while expert trajectories remain scarce and difficult to share. Structured benchmarks can localize failures through stage-level rubrics, but standard post-training discards these diagnostics before the next training round. We present Benchmark-as-Teacher (BaT), a recursive self-improvement system for agent post-training. BaT contains two linked components: the asynchronous Stage Bank data pipeline and BiCuRL (Bilevel Curriculum Reinforcement Learning), its self-improving post-training method. Stage Bank synthesizes content-isolated training states outside the policy-update loop. BiCuRL uses a fixed held-out evaluation to select the next stage curriculum, verifies rollouts with task rubrics, updates the policy with GRPO, and returns the candidate checkpoint to evaluation. On AutoMedBench-Lite, BaT-4B and BaT-9B more than double the Overall scores of their Qwen Instruct baselines. BaT-9B Agent reaches 79.6 Overall, exceeding Claude Opus 4.6 with Claude Code at 77.5.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 30 of its 45 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

30 of 45 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026HealthAgentBench: A Unified Benchmark Suite of Realistic Agentic Healthcare Environments for Challenging Frontier AI Agents30 Jun
  2. 2026AutoMedBench: Towards Medical AutoResearch with Agentic AI Models1 Jun
  3. 2026ClinSeekAgent: Automating Multimodal Evidence Seeking for Agentic Clinical Reasoning19 May
  4. 2026Meissa: Multi-modal Medical Agentic Intelligence9 Mar
  5. 2025MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agents24 Jan

Other references · 25

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  7. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  8. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  9. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
  10. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  11. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  12. 2024Self-Rewarding Language Modelscited by 654
13 more
  1. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  2. 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 552
  3. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  4. 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
  5. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
  6. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 212
  7. 2026Gemma 4 Technical Reportcited by 187
  8. 2025Generalizing Verifiable Instruction Followingcited by 178
  9. 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 123
  10. 2025Agent Lightning: Train ANY AI Agents with Reinforcement Learningcited by 94
  11. 2025Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoningcited by 85
  12. 2026Frontis-MA1: Training an AI4AI Model towards Recursive Self-Improvement in Machine Learning Engineeringcited by 7
  13. 2026Agentic-DPO: From Imitation to Agentic Policy Optimization on Expert Trajectoriescited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MedRSI: Recursive Self-Improvement for Medical Agents via Clinically Aligned Self-Evolution
  2. 2026Can Coding Agents Build Robust Baselines? A Skill-Based Approach for Automating the Medical Imaging Model-Development Pipeline
  3. 2026RSIBench-Data: Benchmarking Data-Centric Research for Recursive Self-Improvement
  4. 2026From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning
  5. 2025STELLA: Self-Evolving LLM Agent for Biomedical Research
  6. 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness
  7. 2025Learning to Be A Doctor: Searching for Effective Medical Agent Architectures
  8. 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy