mlsanityData to 14 Oct 2026

ScienceBuddy: Recursive-in-Recursive Self-Improvement for Interactive Scientific Agents

arXiv 2609.17523 ↗First posted 15 Sep 2026cs.AI cs.CLcited by 7

Not on the map. Why?

Abstract (arXiv)

We introduce and release ScienceBuddy, an interactive scientific research workspace that brings continually improving scientific agents into researchers' everyday workflows. ScienceBuddy supports researchers in carrying out scientific tasks while transforming their requests, feedback, and execution evidence into tasks and evaluation rubrics for continual learning. At its core is recursive-in-recursive self-improvement, a paradigm that couples harness evolution with model reinforcement learning: the inner recursion improves the harness with the model fixed, while the outer recursion trains the model under the improved harness. Harness evolution shapes training experience, and model learning creates new opportunities for harness adaptation. We present case studies of researcher interaction, harness refinement, and model learning, with the benchmark cases spanning four scientific task families. By releasing ScienceBuddy as a research product, we make this paradigm available to the scientific community and take a step toward discovery intelligence: scientific AI that advances through sustained collaboration with researchers and evolves alongside the research it supports. Website: http://science-buddy.io

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 25 of its 28 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

25 of 28 references.

References · 25

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  5. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
  6. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
  7. 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 366
  8. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
  9. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
  10. 2024LAB-Bench: Measuring Capabilities of Language Models for Biology Researchcited by 156
  11. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 148
  12. 2026OpenClaw-RL: Train Any Agent Simply by Talkingcited by 90
13 more
  1. 2025Self-Adapting Language Modelscited by 84
  2. 2026AgentRx: Diagnosing AI Agent Failures from Execution Trajectoriescited by 60
  3. 2026Hyperagentscited by 56
  4. 2026SkillGen: Verified Inference-Time Agent Skill Synthesiscited by 36
  5. 2026RLAnything: Forge Environment, Policy, and Reward Model in Completely Dynamic RL Systemcited by 24
  6. 2026SIA: Self Improving AI with Harness & Weight Updatescited by 21
  7. 2026AdaRubric: Task-Adaptive Rubrics for Reliable LLM Agent Evaluation and Reward Learningcited by 13
  8. 2026HELIX: Model-Harness Co-evolution for Recursive Self-Improvementcited by 7
  9. 2026Adaptive Prompt Structure Factorization: A Framework for Self-Discovering and Optimizing Compositional Prompt Programscited by 5
  10. 2026Reinforcement Learning with Robust Rubric Rewardscited by 4
  11. 2026PILOT in the Loop: Live Self-Improvement for Long-Horizon Agentscited by 4
  12. 2026Fantastic Scientific Agents and How to Build Them: AgentBuild for Rietveld Refinementcited by 3
  13. 2026Environment Evolution for Terminal Agentscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ScienceClaw: Benchmarking Continual Self-Evolution of AI-for-Science Agents Across the Natural and Social Sciences
  2. 2026Recursive self-improvement of AI research agents
  3. 2026AIBuildAI-2: A Knowledge-Enhanced Agent for Automatically Building AI Models
  4. 2026SciResearcher: Scaling Deep Research Agents for Frontier Scientific Reasoning
  5. 2025AgentRxiv: Towards Collaborative Autonomous Research
  6. 2026Recursive Harness Self-Improvement
  7. 2026Learning from Research: Toward Lifelong Agent Harness Evolution
  8. 2026Aspire: Can Models Self-Evolve from Vague Goals?