mlsanityData to 7 Oct 2026

SelfAI: A self-directed framework for long-horizon scientific discovery

arXiv 2512.00403 ↗First posted 29 Nov 2025cs.LG cs.AI cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Scientific discovery increasingly entails long-horizon exploration of complex hypothesis spaces, yet most existing approaches emphasize final performance while offering limited insight into how scientific exploration unfolds over time, particularly balancing efficiency-diversity trade-offs and supporting reproducible, human-in-the-loop discovery workflows. We introduce SelfAI, a self-directed, multi-agent-enabled discovery system that automates scientific exploration as a strategic, trajectory-driven decision-making process. SelfAI translates high-level research intent into executable experiments, reasons over accumulated experimental trajectories to guide subsequent exploration, and applies adaptive stopping decisions to terminate unproductive search paths within a closed-loop workflow governed by explicit efficiency-diversity trade-offs. Evaluated using real-world experiments spanning domains from machine learning to drug discovery, SelfAI consistently discovers high-quality solutions with substantially fewer redundant trials than classical optimization and recent LLM-based baselines. The proposed methods establish a general framework for organizing long-horizon scientific discovery and adaptive decision-making in complex scientific and engineering systems.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 31 of its 67 references that are in the map. First posted on arXiv 29 Nov 2025.

Builds on

31 of 67 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  6. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  7. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  8. 2023Qwen Technical Reportcited by 3,273
  9. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  10. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  11. 2022Towards Reasoning in Large Language Models: A Surveycited by 593
  12. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 429
19 more
  1. 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
  2. 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
  3. 2025Accelerating scientific discovery with Co-Scientistcited by 353
  4. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
  5. 2024nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentationcited by 235
  6. 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
  7. 2023MedNeXt: Transformer-driven Scaling of ConvNets for Medical Image Segmentationcited by 161
  8. 2021GraphSMOTE: Imbalanced Node Classification on Graphs with Graph Neural Networkscited by 147
  9. 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 146
  10. 2025MLGym: A New Framework and Benchmark for Advancing AI Research Agentscited by 111
  11. 2023Extracting Accurate Materials Data from Research Papers with Conversational Language Models and Prompt Engineeringcited by 86
  12. 2020Molecular graph generation with Graph Neural Networkscited by 79
  13. 2025AI Research Agents for Machine Learning: Search, Exploration, and Generalization in MLE-benchcited by 65
  14. 2024Probing the limitations of multimodal language models for chemistry and materials researchcited by 31
  15. 2025Optuna vs Code Llama: Are LLMs a New Paradigm for Hyperparameter Tuning?cited by 21
  16. 2024Lossless data compression by large modelscited by 20
  17. 2025A multi-agentic framework for real-time, autonomous freeform metasurface designcited by 14
  18. 2025AgenticSciML: Collaborative Multi-Agent Systems for Emergent Discovery in Scientific Machine Learningcited by 13
  19. 2024Large Language Models for Human-Machine Collaborative Particle Accelerator Tuning through Natural Languagecited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.