mlsanityData to 14 Oct 2026

ASI-Evolve: AI Accelerates AI

arXiv 2603.29640 ↗First posted 31 Mar 2026cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Can AI accelerate the development of AI itself? While recent agentic systems have shown strong performance on well-scoped tasks with rapid feedback, it remains unclear whether they can tackle the costly, long-horizon, and weakly supervised research loops that drive real AI progress. We present ASI-Evolve, an agentic framework for AI-for-AI research that closes this loop through a learn-design-experiment-analyze cycle. ASI-Evolve augments standard evolutionary agents with two key components: a cognition base that injects accumulated human priors into each round of exploration, and a dedicated analyzer that distills complex experimental outcomes into reusable insights for future iterations. To our knowledge, ASI-Evolve is the first unified framework to demonstrate AI-driven discovery across three central components of AI development: data, architectures, and learning algorithms. In neural architecture design, it discovered 105 SOTA linear attention architectures, with the best discovered model surpassing DeltaNet by +0.97 points, nearly 3x the gain of recent human-designed improvements. In pretraining data curation, the evolved pipeline improves average benchmark performance by +3.96 points, with gains exceeding 18 points on MMLU. In reinforcement learning algorithm design, discovered algorithms outperform GRPO by up to +12.5 points on AMC32, +11.67 points on AIME24, and +5.04 points on OlympiadBench. We further provide initial evidence that this AI-for-AI paradigm can transfer beyond the AI stack through experiments in mathematics and biomedicine. Together, these results suggest that ASI-Evolve represents a promising step toward enabling AI to accelerate AI across the foundational stages of development, offering early evidence for the feasibility of closed-loop AI research.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 27 of its 42 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

27 of 42 references.

References · 27

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  3. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  4. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  5. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  6. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
  7. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
  8. 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 532
  9. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
  10. 2024Parallelizing Linear Transformers with the Delta Rule over Sequence Lengthcited by 396
  11. 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
  12. 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
15 more
  1. 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 174
  2. 2024AutoSurvey: Large Language Models Can Automatically Write Surveyscited by 119
  3. 2025Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Taskcited by 106
  4. 2025Robin: A multi-agent system for automating scientific discoverycited by 62
  5. 2025ML-Master: Towards AI-for-AI via Integration of Exploration and Reasoningcited by 61
  6. 2026AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimizationcited by 60
  7. 2024Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideascited by 57
  8. 2025SciMaster: Towards General-Purpose Scientific AI Agents, Part I. X-Master as Foundation: Can We Lead on Humanity's Last Exam?cited by 47
  9. 2026FrontierScience: Evaluating AI's Ability to Perform Expert-Level Scientific Taskscited by 47
  10. 2022Interpretable bilinear attention network with domain adaptation improves drug-target predictioncited by 39
  11. 2025LoongFlow: Directed Evolutionary Search via a Cognitive Plan-Execute-Summarize Paradigmcited by 22
  12. 2025AutoMLGen: Navigating Fine-Grained Optimization for Coding Agentscited by 18
  13. 2025Neural Architecture Discovery via Autonomous Evolutioncited by 16
  14. 2025Position: Intelligent Science Laboratory Requires the Integration of Cognitive and Embodied AIcited by 2
  15. 2025Towards an AI Fluid Scientist: LLM-Powered Scientific Discovery in Experimental Fluid Mechanicscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Astar: Learning to Propose Evolution Directions for Self-Evolving Industrial AI Systems
  2. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems
  3. 2026Aspire: Can Models Self-Evolve from Vague Goals?
  4. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
  5. 2026A case study of evaluating AI agents on a neuroscience data-to-discovery pipeline
  6. 2024Investigate-Consolidate-Exploit: A General Strategy for Inter-Task Agent Self-Evolution
  7. 2026FML-bench: A Controlled Study of AI Research Agent Strategies from the Perspective of Search Dynamics
  8. 2025AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suite