mlsanityData to 14 Oct 2026

Training Numerical Intelligence via Auto-Diagnosis and Skill Discovery

arXiv 2610.03872 ↗First posted 2 Oct 2026cs.AI cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

AI agents are becoming increasingly capable of generating scientific code, but generating code is not the same as improving the algorithms behind it. For numerical solvers, execution feedback can expose poor performance, but rarely reveals its underlying cause and how to address it. We introduce Auto-Diagnosis and Skill Discovery (ADSD), a framework that links numerical diagnosis to reusable solver self-improvement. ADSD follows a diagnosis-first paradigm that first explains why a solver performs poorly, then uses this diagnosis to guide the discovery of appropriate numerical methods. The resulting knowledge is packaged into reusable solver skills, turning solver improvement from trial-and-error editing into a structured process of diagnosis, discovery, and implementation. Across four challenging numerical domains--power flow equation, AC optimal power flow control, stiff ordinary differential equations, and heterogeneous diffusion PDEs--ADSD consistently improves solver accuracy, robustness, and efficiency. On GOC-500 power flow, for example, ADSD reduces mean solver error by nearly 71×, with improvements further transferring to unseen grid topologies and operating regimes.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 58 of its 72 references that are in the map. First posted on arXiv 2 Oct 2026.

Builds on

58 of 72 references.

References · 58

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  5. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  7. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  8. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
  9. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  10. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
  11. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
  12. 2025ToolRL: Reward is All Tool Learning Needscited by 362
38 more
  1. 2023Large Language Models as Tool Makerscited by 303
  2. 2023ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Modelscited by 187
  3. 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 137
  4. 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systemscited by 107
  5. 2025Reinforcement Learning for Self-Improving Agent with Skill Librarycited by 100
  6. 2026AgentRx: Diagnosing AI Agent Failures from Execution Trajectoriescited by 60
  7. 2021Learning to run a Power Network Challenge: a Retrospective Analysiscited by 55
  8. 2024LLMs for Mathematical Modeling: Towards Bridging the Gap between Natural and Mathematical Languagescited by 49
  9. 2026SkillForge: Forging Domain-Specific, Self-Evolving Agent Skills in Cloud Technical Supportcited by 48
  10. 2025Automated Hypothesis Validation with Agentic Sequential Falsificationscited by 44
  11. 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulatorscited by 42
  12. 2026SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resourcescited by 41
  13. 2025CodePDE: An Inference Framework for LLM-driven PDE Solver Generationcited by 39
  14. 2026SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revisioncited by 30
  15. 2025Exploration vs Exploitation: Rethinking RLVR through Clipping, Entropy, and Spurious Rewardcited by 27
  16. 2024OPFData: Large-scale datasets for AC optimal power flow with topological perturbationscited by 24
  17. 2025Paper2Agent: Reimagining Research Papers As Interactive and Reliable AI Agentscited by 23
  18. 2025Stepwise Guided Policy Optimization: Coloring your Incorrect Reasoning in GRPOcited by 19
  19. 2023Large Foundation Models for Power Systemscited by 18
  20. 2024Enhancing LLMs for Power System Simulations: A Feedback-driven Multi-agent Frameworkcited by 17
  21. 2021PowerGridworld: A Framework for Multi-Agent Reinforcement Learning in Power Systemscited by 16
  22. 2025GridMind: LLMs-Powered Agents for Power System Analysis and Operationscited by 16
  23. 2025ResearchCodeAgent: An LLM Multi-Agent System for Automated Codification of Research Methodologiescited by 15
  24. 2021PowerGym: A Reinforcement Learning Environment for Volt-Var Control in Power Distribution Systemscited by 14
  25. 2024ElecBench: a Power Dispatch Evaluation Benchmark for Large Language Modelscited by 13
  26. 2025ComPO: Preference Alignment via Comparison Oraclescited by 13
  27. 2025MIR: Methodology Inspiration Retrieval for Scientific Research Problemscited by 11
  28. 2026Reward-free Alignment for Conflicting Objectivescited by 11
  29. 2026GRASP: Gated Regression-Aware Skill Proposer for Self-Improving LLM Agentscited by 11
  30. 2021Personalized Algorithm Generation: A Case Study in Learning ODE Integratorscited by 9
  31. 2025RL2Grid: Benchmarking Reinforcement Learning in Power Grid Operationscited by 9
  32. 2026AutoNumerics: An Autonomous, PDE-Agnostic Multi-Agent Pipeline for Scientific Computingcited by 8
  33. 2026PDEAgent-Bench: A Multi-Metric, Multi-Library Benchmark for PDE Solver Generationcited by 8
  34. 2024Enabling Large Language Models to Perform Power System Simulations with Previously Unseen Tools: A Case of Dalinecited by 7
  35. 2025PFDelta: A Benchmark Dataset for Power Flow under Load, Generation, and Topology Variationscited by 7
  36. 2025SciML Agents: Write the Solver, Not the Solutioncited by 6
  37. 2025From Natural Language to Solver-Ready Power System Optimization: An LLM-Assisted, Validation-in-the-Loop Frameworkcited by 3
  38. 2026Towards LLM-enabled autonomous combustion research: A literature-aware agent for self-corrective modeling workflowscited by 3

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.