mlsanityData to 14 Oct 2026

AI Training Manager: Bounded Closed-Loop Control of Adaptive Training Recipes

arXiv 2606.29871 ↗First posted 29 Jun 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

We present the AI Training Manager, a bounded LLM-based metacognitive monitoring-and-control layer for machine-learning training. The Manager asynchronously observes structured telemetry from an active training run, assesses the current training regime, and selects adaptive interventions through a constrained, deterministically verified action interface. We evaluate the feasibility of this architecture using deliberately induced, interpretable failure modes in supervised and reinforcement learning tasks. For supervised learning, we induce a multi-objective overfitting failure in a GPT-2-style model trained on TinyStories. The Manager prevents the resulting late-run validation collapse, reducing final validation loss by 54.3% relative to the same stressed recipe. For reinforcement learning, we study robotic reaching under opposing multifactor stress regimes. In a conservative regime, the Manager raises final deterministic safe success from 0.413 to 0.705. In an aggressive regime, it raises safe success from 0.121 to 0.764. The same Manager instructions and action surface are used in both regimes. These results suggest that bounded LLM reasoning can provide a practical metacognitive control layer over ongoing learning processes.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 40 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

27 of 40 references.

References · 27

  1. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  2. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  4. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
  5. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  6. 2017Constrained Policy Optimizationcited by 983
  7. 2023Large Language Models as Optimizerscited by 864
  8. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
  9. 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 699
  10. 2015Cyclical Learning Rates for Training Neural Networkscited by 629
  11. 2016Learning to learn by gradient descent by gradient descentcited by 620
  12. 2023TinyStories: How Small Can Language Models Be and Still Speak Coherent English?cited by 449
15 more
  1. 2017Population Based Training of Neural Networkscited by 367
  2. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
  3. 2016Learning to Optimizecited by 195
  4. 2017Neural Optimizer Search with Reinforcement Learningcited by 82
  5. 2023Using Large Language Models for Hyperparameter Optimizationcited by 71
  6. 2022Automated Reinforcement Learning (AutoRL): A Survey and Open Problemscited by 70
  7. 2024Large Language Model Agent for Hyper-Parameter Optimizationcited by 64
  8. 2022VeLO: Training Versatile Learned Optimizers by Scaling Upcited by 57
  9. 2022Automated Dynamic Algorithm Configurationcited by 39
  10. 2024Sequential Large Language Model-Based Hyper-parameter Optimizationcited by 24
  11. 2023Learning to Optimize for Reinforcement Learningcited by 12
  12. 2022Theory-inspired Parameter Control Benchmarks for Dynamic Algorithm Configurationcited by 11
  13. 2023AutoRL Hyperparameter Landscapescited by 8
  14. 2025A Proposal to Extend the Common Model of Cognition with Metacognitioncited by 4
  15. 2025Small LLMs with Expert Blocks Are Good Enough for Hyperparamter Tuningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Experience to Strategy: Empowering LLM Agents with Trainable Graph Memory
  2. 2025AMFT: Aligning LLM Reasoners by Meta-Learning the Optimal Imitation-Exploration Balance
  3. 2026LLMZero: Discovering Adaptive Training Strategies for RL Post-Training via LLM Agents
  4. 2026LLM-ALSO: LLM-Driven Adaptive Learning-Signal Optimization for Multi-Agent Reinforcement Learning
  5. 2026From Meta-Thought to Execution: Cognitively Aligned Post-Training for Generalizable and Reliable LLM Reasoning
  6. 2025LLM-Guided Reinforcement Learning: Addressing Training Bottlenecks through Policy Modulation
  7. 2024Active Fine-Tuning of Multi-Task Policies
  8. 2026Can RL Improve Generalization of LLM Agents? An Empirical Study