mlsanityData to 14 Oct 2026

AgenticRS-EnsNAS: Ensemble-Decoupled Self-Evolving Architecture Search

arXiv 2603.20014 ↗First posted 20 Mar 2026cs.LGcited by 0

On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents

Abstract (arXiv)

Neural Architecture Search (NAS) deployment in industrial production systems faces a fundamental validation bottleneck: verifying a single candidate architecture pi requires evaluating the deployed ensemble of M models, incurring prohibitive O(M) computational cost per candidate. This cost barrier severely limits architecture iteration frequency in real-world applications where ensembles (M=50-200) are standard for robustness. This work introduces Ensemble-Decoupled Architecture Search, a framework that leverages ensemble theory to predict system-level performance from single-learner evaluation. We establish the Ensemble-Decoupled Theory with a sufficient condition for monotonic ensemble improvement under homogeneity assumptions: a candidate architecture pi yields lower ensemble error than the current baseline if rho(pi) < rho(pi_old) - (M / (M - 1)) * (Delta E(pi) / sigma^2(pi)), where Delta E, rho, and sigma^2 are estimable from lightweight dual-learner training. This decouples architecture search from full ensemble training, reducing per-candidate search cost from O(M) to O(1) while maintaining O(M) deployment cost only for validated winners. We unify solution strategies across pipeline continuity: (1) closed-form optimization for tractable continuous pi (exemplified by feature bagging in CTR prediction), (2) constrained differentiable optimization for intractable continuous pi, and (3) LLM-driven search with iterative monotonic acceptance for discrete pi. The framework reveals two orthogonal improvement mechanisms -- base diversity gain and accuracy gain -- providing actionable design principles for industrial-scale NAS. All theoretical derivations are rigorous with detailed proofs deferred to the appendix. Comprehensive empirical validation will be included in the journal extension of this work.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 4 of its 13 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

4 of 13 references.

References · 4

  1. 2018DARTS: Differentiable Architecture Searchcited by 1,798
  2. 2018Efficient Neural Architecture Search via Parameter Sharingcited by 837
  3. 2020NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Searchcited by 416
  4. 2019Understanding and Robustifying Differentiable Architecture Searchcited by 178

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agentic Neural Architecture Search
  2. 2024NADER: Neural Architecture Design via Multi-Agent Collaboration
  3. 2024Evolution and Efficiency in Neural Architecture Search: Bridging the Gap Between Expert Design and Automated Optimization
  4. 2026LLM as a Tool, Not an Agent: Code-Mined Tree Transformations for Neural Architecture Search
  5. 2025The M-factor: A Novel Metric for Evaluating Neural Architecture Search in Resource-Constrained Environments
  6. 2026Transformer-Guided Swarm Intelligence for Frugal Neural Architecture Search
  7. 2025AutoMaAS: Self-Evolving Multi-Agent Architecture Search for Large Language Models
  8. 2026Evolving Ensemble of Agents