General learned delegation by clones
Not on the map. Why?
Abstract (arXiv)
Frontier language models improve with additional test-time computation, but serial reasoning or uncoordinated parallel sampling can be compute-inefficient under fixed inference budgets. We propose SELFCEST, which equips a base model with the ability to spawn same-weight clones in separate parallel contexts by agentic reinforcement learning. Training is end-to-end under a global task reward with shared-parameter rollouts, yielding a learned controller that allocates both generation and context budget across branches. Across challenging math reasoning benchmarks and long-context multi-hop QA, SELFCEST improves the accuracy-cost Pareto frontier relative to monolithic baselines at matched inference budget, and exhibits out-of-distribution generalization in both domains.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
27 of 41 references.
References · 27
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2020Learning to summarize from human feedbackcited by 2,562
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
15 more
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,270
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2024Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Headscited by 821
- 2018QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 697
- 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
- 2020BERT Loses Patience: Fast and Robust Inference with Early Exitcited by 267
- 2024WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learningcited by 243
- 2024Mixture-of-Depths: Dynamically allocating compute in transformer-based language modelscited by 242
- 2023How well do Large Language Models perform in Arithmetic tasks?cited by 130
- 2024Coevolving with the Other You: Fine-Tuning LLM with Sequential Cooperative Multi-Agent Reinforcement Learningcited by 32
- 2025Reinforce LLM Reasoning through Multi-Agent Reflectioncited by 26
- 2021Magic Pyramid: Accelerating Inference with Early Exiting and Token Pruningcited by 15
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SAGE: Multi-Agent Self-Evolution for LLM Reasoning
- 2025Native Parallel Reasoner: Reasoning in Parallelism via Self-Distilled Reinforcement Learning
- 2025AlphaApollo: A System for Deep Agentic Reasoning
- 2026PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning
- 2026SRPO: Self-Reflective Policy Optimization for Long-Horizon Reasoning
- 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoning
- 2025Boosting LLM Reasoning via Spontaneous Self-Correction
- 2025Reasoning Vectors: Transferring Chain-of-Thought Capabilities via Task Arithmetic