RECAST: Learning to Compute the Right Context through Adaptive Evidence Routing
Not on the map. Why?
Abstract (arXiv)
Large language models are increasingly applied to tasks grounded in long, heterogeneous information sources. Conventional Retrieval-Augmented Generation (RAG) relies on fixed similarity-based retrieval, while agentic variants adapt queries and tool use but remain largely retrieval-centric. However, in many tasks, the evidence required for a solution is not explicitly present in any single source item. Instead, it must be derived through filtering, aggregation, or computation across multiple source items. In this work, we introduce RECAST (Routing Evidence through Computation, Access, and Synthesized Tools), a learned framework that formulates evidence construction as a sequential decision process over heterogeneous retrieval and computation operations, allowing evidence to be actively derived rather than merely retrieved. A lightweight RouterLM iteratively selects and formulates primitive operations or specifies customized operations for a frozen CompilerLM to translate into executable code. Once it judges the evidence sufficient, RouterLM passes the accepted evidence to a frozen AnswerLM to produce the final solution. We train RouterLM with supervised fine-tuning (SFT) followed by group relative policy optimization (GRPO). Across six heterogeneous benchmark families, RECAST achieves a mean success rate of 75.6%, outperforming the strongest large-model baseline by 15.9%. Moreover, training enables the Qwen3.5-9B RouterLM to outperform a training-free Gemini 3.5 Flash RouterLM by 5.0%. On three held-out benchmarks, RECAST improves over the strongest baseline by 15.0% on average, demonstrating strong zero-shot generalization across tasks and heterogeneous source representations.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 46 references that are in the map. First posted on arXiv 7 Oct 2026.
Builds on
11 of 46 references.
References · 11
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
- 2021TAPEX: Table Pre-training via Learning a Neural SQL Executorcited by 233
- 2022Binding Language Models in Symbolic Languagescited by 224
- 2023ART: Automatic multi-step reasoning and tool-use for large language modelscited by 193
- 2024Corrective Retrieval Augmented Generationcited by 187
- 2023Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflowcited by 76
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoning
- 2026ORDER: Task-Conditioned Routing for Retrieval-Augmented Generation
- 2026DynaKRAG: A Unified Framework for Learnable Evidence Control in Multi-Hop Retrieval-Augmented Generation
- 2026Skill-RAG: Failure-State-Aware Retrieval Augmentation via Hidden-State Probing and Skill Routing
- 2026PruneRAG: Confidence-Guided Query Decomposition Trees for Efficient Retrieval-Augmented Generation
- 2026ROZA Graphs: Self-Improving Near-Deterministic RAG through Evidence-Centric Feedback
- 2026Stateful Evidence-Driven Retrieval-Augmented Generation with Iterative Reasoning
- 2025FAIR-RAG: Faithful Adaptive Iterative Refinement for Retrieval-Augmented Generation