mlsanityData to 7 Oct 2026

Token-Budgeted Escalation for Financial Document QA: Cost Is Predictable, Benefit Is the Bottleneck

arXiv 2610.07760 ↗First posted 6 Oct 2026cs.IRcited by 0

On the map: Retrieval-augmented generation → Legal and financial RAG

Abstract (arXiv)

Retrieval-augmented generation systems can route difficult queries to deeper context, but batch deployments must allocate a shared token budget across calls whose costs vary by query. We formulate selective escalation as finite-batch allocation for financial document question answering. Each of 150 FinanceBench questions first receives a top-1 retrieval answer. Predictors estimate the adjudication-quality gain and token cost of an optional top-5 call, and the allocator prioritizes calls by predicted gain per token. At the nominal 10% budget, gain-per-token allocation improves adjudication quality over gain-only ranking by 0.034 (95% document-bootstrap CI [0.001, 0.072]) while using 46.6% fewer total tokens than one-pass top-5 retrieval. Additional-call cost is accurately predictable (R-squared 0.93), whereas beneficial escalation remains difficult to rank (AUROC 0.60). These results show that heterogeneous cost is actionable under tight constraints, while progress across the full budget frontier depends on stronger query-specific benefit estimates.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Legal and financial RAG, one of 15 directions in Retrieval-augmented generation. First posted on arXiv 6 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Decomposing Retrieval Failures in RAG for Long-Document Financial Question Answering
  2. 2025FinGEAR: Financial Mapping-Guided Enhanced Answer Retrieval
  3. 2026Bypassing Document Ingestion: An MCP Approach to Financial Q&A
  4. 2025Metadata-Driven Retrieval-Augmented Generation for Financial Question Answering
  5. 2026Enhancing Financial Question Answering: A Novel Benchmark Dataset of Banks' financial statements
  6. 2025Optimizing Retrieval Strategies for Financial Question Answering Documents in Retrieval-Augmented Generation Systems
  7. 2025VeritasFi: An Adaptable, Multi-tiered RAG Framework for Multi-modal Financial Question Answering
  8. 2026Agentic Retrieval-Augmented Generation for Financial Document Question Answering