mlsanityData to 14 Oct 2026

CIFQA: A Deterministic Tool-Grounded Multi-Agent LLM Framework for Financial Query Answering

arXiv 2608.26114 ↗First posted 5 Jun 2026cs.AI cs.CL q-fin.CPcited by 0

On the map: LLM agents and tool use → Financial trading and forecasting agents

Abstract (arXiv)

Calculation-intensive financial question answering requires exact reasoning over structured rates, temporal conditions, numerical formulas, and rule-based constraints. Although Large Language Models (LLMs) perform strongly on natural language tasks, they often produce numerically incorrect yet plausible answers when solving multi-step financial calculations. To address this limitation, we introduce CIFQA (Calculation-Intensive Financial Query Answering), a deterministic tool-grounded multi-agent LLM framework for financial question answering. CIFQA separates language understanding from numerical execution by assigning specialized agents to query interpretation, routing, parameter extraction, computation planning, and response generation, while deterministic Python-based tools perform financial calculations and rule application. We instantiate CIFQA for fixed deposit query answering and evaluate it on a curated benchmark of fixed deposit queries. CIFQA achieves 95.54% accuracy on calculation-intensive queries and 90.87% overall accuracy, substantially outperforming direct LLM baselines even when provided with complete formulas, rate cards, and benchmark instructions. Ablation studies show that deterministic components such as exact rate lookup, tenure computation, rolling-year adjustment, and premature-withdrawal logic are critical contributors to performance. Notably, a 17B open-source backbone operating within CIFQA outperforms substantially larger frontier models evaluated with the same financial information, demonstrating that architectural design is a more important determinant of numerical reliability than model scale. While evaluated on fixed deposit queries, CIFQA provides a generalizable framework for calculation-intensive financial reasoning tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use. Builds on 35 of its 46 references that are in the map. First posted on arXiv 5 Jun 2026.

Builds on

35 of 46 references.

References · 35

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  7. 2020Scaling Laws for Neural Language Modelscited by 6,586
  8. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  9. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  10. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  11. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  12. 2022Emergent Abilities of Large Language Modelscited by 2,512
23 more
  1. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  2. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  3. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  4. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  5. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  6. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
  7. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  8. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  9. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  10. 2023BloombergGPT: A Large Language Model for Financecited by 939
  11. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
  12. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  13. 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 550
  14. 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 503
  15. 2024Understanding the planning of LLM agents: A surveycited by 421
  16. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
  17. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
  18. 2023FinGPT: Open-Source Financial Large Language Modelscited by 253
  19. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
  20. 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 90
  21. 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 79
  22. 2024How Numerical Precision Affects Arithmetical Reasoning Capabilities of LLMscited by 24
  23. 2025Mathematical Reasoning in Large Language Models: Assessing Logical and Arithmetic Errors across Wide Numerical Rangescited by 24

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhancing Financial Question Answering with a Multi-Agent Reflection Framework
  2. 2026Agentic Retrieval-Augmented Generation for Financial Document Question Answering
  3. 2025FinAgentBench: A Benchmark Dataset for Agentic Retrieval in Financial Question Answering
  4. 2026From Documents to Reasoning: A Validated Synthetic Data Pipeline and Semantic-Aware Fine-Tuning for Financial Numerical Reasoning
  5. 2023BizBench: A Quantitative Reasoning Benchmark for Business and Finance
  6. 2025Agentar-Fin-R1: Enhancing Financial Intelligence through Domain Expertise, Training Efficiency, and Advanced Reasoning
  7. 2026Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements
  8. 2026FIND: Toward Multimodal Financial Reasoning and Question Answering for Indic Languages