CIFQA: A Deterministic Tool-Grounded Multi-Agent LLM Framework for Financial Query Answering
On the map: LLM agents and tool use → Financial trading and forecasting agents
Abstract (arXiv)
Calculation-intensive financial question answering requires exact reasoning over structured rates, temporal conditions, numerical formulas, and rule-based constraints. Although Large Language Models (LLMs) perform strongly on natural language tasks, they often produce numerically incorrect yet plausible answers when solving multi-step financial calculations. To address this limitation, we introduce CIFQA (Calculation-Intensive Financial Query Answering), a deterministic tool-grounded multi-agent LLM framework for financial question answering. CIFQA separates language understanding from numerical execution by assigning specialized agents to query interpretation, routing, parameter extraction, computation planning, and response generation, while deterministic Python-based tools perform financial calculations and rule application. We instantiate CIFQA for fixed deposit query answering and evaluate it on a curated benchmark of fixed deposit queries. CIFQA achieves 95.54% accuracy on calculation-intensive queries and 90.87% overall accuracy, substantially outperforming direct LLM baselines even when provided with complete formulas, rate cards, and benchmark instructions. Ablation studies show that deterministic components such as exact rate lookup, tenure computation, rolling-year adjustment, and premature-withdrawal logic are critical contributors to performance. Notably, a 17B open-source backbone operating within CIFQA outperforms substantially larger frontier models evaluated with the same financial information, demonstrating that architectural design is a more important determinant of numerical reliability than model scale. While evaluated on fixed deposit queries, CIFQA provides a generalizable framework for calculation-intensive financial reasoning tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use. Builds on 35 of its 46 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
35 of 46 references.
References · 35
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Emergent Abilities of Large Language Modelscited by 2,512
23 more
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 550
- 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 503
- 2024Understanding the planning of LLM agents: A surveycited by 421
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
- 2023FinGPT: Open-Source Financial Large Language Modelscited by 253
- 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
- 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 90
- 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 79
- 2024How Numerical Precision Affects Arithmetical Reasoning Capabilities of LLMscited by 24
- 2025Mathematical Reasoning in Large Language Models: Assessing Logical and Arithmetic Errors across Wide Numerical Rangescited by 24
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Enhancing Financial Question Answering with a Multi-Agent Reflection Framework
- 2026Agentic Retrieval-Augmented Generation for Financial Document Question Answering
- 2025FinAgentBench: A Benchmark Dataset for Agentic Retrieval in Financial Question Answering
- 2026From Documents to Reasoning: A Validated Synthetic Data Pipeline and Semantic-Aware Fine-Tuning for Financial Numerical Reasoning
- 2023BizBench: A Quantitative Reasoning Benchmark for Business and Finance
- 2025Agentar-Fin-R1: Enhancing Financial Intelligence through Domain Expertise, Training Efficiency, and Advanced Reasoning
- 2026Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements
- 2026FIND: Toward Multimodal Financial Reasoning and Question Answering for Indic Languages