FiMI Banking: A Sovereign Model for Indian Retail Banking
On the map: LLM alignment / RLHF / preference optimisation → Reward modeling and RLHF
Abstract (arXiv)
Banks need conversational systems that can answer product questions, assist customers with account-related requests, and operate safely within strict operational and regulatory constraints. General-purpose language models do not reliably meet these requirements. They fall short when a task requires grounded information, correct tool use, or cautious handling of bank-specific sensitive situations. We introduce FiMI Banking, a controlled Indian retail-banking setting. We build it from vetted banking documents, structured ground truth, synthetic customer backgrounds, and banking tools. We evaluate two post-training approaches: preference optimization for response-level behavior, and reinforcement learning with verifiable rewards for multi-turn tool-use tasks. Preference optimization improves safe behavior substantially: out-of-scope refusal rises from 52% to 80%. Reinforcement learning improves edge-case performance from 0.509 to 0.718 and order-sensitive task performance from 0.590 to 0.679, while using 29% fewer generated tokens. These results show that preference optimization and verifiable-reward reinforcement learning address complementary requirements for reliable banking agents.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reward modeling and RLHF, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 29 of its 40 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
29 of 40 references.
Closest ancestors · 3
Same direction, newest first
- 2024HybridFlow: A Flexible and Efficient RLHF Framework28 Sep
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Model29 May
- 2017Deep reinforcement learning from human preferences12 Jun
Other references · 26
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2023Statistical Rejection Sampling Improves Preference Optimizationcited by 323
14 more
- 2024Disentangling Length from Quality in Direct Preference Optimizationcited by 196
- 2024Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Datacited by 185
- 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplaycited by 167
- 2023XuanYuan 2.0: A Large Chinese Financial Chat Model with Hundreds of Billions Parameterscited by 92
- 2023DISC-FinLLM: A Chinese Financial Large Language Model based on Multiple Experts Fine-tuningcited by 64
- 2026The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligencecited by 61
- 2024RS-DPO: A Hybrid Rejection Sampling and Direct Preference Optimization Method for Alignment of Large Language Modelscited by 48
- 2024Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignmentcited by 46
- 2026SPASM: Stable Persona-driven Agent Simulation for Multi-turn Dialogue Generationcited by 11
- 2024Aligning CodeLLMs with Direct Preference Optimizationcited by 9
- 2026State-Grounded Multi-Agent Synthetic Data Generation for Tool-Augmented LLMscited by 4
- 2026Evoflux: Inference-Time Evolution of Executable Tool Workflows for Compact Agentscited by 2
- 2026FiMI: A Domain-Specific Language Model for Indian Finance Ecosystemcited by 1
- 2026GenesisFunc: Multi-Agent Data Generation for Accurate and Generalizable Function-Callingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Banking Done Right: Redefining Retail Banking with Language-Centric AI
- 2026BankMathBench: A Benchmark for Numerical Reasoning in Banking Scenarios
- 2026Helping Customers in Distress: An LLM-powered Agent that Converses, Probes, and Routes
- 2026ChatShopBuddy: Towards Reliable Conversational Shopping Agents via Reinforcement Learning
- 2026Harmonizing Dense and Sparse Signals in Multi-turn RL: Dual-Horizon Credit Assignment for Industrial Sales Agents
- 2026FraudBench: Stress-Testing Policy-Grounded Banking Agents Against Adaptive Fraud
- 2025DianJin-R1: Evaluating and Enhancing Financial Reasoning in Large Language Models
- 2025Teaching LLM to be Persuasive: Reward-Enhanced Policy Optimization for Alignment from Heterogeneous Rewards