FinBloom: Knowledge Grounding Large Language Model with Real-time Financial Data
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) excel at generating human-like responses but often struggle with interactive tasks that require access to real-time information. This limitation poses challenges in finance, where models must access up-to-date information, such as recent news or price movements, to support decision-making. To address this, we introduce Financial Agent, a knowledge-grounding approach for LLMs to handle financial queries using real-time text and tabular data. Our contributions are threefold: First, we develop a Financial Context Dataset of over 50,000 financial queries paired with the required context. Second, we develop FinBloom 7B, a custom 7 billion parameter LLM, by fine-tuning Bloom 7B on 14 million financial news articles from Reuters and Deutsche Presse-Agentur (DPA), alongside a random sample of 25% from 12 million Securities and Exchange Commission (SEC) filings. Third, we fine-tune FinBloom 7B using the Financial Context Dataset to serve as a Financial Agent. This agent generates relevant financial context, enabling efficient real-time data retrieval to answer user queries. By reducing latency and eliminating the need for users to manually provide accurate data, our approach significantly enhances the capability of LLMs to handle dynamic financial tasks. Our proposed approach makes real-time financial decisions, algorithmic trading and other related tasks streamlined, and is valuable in contexts with high-velocity data flows.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 48 of its 74 references that are in the map. First posted on arXiv 4 Feb 2025.
Builds on
48 of 74 references.
References · 48
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
36 more
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2022Galactica: A Large Language Model for Sciencecited by 744
- 2021GPT Understands, Toocited by 716
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 606
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
- 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
- 2024The Power of Noise: Redefining Retrieval for RAG Systemscited by 281
- 2023FinGPT: Open-Source Financial Large Language Modelscited by 253
- 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 249
- 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 222
- 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
- 2023Grounding Large Language Models in Interactive Environments with Online Reinforcement Learningcited by 195
- 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 141
- 2024A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalistcited by 137
- 2024Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAGcited by 123
- 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 82
- 2020Impact of News on the Commodity Market: Dataset and Resultscited by 80
- 2023Trillion Dollar Words: A New Financial Dataset, Task & Market Analysiscited by 75
- 2024A Comprehensive Survey of Retrieval-Augmented Generation (RAG): Evolution, Current Landscape and Future Directionscited by 70
- 2024Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wiselycited by 66
- 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
- 2020Generating Plausible Counterfactual Explanations for Deep Transformers in Financial Text Classificationcited by 40
- 2021Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representationcited by 32
- 2020Financial Document Causality Detection Shared Task (FinCausal 2020)cited by 31
- 2023Empowering Many, Biasing a Few: Generalist Credit Scoring through Large Language Modelscited by 24
- 2023SEntFiN 1.0: Entity-Aware Sentiment Analysis for Financial Newscited by 18
- 2023REFinD: Relation Extraction Financial Datasetcited by 17
- 2024RAG Does Not Work for Enterprisescited by 15
- 2023Financial Numeric Extreme Labelling: A Dataset and Benchmarking for XBRL Taggingcited by 12
- 2024Mindful-RAG: A Study of Points of Failure in Retrieval Augmented Generationcited by 12
- 2023CFGPT: Chinese Financial Assistant with Large Language Modelcited by 11
- 2018Textual Analogy Parsing: What's Shared and What's Compared among Analogous Factscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.