mlsanityData to 14 Oct 2026

FinBloom: Knowledge Grounding Large Language Model with Real-time Financial Data

arXiv 2502.18471 ↗First posted 4 Feb 2025cs.IR cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) excel at generating human-like responses but often struggle with interactive tasks that require access to real-time information. This limitation poses challenges in finance, where models must access up-to-date information, such as recent news or price movements, to support decision-making. To address this, we introduce Financial Agent, a knowledge-grounding approach for LLMs to handle financial queries using real-time text and tabular data. Our contributions are threefold: First, we develop a Financial Context Dataset of over 50,000 financial queries paired with the required context. Second, we develop FinBloom 7B, a custom 7 billion parameter LLM, by fine-tuning Bloom 7B on 14 million financial news articles from Reuters and Deutsche Presse-Agentur (DPA), alongside a random sample of 25% from 12 million Securities and Exchange Commission (SEC) filings. Third, we fine-tune FinBloom 7B using the Financial Context Dataset to serve as a Financial Agent. This agent generates relevant financial context, enabling efficient real-time data retrieval to answer user queries. By reducing latency and eliminating the need for users to manually provide accurate data, our approach significantly enhances the capability of LLMs to handle dynamic financial tasks. Our proposed approach makes real-time financial decisions, algorithmic trading and other related tasks streamlined, and is valuable in contexts with high-velocity data flows.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 48 of its 74 references that are in the map. First posted on arXiv 4 Feb 2025.

Builds on

48 of 74 references.

References · 48

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  8. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  9. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  10. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  11. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
  12. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
36 more
  1. 2023BloombergGPT: A Large Language Model for Financecited by 939
  2. 2022Galactica: A Large Language Model for Sciencecited by 744
  3. 2021GPT Understands, Toocited by 716
  4. 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 606
  5. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  6. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
  7. 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
  8. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
  9. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
  10. 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
  11. 2024The Power of Noise: Redefining Retrieval for RAG Systemscited by 281
  12. 2023FinGPT: Open-Source Financial Large Language Modelscited by 253
  13. 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 249
  14. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 222
  15. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
  16. 2023Grounding Large Language Models in Interactive Environments with Online Reinforcement Learningcited by 195
  17. 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 141
  18. 2024A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalistcited by 137
  19. 2024Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAGcited by 123
  20. 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 82
  21. 2020Impact of News on the Commodity Market: Dataset and Resultscited by 80
  22. 2023Trillion Dollar Words: A New Financial Dataset, Task & Market Analysiscited by 75
  23. 2024A Comprehensive Survey of Retrieval-Augmented Generation (RAG): Evolution, Current Landscape and Future Directionscited by 70
  24. 2024Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wiselycited by 66
  25. 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
  26. 2020Generating Plausible Counterfactual Explanations for Deep Transformers in Financial Text Classificationcited by 40
  27. 2021Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representationcited by 32
  28. 2020Financial Document Causality Detection Shared Task (FinCausal 2020)cited by 31
  29. 2023Empowering Many, Biasing a Few: Generalist Credit Scoring through Large Language Modelscited by 24
  30. 2023SEntFiN 1.0: Entity-Aware Sentiment Analysis for Financial Newscited by 18
  31. 2023REFinD: Relation Extraction Financial Datasetcited by 17
  32. 2024RAG Does Not Work for Enterprisescited by 15
  33. 2023Financial Numeric Extreme Labelling: A Dataset and Benchmarking for XBRL Taggingcited by 12
  34. 2024Mindful-RAG: A Study of Points of Failure in Retrieval Augmented Generationcited by 12
  35. 2023CFGPT: Chinese Financial Assistant with Large Language Modelcited by 11
  36. 2018Textual Analogy Parsing: What's Shared and What's Compared among Analogous Factscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.