mlsanityData to 14 Oct 2026

FinBERT: Financial Sentiment Analysis with Pre-trained Language Models

arXiv 1908.10063 ↗First posted 27 Aug 2019cs.CL cs.LGcited by 385

Not on the map. Why?

Cited by 20 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Financial sentiment analysis is a challenging task due to the specialized language and lack of labeled data in that domain. General-purpose models are not effective enough because of the specialized language used in a financial context. We hypothesize that pre-trained language models can help with this problem because they require fewer labeled examples and they can be further trained on domain-specific corpora. We introduce FinBERT, a language model based on BERT, to tackle NLP tasks in the financial domain. Our results show improvement in every measured metric on current state-of-the-art results for two financial sentiment analysis datasets. We find that even with a smaller training set and fine-tuning only a part of the model, FinBERT outperforms state-of-the-art machine learning methods.

Key facts. Cited by 385 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Aug 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 32; 2022: 42; 2023: 71; 2024: 78; 2025: 75; 2026: 87.

385 papers.

Sort:

By area:

  1. 2023BloombergGPT: A Large Language Model for Financecited by 939
  2. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
  3. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  4. 2023FinGPT: Open-Source Financial Large Language Modelscited by 253
  5. 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
  6. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 222
  7. 2023Evaluating Large Language Models: A Comprehensive Surveycited by 202
  8. 2023OpenAGI: When LLM Meets Domain Expertscited by 197
  9. 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 141
  10. 2023Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Surveycited by 135
  11. 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
  12. 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 121
38 more
  1. 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
  2. 2024AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attackscited by 96
  3. 2023XuanYuan 2.0: A Large Chinese Financial Chat Model with Hundreds of Billions Parameterscited by 92
  4. 2021ClimateBert: A Pretrained Language Model for Climate-Related Textcited by 90
  5. 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 90
  6. 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 90
  7. 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 83
  8. 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 79
  9. 2021A Review on Graph Neural Network Methods in Financial Applicationscited by 78
  10. 2023Trillion Dollar Words: A New Financial Dataset, Task & Market Analysiscited by 75
  11. 2023FinGPT: Instruction Tuning Benchmark for Open-Source Large Language Models in Financial Datasetscited by 69
  12. 2023Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language Modelscited by 68
  13. 2023DISC-FinLLM: A Chinese Financial Large Language Model based on Multiple Experts Fine-tuningcited by 64
  14. 2024INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agentcited by 64
  15. 2023BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmarkcited by 60
  16. 2023Are ChatGPT and GPT-4 General-Purpose Solvers for Financial Text Analytics? A Study on Several Typical Taskscited by 59
  17. 2023Instruct-FinGPT: Financial Sentiment Analysis by Instruction Tuning of General-Purpose Large Language Modelscited by 58
  18. 2023A Bibliometric Review of Large Language Models Research from 2017 to 2023cited by 57
  19. 2022PanGu-Coder: Program Synthesis with Function-Level Language Modelingcited by 48
  20. 2024AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Frameworkcited by 47
  21. 2023Using Large Language Models to Generate, Validate, and Apply User Intent Taxonomiescited by 34
  22. 2024LLMFactor: Extracting Profitable Factors through Prompts for Explainable Stock Movement Predictioncited by 33
  23. 2022Prompting as Probing: Using Language Models for Knowledge Base Constructioncited by 32
  24. 2023Context Matters: A Strategy to Pre-train Language Model for Science Educationcited by 32
  25. 2024FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Modelscited by 32
  26. 2023Training-free Lexical Backdoor Attacks on Language Modelscited by 31
  27. 2023Integration of Large Language Models and Federated Learningcited by 31
  28. 2021FBERT: A Neural Transformer for Identifying Offensive Contentcited by 30
  29. 2024Can Large Language Models Beat Wall Street? Unveiling the Potential of AI in Stock Selectioncited by 29
  30. 2021A systematic review of Hate Speech automatic detection using Natural Language Processingcited by 27
  31. 2022What do LLMs Know about Financial Markets? A Case Study on Reddit Market Sentiment Analysiscited by 27
  32. 2024STEER: Assessing the Economic Rationality of Large Language Modelscited by 27
  33. 2023Empowering Many, Biasing a Few: Generalist Credit Scoring through Large Language Modelscited by 24
  34. 2022On the Domain Adaptation and Generalization of Pretrained Language Models: A Surveycited by 23
  35. 2024FinLlama: Financial Sentiment Classification for Algorithmic Trading Applicationscited by 23
  36. 2025FLAG-Trader: Fusion LLM-Agent with Gradient-based Reinforcement Learning for Financial Tradingcited by 23
  37. 2022A general-purpose material property data extraction pipeline from large polymer corpora using Natural Language Processingcited by 22
  38. 2023Leveraging Vision-Language Models for Granular Market Change Predictioncited by 22

50 most cited of 385 All 385 (JSON)