mlsanityData to 14 Oct 2026

FinBERT: A Pretrained Language Model for Financial Communications

arXiv 2006.08097 ↗First posted 15 Jun 2020cs.CLcited by 161

Not on the map. Why?

Abstract (arXiv)

Contextual pretrained language models, such as BERT (Devlin et al., 2019), have made significant breakthrough in various NLP tasks by training on large scale of unlabeled text re-sources.Financial sector also accumulates large amount of financial communication text.However, there is no pretrained finance specific language models available. In this work,we address the need by pretraining a financial domain specific BERT models, FinBERT, using a large scale of financial communication corpora. Experiments on three financial sentiment classification tasks confirm the advantage of FinBERT over generic domain BERT model. The code and pretrained models are available at https://github.com/yya518/FinBERT. We hope this will be useful for practitioners and researchers working on financial NLP tasks.

Key facts. Cited by 161 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Jun 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 8; 2022: 19; 2023: 33; 2024: 36; 2025: 39; 2026: 26.

161 papers.

Sort:

By area:

  1. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  2. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 222
  3. 2022Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attackscited by 175
  4. 2022Can Foundation Models Wrangle Your Data?cited by 175
  5. 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 141
  6. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 135
  7. 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
  8. 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 121
  9. 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
  10. 2024HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extractioncited by 93
  11. 2023XuanYuan 2.0: A Large Chinese Financial Chat Model with Hundreds of Billions Parameterscited by 92
  12. 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 90
38 more
  1. 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 90
  2. 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 82
  3. 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 79
  4. 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
  5. 2023Trillion Dollar Words: A New Financial Dataset, Task & Market Analysiscited by 75
  6. 2022Fengshenbang 1.0: Being the Foundation of Chinese Cognitive Intelligencecited by 70
  7. 2023Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language Modelscited by 68
  8. 2024INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agentcited by 64
  9. 2023BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmarkcited by 60
  10. 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
  11. 2022POLITICS: Pretraining with Same-story Article Comparison for Ideology Prediction and Stance Detectioncited by 51
  12. 2022FiNER: Financial Numeric Entity Recognition for XBRL Taggingcited by 50
  13. 2025Large Language Models Hallucination: A Comprehensive Surveycited by 49
  14. 2023Deficiency of Large Language Models in Finance: An Empirical Examination of Hallucinationcited by 41
  15. 2024Graph Machine Learning in the Era of Large Language Models (LLMs)cited by 33
  16. 2022What do LLMs Know about Financial Markets? A Case Study on Reddit Market Sentiment Analysiscited by 27
  17. 2023DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domainscited by 27
  18. 2023Empowering Many, Biasing a Few: Generalist Credit Scoring through Large Language Modelscited by 24
  19. 2025FLAG-Trader: Fusion LLM-Agent with Gradient-based Reinforcement Learning for Financial Tradingcited by 23
  20. 2022Open-world Story Generation with Structured Knowledge Enhancement: A Comprehensive Surveycited by 22
  21. 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontierscited by 22
  22. 2025FinMTEB: Finance Massive Text Embedding Benchmarkcited by 18
  23. 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
  24. 2023One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial Supportcited by 16
  25. 2021JuriBERT: A Masked-Language Model Adaptation for French Legal Textcited by 14
  26. 2023FinEntity: Entity-level Sentiment Classification for Financial Textscited by 14
  27. 2023FinPT: Financial Risk Prediction with Profile Tuning on Pretrained Foundation Modelscited by 13
  28. 2021Stock Movement Prediction with Financial News using Contextualized Embedding from BERTcited by 12
  29. 2022SsciBERT: A Pre-trained Language Model for Social Science Textscited by 12
  30. 2024Do We Need Domain-Specific Embedding Models? An Empirical Investigationcited by 12
  31. 2024Greenback Bears and Fiscal Hawks: Finance is a Jungle and Text Embeddings Must Adaptcited by 12
  32. 2023CFGPT: Chinese Financial Assistant with Large Language Modelcited by 11
  33. 2023Is ChatGPT a Financial Expert? Evaluating Language Models on Financial Natural Language Processingcited by 11
  34. 2024StockGPT: A GenAI Model for Stock Prediction and Tradingcited by 11
  35. 2025FinGAIA: A Chinese Benchmark for AI Agents in Real-World Financial Domaincited by 9
  36. 2022Towards an Enhanced Understanding of Bias in Pre-trained Neural Language Models: A Survey with Special Emphasis on Affective Biascited by 8
  37. 2022FinBERT-MRC: financial named entity recognition using BERT under the machine reading comprehension paradigmcited by 8
  38. 2023Leveraging Large Language Models and Weak Supervision for Social Media data annotation: an evaluation using COVID-19 self-reported vaccination tweetscited by 8

50 most cited of 161 All 161 (JSON)