mlsanityData to 7 Oct 2026

Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents

arXiv 2608.12342 ↗First posted 3 Jun 2026cs.CL cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Ensuring the accuracy of financial documents is critical for economic analysis, regulatory compliance, and corporate decision-making. Several studies have shown that Large Language Models (LLMs) perform well in many financial tasks, such as stock price movements and financial analytics. However, a critical task remains unexplored: the ability of LLMs to identify errors in financial documents. In this paper, we introduce FinED-Bench, the first publicly Benchmark for Financial Error Detection across three levels of cognitive complexity. FinED-Bench covers nine real-world financial scenarios, and includes over 900 documents reported in 2025 that are unseen by existing language models. We detail the benchmark construction process and evaluate several advanced LLMs (e.g., GPT-4o, Qwen3-14B) on this tasks, which requires both financial domain knowledge and reasoning capabilities. Experimental results show that current LLMs still struggle with this task, especially in high-complexity cases. Besides, supervised fine-tuning can significantly improve the performance of weaker LLMs on this task. Our data and code are available at https://github.com/hedyHe/FinED-Bench.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 18 of its 43 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

18 of 43 references.

References · 18

  1. 2023BloombergGPT: A Large Language Model for Financecited by 923
  2. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
  3. 2023Using an LLM to Help With Code Understandingcited by 222
  4. 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 163
  5. 2024A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalistcited by 137
  6. 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
  7. 2021CREAK: A Dataset for Commonsense Reasoning over Entity Knowledgecited by 88
  8. 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learningcited by 82
  9. 2024MEDEC: A Benchmark for Medical Error Detection and Correction in Clinical Notescited by 77
  10. 2023Trillion Dollar Words: A New Financial Dataset, Task & Market Analysiscited by 73
  11. 2023FinGPT: Instruction Tuning Benchmark for Open-Source Large Language Models in Financial Datasetscited by 68
  12. 2024Large Language Model Agent in Financial Trading: A Surveycited by 60
6 more
  1. 2024FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysiscited by 35
  2. 2024Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation Datasetcited by 23
  3. 2021UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Languagecited by 19
  4. 2023SEntFiN 1.0: Entity-Aware Sentiment Analysis for Financial Newscited by 18
  5. 2025Plutus: Benchmarking Large Language Models in Low-Resource Greek Financecited by 16
  6. 2025FinReflectKG -- MultiHop: Financial QA Benchmark for Reasoning with Knowledge Graph Evidencecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements
  2. 2023Beyond Classification: Financial Reasoning in State-of-the-Art Language Models
  3. 2026IndiaFinBench: An Evaluation Benchmark for Large Language Model Performance on Indian Financial Regulatory Text
  4. 2025FinEval-KR: A Financial Domain Evaluation Framework for Large Language Models' Knowledge and Reasoning
  5. 2024FinBen: A Holistic Financial Benchmark for Large Language Models
  6. 2025XFinBench: Benchmarking LLMs in Complex Financial Problem Solving and Reasoning
  7. 2024FinDABench: Benchmarking Financial Data Analysis Ability of Large Language Models
  8. 2025Finance Language Model Evaluation (FLaME)