mlsanityData to 14 Oct 2026

Recognition Is Not Grounding: Benchmarking Multilingual Financial Evidence Extraction

arXiv 2610.19432 ↗First posted 14 Oct 2026cs.AI cs.CEcited by 0

Not on the map. Why?

Abstract (arXiv)

Comparing financial disclosures across languages requires identifying shared accounting concepts and recovering all numerical facts that express them. Existing benchmarks evaluate aspects of these capabilities, but provide limited insight into whether both succeed on the same multilingual evidence. In particular, it remains unclear whether language models can recognize these concepts across languages and exhaustively recover their corresponding numerical evidence from the same contexts. We introduce MULTIFINGROUND, a benchmark designed to investigate this recognition-grounding gap in multilingual financial reports. Constructed from FY2025 disclosures of 90 issuers in English, French, and Greek, MULTIFINGROUND aligns independently authored reports through a shared accounting taxonomy and provides traceable fact-level annotations. The benchmark evaluates financial fact identification, concept recognition, exhaustive fact selection, and concept discrimination without candidate labels. Across 15 evaluated models, eight API and open-weight reference models achieve 97.3-99.4% concept recognition accuracy, yet miss at least one target fact in 26.6-41.9% of correctly recognized groups. Further analyses reveal substantial variation in concept discrimination and limited gains from the evaluated finance-specialized models. Our findings demonstrate that strong concept recognition can coexist with incomplete evidence recovery, highlighting the importance of evaluating semantic recognition and evidence completeness together.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 26 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

15 of 26 references.

References · 15

  1. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  2. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  3. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
  4. 2021XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluationcited by 168
  5. 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 121
  6. 2026DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compressioncited by 76
  7. 2024DocFinQA: A Long-Context Financial Reasoning Datasetcited by 60
  8. 2022FiNER: Financial Numeric Entity Recognition for XBRL Taggingcited by 50
  9. 2025Fino1: On the Transferability of Reasoning-Enhanced LLMs and Reinforcement Learning to Financecited by 35
  10. 2025Plutus: Benchmarking Large Language Models in Low-Resource Greek Financecited by 18
  11. 2025Krikri: Advancing Open Large Language Models for Greekcited by 14
  12. 2023Financial Numeric Extreme Labelling: A Dataset and Benchmarking for XBRL Taggingcited by 12
3 more
  1. 2025Hierarchical Retrieval with Evidence Curation for Open-Domain Financial Question Answering on Standardized Documentscited by 5
  2. 2024Parameter-Efficient Instruction Tuning of Large Language Models For Extreme Financial Numeral Labellingcited by 4
  3. 2026Unlocking Data Value in Finance: A Study on Distillation and Difficulty-Aware Trainingcited by 4

Built on by

Not cited yet.