mlsanityData to 7 Oct 2026

Overview of FinMMEval 2026 Task 1: Multilingual Financial Multiple-Choice Question Answering

arXiv 2607.19856 ↗First posted 22 Jul 2026cs.CL cs.AI cs.CEcited by 0

Not on the map. Why?

Abstract (arXiv)

FinMMEval 2026 Task 1 evaluates multilingual financial multiple-choice question answering in English, Chinese, Arabic, and Hindi. The task tests whether systems can select the correct answer to finance questions involving domain terminology, numerical interpretation, and conceptual financial reasoning across languages and scripts. The final-test set contains 800 questions, with 200 questions per language; gold answers were withheld during submission, and each language was ranked independently by accuracy. The final leaderboards contain 13 English, 11 Chinese, 11 Arabic, and 10 Hindi ranked submissions. Top accuracies range from 92.0% in Hindi to 97.5% in English and Arabic, with the same leading teams appearing near the top across all four languages. The documented systems used retrieval augmentation, direct answer-option scoring, language-specific prompting, selective self-consistency, confidence checks, and LLM-based review stages.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 23 references that are in the map. First posted on arXiv 22 Jul 2026.

Builds on

12 of 23 references.

References · 12

  1. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
  2. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
  3. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
  4. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 194
  5. 2023The Next Chapter: A Study of Large Language Models in Storytellingcited by 58
  6. 2026FinCARDS: Card-Based Analyst Reranking for Financial Document Question Answeringcited by 16
  7. 2025FinChain: A Symbolic Benchmark for Verifiable Chain-of-Thought Financial Reasoningcited by 15
  8. 2025MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial Applicationcited by 14
  9. 2026RealFin: How Well Do LLMs Reason About Finance When Users Leave Things Unsaid?cited by 9
  10. 2025BhashaBench V1: A Comprehensive Benchmark for the Quadrant of Indic Domainscited by 6
  11. 2026FinReporting: An Agentic Workflow for Localized Reporting of Cross-Jurisdiction Financial Disclosurescited by 5
  12. 2026SAHM: A Benchmark for Arabic Financial and Shari'ah-Compliant Reasoningcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Overview of FinMMEval 2026 Task 2: Multilingual Financial Short-Answer Question Answering
  2. 2026Language-Routed RAG and Direct Option Scoring for Multilingual Financial QA: DS@GT at FinMMEval
  3. 2026FIND: Toward Multimodal Financial Reasoning and Question Answering for Indic Languages
  4. 2025FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation
  5. 2024FinTextQA: A Dataset for Long-form Financial Question Answering
  6. 2024FinLLMs: A Framework for Financial Reasoning Dataset Generation with Large Language Models
  7. 2026FinForge: Semi-Synthetic Financial Benchmark Generation
  8. 2024FinBen: A Holistic Financial Benchmark for Large Language Models