UniFinEval: Towards Unified Evaluation of Financial Multimodal Models across Text, Images and Videos
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Multimodal large language models are playing an increasingly significant role in empowering the financial domain, however, the challenges they face, such as multimodal and high-density information and cross-modal multi-hop reasoning, go beyond the evaluation scope of existing multimodal benchmarks. To address this gap, we propose UniFinEval, the first unified multimodal benchmark designed for high-information-density financial environments, covering text, images, and videos. UniFinEval systematically constructs five core financial scenarios grounded in real-world financial systems: Financial Statement Auditing, Company Fundamental Reasoning, Industry Trend Insights, Financial Risk Sensing, and Asset Allocation Analysis. We manually construct a high-quality dataset consisting of 3,767 question-answer pairs in both chinese and english and systematically evaluate 10 mainstream MLLMs under Zero-Shot and CoT settings. Results show that Gemini-3-pro-preview achieves the best overall performance, yet still exhibits a substantial gap compared to financial experts. Further error analysis reveals systematic deficiencies in current models. UniFinEval aims to provide a systematic assessment of MLLMs' capabilities in fine-grained, high-information-density financial environments, thereby enhancing the robustness of MLLMs applications in real-world financial scenarios. Data and code are available at https://github.com/aifinlab/UniFinEval.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 28 of its 51 references that are in the map. First posted on arXiv 9 Jan 2026.
Builds on
28 of 51 references.
Closest ancestors · 7
Same direction, newest first
- 2025FinMR: A Knowledge-Intensive Multimodal Benchmark for Advanced Financial Reasoning9 Oct
- 2025Trading-R1: Financial Trading with LLM Reasoning via Reinforcement Learning14 Sep
- 2025XFinBench: Benchmarking LLMs in Complex Financial Problem Solving and Reasoning20 Aug
- 2025FinMMR: Make Financial Numerical Reasoning More Multimodal, Comprehensive, and Challenging6 Aug
- 2025FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation30 May
- 2024DocFinQA: A Long-Context Financial Reasoning Dataset12 Jan
- 2023FinanceMath: Knowledge-Intensive Math Reasoning in Finance Domains16 Nov
Other references · 21
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 163
- 2024SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehensioncited by 144
- 2024A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalistcited by 137
- 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 77
- 2024MM-Vet v2: A Challenging Benchmark to Evaluate Large Multimodal Models for Integrated Capabilitiescited by 57
- 2024FinTextQA: A Dataset for Long-form Financial Question Answeringcited by 54
- 2024AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Frameworkcited by 47
- 2024Financial Statement Analysis with Large Language Modelscited by 31
- 2023FinVis-GPT: A Multimodal Large Language Model for Financial Chart Analysiscited by 27
- 2023Fin-Fact: A Benchmark Dataset for Multimodal Financial Fact Checking and Explanation Generationcited by 25
- 2024Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation Datasetcited by 23
9 more
- 2024FinReport: Explainable Stock Earnings Forecasting via News Factor Analyzing Modelcited by 11
- 2024StockGPT: A GenAI Model for Stock Prediction and Tradingcited by 11
- 2024DocTabQA: Answering Questions from Long Documents Using Tablescited by 6
- 2025VisFinEval: A Scenario-Driven Chinese Multimodal Benchmark for Holistic Financial Understandingcited by 6
- 2024RiskLabs: Predicting Financial Risk Using Large Language Model based on Multimodal and Multi-Sources Datacited by 4
- 2025VideoConviction: A Multimodal Benchmark for Human Conviction and Stock Market Recommendationscited by 3
- 2025A Survey on Open Dataset Search in the LLM Era: Retrospectives and Perspectivescited by 2
- 2025Unlocking Financial Insights: An advanced Multimodal Summarization with Multimodal Output Framework for Financial Advisory Videoscited by 2
- 2025FinCap: Topic-Aligned Captions for Short-Form Financial YouTube Videoscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Benchmarking Large Vision-Language Models on CFMME: A Comprehensive Chinese Financial Multimodal Evaluation Dataset
- 2025CFBenchmark-MM: Chinese Financial Assistant Benchmark for Multimodal Large Language Model
- 2026FinMTM: A Multi-Turn Multimodal Benchmark for Financial Reasoning and Agent Evaluation
- 2024MME-Finance: A Multimodal Finance Benchmark for Expert-level Understanding and Reasoning
- 2026MM-FinEval: A Multi-Task Multimodal Benchmark for Real-World Financial Forecasting
- 2025FinMMDocR: Benchmarking Financial Multimodal Reasoning with Scenario Awareness, Document Understanding, and Multi-Step Computation
- 2025FinLMM-R1: Enhancing Financial Reasoning in LMM through Scalable Data and Reward Design
- 2024Open-FinLLMs: Open Multimodal Large Language Models for Financial Applications