EvidenceLens: A Claim-Evidence Matrix for Auditing Financial Question Answering
Not on the map. Why?
Abstract (arXiv)
Large language models are increasingly used to answer questions over annual reports, earnings decks, and analyst notes, yet their outputs remain difficult to verify in high-stakes financial workflows. A fluent answer can blend directly grounded statements, weak synthesis, and unsupported claims across narrative text, tables, and charts. We present EvidenceLens, a visual analytics prototype that treats financial question answering as a claim-evidence alignment problem. The system decomposes an answer into atomic claims, summarizes support composition and confidence, support gaps, and coordinates claim-level inspection with source passages, table cells, and chart regions. Its core visual representation is a multimodal claim-evidence matrix that makes coverage, contradiction, and modality imbalance immediately visible. To support reproducibility, we also specify a JSON-based artifact schema, a lightweight multimodal alignment pipeline, and a deterministic review-priority ranking that maps backend signals into an auditable visual structure. Through representative report-auditing scenarios, we show how EvidenceLens helps analysts distinguish grounded claims from overconfident synthesis that conventional chat interfaces flatten.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
19 of 26 references.
References · 19
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2024How Good (Or Bad) Are LLMs at Detecting Misleading Visualizations?cited by 27
- 2025FinSage: A Multi-aspect RAG System for Financial Filings Question Answeringcited by 19
- 2024Unraveling the Truth: Do VLMs really Understand Charts? A Deep Dive into Consistency and Robustnesscited by 17
- 2020Characterizing Automated Data Insightscited by 12
- 2024How Aligned are Human Chart Takeaways and LLM Predictions? A Case Study on Bar Charts with Varying Layoutscited by 10
- 2025WikiMixQA: A Multimodal Benchmark for Question Answering over Tables and Chartscited by 8
- 2025The Perils of Chart Deception: How Misleading Visualizations Affect Vision-Language Modelscited by 7
- 2025SimVecVis: A Dataset for Enhancing MLLMs in Visualization Understandingcited by 5
- 2025Understanding Why ChatGPT Outperforms Humans in Visualization Design Advicecited by 5
7 more
- 2025Enhancing Large Vision-Language Models with Layout Modality for Table Question Answering on Japanese Annual Securities Reportscited by 4
- 2025Does visualization help AI understand data?cited by 3
- 2025Enhancing XAI Interpretation through a Reverse Mapping from Insights to Visualizationscited by 2
- 2025Reflection on Data Storytelling Tools in the Generative AI Era from the Human-AI Collaboration Perspectivecited by 1
- 2025Challenges & Opportunities with LLM-Assisted Visualization Retargetingcited by 1
- 2025ReVise: A Human-AI Interface for Incremental Algorithmic Recoursecited by 1
- 2025Toward a Logic of Generalization about Visualization as a Decision Aidcited by 1
Built on by
Not cited yet.