DataCross: A Unified Benchmark and Agent Framework for Cross-Modal Heterogeneous Data Analysis
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
In real-world data science and enterprise decision-making, critical information is often fragmented across directly queryable structured sources (e.g., SQL, CSV) and "zombie data" locked in unstructured visual documents (e.g., scanned reports, invoice images). Existing data analytics agents are predominantly limited to processing structured data, failing to activate and correlate this high-value visual information, thus creating a significant gap with industrial needs. To bridge this gap, we introduce DataCross, a novel benchmark and collaborative agent framework for unified, insight-driven analysis across heterogeneous data modalities. DataCrossBench comprises 200 end-to-end analysis tasks across finance, healthcare, and other domains. It is constructed via a human-in-the-loop reverse-synthesis pipeline, ensuring realistic complexity, cross-source dependency, and verifiable ground truth. The benchmark categorizes tasks into three difficulty tiers to evaluate agents' capabilities in visual table extraction, cross-modal alignment, and multi-step joint reasoning. We also propose the DataCrossAgent framework, inspired by the "divide-and-conquer" workflow of human analysts. It employs specialized sub-agents, each an expert on a specific data source, which are coordinated via a structured workflow of Intra-source Deep Exploration, Key Source Identification, and Contextual Cross-pollination. A novel reReAct mechanism enables robust code generation and debugging for factual verification. Experimental results show that DataCrossAgent achieves a 29.7% improvement in factuality over GPT-4o and exhibits superior robustness on high-difficulty tasks, effectively activating fragmented "zombie data" for insightful, cross-modal analysis.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 13 of its 19 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
13 of 19 references.
Closest ancestors · 4
Same direction, newest first
- 2025DABstep: Data Agent Benchmark for Multi-step Reasoning30 Jun
- 2024InsightBench: Evaluating Business Analytics Agents Through Multi-Step Insight Generation8 Jul
- 2024Benchmarking Data Science Agents27 Feb
- 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks10 Jan
Other references · 9
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022DS-1000: A Natural and Reliable Benchmark for Data Science Code Generationcited by 442
- 2023Text2Analysis: A Benchmark of Table Question Answering with Advanced Data Analysis and Unclear Queriescited by 38
- 2025UNIDOC-BENCH: A Unified Benchmark for Document-Centric Multimodal RAGcited by 18
- 2024MMCTAgent: Multi-modal Critical Thinking Agent Framework for Complex Visual Reasoningcited by 13
- 2025WikiMixQA: A Multimodal Benchmark for Question Answering over Tables and Chartscited by 8
- 2025UniDataBench: Evaluating Data Analytics Agents Across Structured and Unstructured Datacited by 3
- 2025MedInsightBench: Evaluating Medical Analytics Agents Through Multi-Step Insight Discovery in Multimodal Medical Datacited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Workspace-Bench 1.0: Benchmarking AI Agents on Workspace Tasks with Large-Scale File Dependenciescited by 20
- 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysiscited by 4
- 2026LongDS-Bench: On the Failure of Long-Horizon Agentic Data Analysiscited by 4
- 2026DataSpace: Benchmarking Data Agents for Verifiable Analytics over Heterogeneous Workspacescited by 3
- 2026Unsupervised Skill Discovery for Agentic Data Analysiscited by 2
- 2026Fail Loudly: An Auditable Runtime for Agentic Data Analysiscited by 0
- 2026Fail Loudly: An Auditable Runtime for Agentic Data Analysis26 Sep 2026
- 2026DataSpace: Benchmarking Data Agents for Verifiable Analytics over Heterogeneous Workspaces4 Aug 2026
- 2026Unsupervised Skill Discovery for Agentic Data Analysis4 Jun 2026
- 2026LongDS-Bench: On the Failure of Long-Horizon Agentic Data Analysis28 May 2026
- 2026Workspace-Bench 1.0: Benchmarking AI Agents on Workspace Tasks with Large-Scale File Dependencies5 May 2026
- 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis27 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025FDABench: A Benchmark for Data Agents on Analytical Queries over Heterogeneous Data
- 2026DataClawBench: An Agent Benchmark for Exploratory Real-World Financial Data Analysis
- 2026AgenticDataBench: A Comprehensive Benchmark for Data Agents
- 2025A2P-Vis: an Analyzer-to-Presenter Agentic Pipeline for Visual Insights Generation and Reporting
- 2025CoDA: Agentic Systems for Collaborative Data Visualization
- 2026QwenPaw-Data: Bridging Facts, Methodology, and Execution for Autonomous Enterprise Data Analytics
- 2025Data-to-Dashboard: Multi-Agent LLM Framework for Insightful Visualization in Enterprise Analytics
- 2025DataSage: Multi-agent Collaboration for Insight Discovery with External Knowledge Retrieval, Multi-role Debating, and Multi-path Reasoning