mlsanityData to 7 Oct 2026

AvalancheBench: Evaluating Enterprise Data Agents Through Latent World Recovery

arXiv 2605.24183 ↗First posted 22 May 2026cs.DB cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce AvalancheBench, a benchmark for evaluating enterprise data agents through latent world recovery. AvalancheBench improves on existing benchmarks in three ways. First, it evaluates analytical understanding rather than pipeline completion: systems are scored on whether they recover the segments, drivers, temporal events, and relationships that explain the data, not merely on whether they execute a workflow or produce a plausible report. Second, it provides ground truth for goal-driven analytics by generating observations from a known latent world, enabling partial credit for incomplete but valid recoveries. Third, it exposes how early analytical mistakes propagate into later conclusions: missed segments, merged events, or wrong attributions can lead to systematically wrong recommendations. In this sense, AvalancheBench complements real-data benchmarks by providing a controlled setting for diagnosing whether agents recover the analytical structure behind enterprise data. On a first e-commerce use case, the strongest configuration of a leading coding agent recovers only 26% of the rubric, with failures concentrated in generic customer segmentations and merged temporal events.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 4 of its 15 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

4 of 15 references.

References · 4

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2025DeepScholar-Bench: A Live Benchmark and Automated Evaluation for Generative Research Synthesiscited by 31
  3. 2025KramaBench: A Benchmark for AI Systems on Data-to-Insight Pipelines over Data Lakescited by 30
  4. 2025Cortex AISQL: A Production SQL Engine for Unstructured Datacited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026ERPBench: A State-Grounded Evaluation Paradigm for Computer-Use Agents in Enterprise Software
  2. 2026DataClawBench: An Agent Benchmark for Exploratory Real-World Financial Data Analysis
  3. 2026EnterpriseClawBench: Benchmarking Agents from Real Workplace Sessions
  4. 2026DI-Bench: Systematically Generating In-Domain Data Intelligence Benchmarks for Enterprise Agents
  5. 2024InsightBench: Evaluating Business Analytics Agents Through Multi-Step Insight Generation
  6. 2025FDABench: A Benchmark for Data Agents on Analytical Queries over Heterogeneous Data
  7. 2025DAComp: Benchmarking Data Agents across the Full Data Intelligence Lifecycle
  8. 2026QwenPaw-Data: Bridging Facts, Methodology, and Execution for Autonomous Enterprise Data Analytics