mlsanityData to 7 Oct 2026

Text2Analysis: A Benchmark of Table Question Answering with Advanced Data Analysis and Unclear Queries

arXiv 2312.13671 ↗First posted 21 Dec 2023cs.CL cs.LGcited by 38

Not on the map. Why?

Abstract (arXiv)

Tabular data analysis is crucial in various fields, and large language models show promise in this area. However, current research mostly focuses on rudimentary tasks like Text2SQL and TableQA, neglecting advanced analysis like forecasting and chart generation. To address this gap, we developed the Text2Analysis benchmark, incorporating advanced analysis tasks that go beyond the SQL-compatible operations and require more in-depth analysis. We also develop five innovative and effective annotation methods, harnessing the capabilities of large language models to enhance data quality and quantity. Additionally, we include unclear queries that resemble real-world user questions to test how well models can understand and tackle such challenges. Finally, we collect 2249 query-result pairs with 347 tables. We evaluate five state-of-the-art models using three different metrics and the results show that our benchmark presents introduces considerable challenge in the field of tabular data analysis, paving the way for more advanced research opportunities.

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 10 of its 23 references that are in the map. First posted on arXiv 21 Dec 2023.

Builds on

10 of 23 references.

References · 10

  1. 2023StarCoder: may the source be with you!cited by 790
  2. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
  3. 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
  4. 2021TAPEX: Table Pre-training via Learning a Neural SQL Executorcited by 233
  5. 2023Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoningcited by 177
  6. 2016Language to Logical Form with Neural Attentioncited by 158
  7. 2023CodeGen2: Lessons for Training LLMs on Programming and Natural Languagescited by 124
  8. 2023Demonstration of InsightPilot: An LLM-Empowered Automated Data Exploration Systemcited by 20
  9. 2020Table2Charts: Recommending Charts by Learning Shared Table Representationscited by 14
  10. 2021A flexible forecasting model for production systemscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 18; 2025: 15; 2026: 5.

38 papers.

Sort:

By area:

  1. 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoningcited by 127
  2. 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 127
  3. 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
  4. 2025DataSciBench: An LLM Agent Benchmark for Data Sciencecited by 53
  5. 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 38
  6. 2024DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Modelscited by 34
  7. 2025Large Language Model-based Data Science Agent: A Surveycited by 22
  8. 2025nvAgent: Automated Data Visualization from Natural Language via Collaborative Agent Workflowcited by 21
  9. 2024LightVA: Lightweight Visual Analytics with LLM Agent-Based Task Planning and Executioncited by 20
  10. 2024Tapilot-Crossing: Benchmarking and Evolving LLMs Towards Interactive Data Analysis Agentscited by 17
  11. 2024PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queriescited by 17
  12. 2024TQA-Bench: Evaluating LLMs for Multi-Table Question Answeringcited by 17
26 more
  1. 2025nvBench 2.0: Resolving Ambiguity in Text-to-Visualization through Stepwise Reasoningcited by 17
  2. 2024SpreadsheetLLM: Encoding Spreadsheets for Large Language Modelscited by 15
  3. 2025RealHiTBench: A Comprehensive Realistic Hierarchical Table Benchmark for Evaluating LLM-Based Table Analysiscited by 12
  4. 2024TART: An Open-Source Tool-Augmented Framework for Explainable Table-based Reasoningcited by 10
  5. 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challengescited by 10
  6. 2024CoCoST: Automatic Complex Code Generation with Online Searching and Correctness Testingcited by 7
  7. 2026LongDA: Benchmarking LLM Agents for Long-Document Data Analysiscited by 6
  8. 2026DataCross: A Unified Benchmark and Agent Framework for Cross-Modal Heterogeneous Data Analysiscited by 6
  9. 2025Automated Formalization via Conceptual Retrieval-Augmented LLMscited by 5
  10. 2025T2R-bench: A Benchmark for Generating Article-Level Reports from Real World Industrial Tablescited by 5
  11. 2025TableLoRA: Low-rank Adaptation on Table Structure Understanding for Large Language Modelscited by 4
  12. 2025Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluationcited by 4
  13. 2024QUIS: Question-guided Insights Generation for Automated Exploratory Data Analysiscited by 3
  14. 2024RETQA: A Large-Scale Open-Domain Tabular Question Answering Dataset for Real Estate Sectorcited by 3
  15. 2024Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Typescited by 3
  16. 2025Large Language Models for Predictive Analysis: How Far Are They?cited by 3
  17. 2025Formula-R1: Incentivizing LLM Reasoning over Complex Tables with Numerical Computation via Formula-Driven Reinforcement Learningcited by 3
  18. 2024WikiTableEdit: A Benchmark for Table Editing by Natural Language Instructioncited by 2
  19. 2025MDSF: Context-Aware Multi-Dimensional Data Storytelling Framework based on Large language Modelcited by 1
  20. 2024Using ChatGPT for Data Science Analysescited by 0
  21. 2024Extract Information from Hybrid Long Documents Leveraging LLMs: A Framework and Datasetcited by 0
  22. 2025GeoGrid-Bench: Can Foundation Models Understand Multimodal Gridded Geo-Spatial Data?cited by 0
  23. 2025SCARE: A Benchmark for SQL Correction and Question Answerability Classification for Reliable EHR Question Answeringcited by 0
  24. 2026ReCoQA: A Benchmark for Tool-Augmented and Multi-Step Reasoning in Real Estate Question and Answeringcited by 0
  25. 2026Behavioral Intelligence Platforms: From Event Streams to Autonomous Insight via Probabilistic Journey Graphs, Behavioral Knowledge Extraction, and Grounded Language Generationcited by 0
  26. 2026Text Analytics Evaluation Framework: A Case Study on LLMs and Social Mediacited by 0