mlsanityData to 14 Oct 2026

Can LLMs Narrate Tabular Data? An Evaluation Framework for Natural Language Representations of Text-to-SQL System Outputs

arXiv 2510.23854 ↗First posted 27 Oct 2025cs.CL cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

In modern industry systems like multi-turn chat agents, Text-to-SQL technology bridges natural language (NL) questions and database (DB) querying. The conversion of tabular DB results into NL representations (NLRs) enables the chat-based interaction. Currently, NLR generation is typically handled by large language models (LLMs), but information loss or errors in presenting tabular results in NL remains largely unexplored. This paper introduces a novel evaluation method - Combo-Eval - for judgment of LLM-generated NLRs that combines the benefits of multiple existing methods, optimizing evaluation fidelity and achieving a significant reduction in LLM calls by 25-61%. Accompanying our method is NLR-BIRD, the first dedicated dataset for NLR benchmarking. Through human evaluations, we demonstrate the superior alignment of Combo-Eval with human judgments, applicable across scenarios with and without ground truth references.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 35 of its 63 references that are in the map. First posted on arXiv 27 Oct 2025.

Builds on

35 of 63 references.

References · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2024A Survey on LLM-as-a-Judgecited by 1,423
  4. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 688
  5. 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 477
  6. 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 268
  7. 2024CodeS: Towards Building Open-source Language Models for Text-to-SQLcited by 187
  8. 2021FeTaQA: Free-form Table Question Answeringcited by 175
  9. 2024CHESS: Contextual Harnessing for Efficient SQL Synthesiscited by 169
  10. 2023C3: Zero-shot Text-to-SQL with ChatGPTcited by 164
  11. 2024Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessmentcited by 126
  12. 2024Synthesizing Text-to-SQL Data from Weak and Strong LLMscited by 54
23 more
  1. 2023BotChat: Evaluating LLMs' Capabilities of Having Multi-Turn Dialoguescited by 34
  2. 2024Understanding the Effects of Noise in Text-to-SQL: An Examination of the BIRD-Bench Benchmarkcited by 34
  3. 2024Text2SQL is Not Enough: Unifying AI and Databases with TAGcited by 34
  4. 2024Is Table Retrieval a Solved Problem? Exploring Join-Aware Multi-Table Retrievalcited by 27
  5. 2024A Survey on Recent Advances in Conversational Data Generationcited by 23
  6. 2023Text-to-SQL Error Correction with Language Models of Codecited by 21
  7. 2023Interactive Text-to-SQL Generation via Editable Step-by-Step Explanationscited by 19
  8. 2024Survey of Large Multimodal Model Datasets, Application Categories and Taxonomycited by 17
  9. 2023SQLPrompt: In-Context Text-to-SQL with Minimal Labeled Datacited by 16
  10. 2025SweEval: Do LLMs Really Swear? A Safety Benchmark for Testing Limits for Enterprise Usecited by 15
  11. 2025Hard Negative Mining for Domain-Specific Retrieval in Enterprise Systemscited by 14
  12. 2023Error Detection for Text-to-SQL Semantic Parsingcited by 12
  13. 2024LLM for Barcodes: Generating Diverse Synthetic Data for Identity Documentscited by 12
  14. 2025Tuning LLM Judge Design Decisions for 1/1000 of the Costcited by 11
  15. 2025Aligning LLMs for Multilingual Consistency in Enterprise Applicationscited by 11
  16. 2023DBCopilot: Natural Language Querying over Massive Databases via Schema Routingcited by 10
  17. 2025FS-DAG: Few Shot Domain Adapting Graph Networks for Visually Rich Document Understandingcited by 10
  18. 2025DAIQ: Auditing Demographic Attribute Inference from Question in LLMscited by 10
  19. 2022Augmenting Multi-Turn Text-to-SQL Datasets with Self-Playcited by 9
  20. 2025Hybrid AI for Responsive Multi-Turn Online Conversations with Novel Dynamic Routing and Feedback Adaptationcited by 6
  21. 2025Who's Asking? Investigating Bias Through the Lens of Disability Framed Queries in LLMscited by 6
  22. 2025SpeechWeave: Diverse Multilingual Synthetic Text & Audio Data Generation Pipeline for Training Text to Speech Modelscited by 5
  23. 2024TCSR-SQL: Towards Table Content-aware Text-to-SQL with Self-retrievalcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

  1. 2026JTPRO: A Joint Tool-Prompt Reflective Optimization Framework for Language Agentscited by 4
  2. 2026Barriers to Discrete Reasoning with Transformers: A Survey Across Depth, Exactness, and Bandwidthcited by 3
  3. 2026MT-OSC: Path for LLMs that Get Lost in Multi-Turn Conversationcited by 2
  4. 2026GSM-SEM: Benchmark and Framework for Generating Semantically Variant Augmentationscited by 2
  5. 2026Do Image-Text Metrics Respect Semantic Invariances?cited by 2
  6. 2026DiffuMask: Diffusion Language Model for Token-level Prompt Pruningcited by 1
  7. 2026SPENCE: A Syntactic Probe for Detecting Contamination in NL2SQL Benchmarkscited by 0