Challenges in Data-to-Document Generation
Not on the map. Why?
Abstract (arXiv)
Recent neural models have shown significant progress on the problem of generating short descriptive texts conditioned on a small number of database records. In this work, we suggest a slightly more difficult data-to-text generation task, and investigate how effective current approaches are on this task. In particular, we introduce a new, large-scale corpus of data records paired with descriptive documents, propose a series of extractive evaluation methods for analyzing performance, and obtain baseline results using current neural generation methods. Experiments show that these models produce fluent text, but fail to convincingly approximate human-generated documents. Moreover, even templated baselines exceed the performance of these neural models on some metrics, though copy- and reconstruction-based extensions lead to noticeable improvements.
Key facts. Cited by 226 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jul 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 51; 2022: 53; 2023: 43; 2024: 30; 2025: 30; 2026: 19.
226 papers.
Sort:
By area:
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2021A Survey of Data Augmentation Approaches for NLPcited by 408
- 2021Measuring Attribution in Natural Language Generation Modelscited by 253
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2022A Contrastive Framework for Neural Text Generationcited by 224
- 2022Factuality Enhanced Language Models for Open-Ended Text Generationcited by 200
- 2021On Hallucination and Predictive Uncertainty in Conditional Language Generationcited by 176
- 2021Hurdles to Progress in Long-form Question Answeringcited by 166
- 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 166
- 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 154
- 2021NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristicscited by 153
38 more
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2022Calibrating Sequence likelihood Improves Conditional Language Generationcited by 121
- 2023From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thoughtcited by 118
- 2021HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generationcited by 117
- 2023VisText: A Benchmark for Semantically Rich Chart Captioningcited by 111
- 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 108
- 2021Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Groundingcited by 106
- 2024LLM-based NLG Evaluation: Current Status and Challengescited by 71
- 2024An Entropy-based Text Watermarking Detection Methodcited by 61
- 2022OpenCQA: Open-ended Question Answering with Chartscited by 60
- 2023DINOISER: Diffused Conditional Sequence Learning by Manipulating Noisescited by 50
- 2021Perturbation CheckLists for Evaluating NLG Evaluation Metricscited by 49
- 2021Text-to-Table: A New Way of Information Extractioncited by 47
- 2022Conditional Generation with a Question-Answering Blueprintcited by 44
- 2023Understanding and Detecting Hallucinations in Neural Machine Translation via Model Introspectioncited by 44
- 2024Multimodal Table Understandingcited by 43
- 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Taskscited by 42
- 2022IndicNLG Benchmark: Multilingual Datasets for Diverse NLG Tasks in Indic Languagescited by 42
- 2023SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluationcited by 42
- 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
- 2024Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sportscited by 41
- 2021FRUIT: Faithfully Reflecting Updated Information in Textcited by 39
- 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenterscited by 38
- 2022Deepfake Text Detection: Limitations and Opportunitiescited by 37
- 2022GEMv2: Multilingual NLG Benchmarking in a Single Line of Codecited by 36
- 2021Data-to-text Generation with Macro Planningcited by 34
- 2021Does the Order of Training Samples Matter? Improving Neural Data-to-Text Generation with Curriculum Learningcited by 34
- 2024AI Hallucinations: A Misnomer Worth Clarifyingcited by 34
- 2024Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extractioncited by 33
- 2021Open Domain Question Answering with A Unified Knowledge Interfacecited by 32
- 2022Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learningcited by 32
- 2023Diving Deep into Modes of Fact Hallucinations in Dialogue Systemscited by 32
- 2021Does Pretraining for Summarization Require Knowledge Transfer?cited by 30
- 2022Using Pre-Trained Language Models for Producing Counter Narratives Against Hate Speech: a Comparative Studycited by 30
- 2023ChartSumm: A Comprehensive Benchmark for Automatic Chart Summarization of Long and Short Summariescited by 30
- 2022ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examplescited by 29
- 2023Elastic Weight Removal for Faithful and Abstractive Dialogue Generationcited by 29
- 2022A Well-Composed Text is Half Done! Composition Sampling for Diverse Conditional Generationcited by 28
50 most cited of 226 All 226 (JSON)
- 2026VERITYGATE: A Four-Gate Schema-Level Faithfulness Framework and Paired Benchmark for Grounded LLM Narrations over Structured Evidence30 Sep 2026
- 2026From Tables to Quantified Statements: Evaluating LLM Inference Generation through Executable Verification21 Sep 2026
- 2026TEAR: Table Extraction with Attribute Recommendation from Texts via Large Language Models14 Sep 2026
- 2026AnalysisBank: An Expert Analysis Pattern Library for Financial Report Generation1 Sep 2026
- 2026Provenance Before Prose: Claim-Locked Reporting for Statistical Text Generation26 Aug 2026
- 2026Cross-Domain, Multi-Task Data-to-Text Generation without In-Domain Training Data24 Aug 2026
- 2026Grounded Normative Rule Generation with Structured Search23 Aug 2026
- 2026A Survey of Large Models in Sports14 Aug 2026
- 2026Beyond Tables: Doc2DB-Bench for Relationally Faithful Document-to-Database Construction9 Aug 2026
- 2026Symphony of Bias: Exploring Gender Associations with Musical Instruments in Multimodal LLMs29 Jul 2026
- 2026EpiNarrate: Agentic Generation of Grounded Narratives from Epidemiological Scenario Projections17 Jul 2026
- 2026Pitwall: Faithful Natural-Language Race-Strategy Briefings from a Calibrated Real-Time Monte Carlo Engine7 Jul 2026
38 more
- 2026Precision Is Not Faithfulness: Coverage-Aware Evaluation of Grounded Generation with a Complete Oracle8 Jun 2026
- 2026Think Fast, Talk Smart: Partitioning Deterministic and Neural Computation for Structured Health Text Generation28 May 2026
- 2026ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Models22 May 2026
- 2026Tree-of-Text: A Tree-based Prompting Framework for Table-to-Text Generation in the Sports Domain29 Apr 2026
- 2026How to Utilize Complementary Vision-Text Information for 2D Structure Understanding17 Mar 2026
- 2026DTBench: A Synthetic Benchmark for Document-to-Table Extraction14 Feb 2026
- 2026Efficient Table Retrieval and Understanding with Multimodal Large Language Models7 Feb 2026
- 2025TabReX : Tabular Referenceless eXplainable Evaluation17 Dec 2025
- 2025Towards Improving Interpretability of Language Model Generation through a Structured Knowledge Discovery Approach28 Nov 2025
- 2025OmniStruct: Universal Text-to-Structure Generation across Diverse Schemas23 Nov 2025
- 2025TabFlash: Efficient Table Understanding with Progressive Question Conditioning and Token Focusing17 Nov 2025
- 2025RUST-BENCH: Benchmarking LLM Reasoning on Unstructured Text within Structured Tables6 Nov 2025
- 2025Input Matters: Evaluating Input Structure's Impact on LLM Summaries of Sports Play-by-Play23 Oct 2025
- 2025Re-evaluating Minimum Bayes Risk Decoding for Automatic Speech Recognition22 Oct 2025
- 2025FreshTab: Sourcing Fresh Data for Table-to-Text Generation Evaluation15 Oct 2025
- 2025Document Intelligence in the Era of Large Language Models: A Survey15 Oct 2025
- 2025Mitigating Hallucination in Multimodal LLMs with Layer Contrastive Decoding29 Sep 2025
- 2025KAHAN: Knowledge-Augmented Hierarchical Analysis and Narration for Financial Data Narration21 Sep 2025
- 2025T2R-bench: A Benchmark for Generating Article-Level Reports from Real World Industrial Tables27 Aug 2025
- 2025Evaluating Structured Decoding for Text-to-Table Generation: Evidence from Three Datasets21 Aug 2025
- 2025Structuring the Unstructured: A Systematic Review of Text-to-Structure Generation for Agentic AI with a Universal Evaluation Framework17 Aug 2025
- 2025TEN: Table Explicitization, Neurosymbolically12 Aug 2025
- 2025LLM driven Text-to-Table Generation through Sub-Tasks Guidance and Iterative Refinement12 Aug 2025
- 2025Commentary Generation for Soccer Highlights11 Aug 2025
- 2025Whither symbols in the era of advanced neural networks?7 Aug 2025
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challenges31 Jul 2025
- 2025Role-Aware Language Models for Secure and Contextualized Access Control in Organizations31 Jul 2025
- 2025Ta-G-T: Subjectivity Capture in Table to Text Generation via RDF Graphs25 Jul 2025
- 2025Data Transformation Strategies to Remove Heterogeneity16 Jul 2025
- 2025Map&Make: Schema Guided Text to Table Generation29 May 2025
- 2025TabXEval: Why this is a Bad Table? An eXhaustive Rubric for Table Evaluation28 May 2025
- 2025The Case for Repeatable, Open, and Expert-Grounded Hallucination Benchmarks in Large Language Models22 May 2025
- 2025The Challenge of Achieving Attributability in Multilingual Table-to-Text Generation with Question-Answer Blueprints29 Mar 2025
- 2025Tgea: An error-annotated dataset and benchmark tasks for text generation from pretrained language models6 Mar 2025
- 2025eC-Tab2Text: Aspect-Based Text Generation from e-Commerce Product Tables20 Feb 2025
- 2025What Really Matters for Table LLMs? A Meta-Evaluation of Model and Data Effects24 Jan 2025
- 2025BiMarker: Enhancing Text Watermark Detection for Large Language Models with Bipolar Watermarks21 Jan 2025
- 2024DataTales: A Benchmark for Real-World Intelligent Data Narration23 Oct 2024
50 newest of 226 All 226 (JSON)
- 2021HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generationcited by 117
- 2022ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examplescited by 29
- 2023Effective Distillation of Table-based Reasoning Ability from LLMscited by 23
- 2025Mitigating Hallucination in Multimodal LLMs with Layer Contrastive Decodingcited by 10
- 2025T2R-bench: A Benchmark for Generating Article-Level Reports from Real World Industrial Tablescited by 5
- 2023Towards Controlled Table-to-Text Generation with Scientific Reasoningcited by 3
- 2025RUST-BENCH: Benchmarking LLM Reasoning on Unstructured Text within Structured Tablescited by 1
- 2026Think Fast, Talk Smart: Partitioning Deterministic and Neural Computation for Structured Health Text Generationcited by 0
- 2026Think Fast, Talk Smart: Partitioning Deterministic and Neural Computation for Structured Health Text Generation28 May 2026
- 2025RUST-BENCH: Benchmarking LLM Reasoning on Unstructured Text within Structured Tables6 Nov 2025
- 2025Mitigating Hallucination in Multimodal LLMs with Layer Contrastive Decoding29 Sep 2025
- 2025T2R-bench: A Benchmark for Generating Article-Level Reports from Real World Industrial Tables27 Aug 2025
- 2023Towards Controlled Table-to-Text Generation with Scientific Reasoning8 Dec 2023
- 2023Effective Distillation of Table-based Reasoning Ability from LLMs22 Sep 2023
- 2022ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples22 Oct 2022
- 2021HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generation15 Aug 2021
- 2025Structuring the Unstructured: A Systematic Review of Text-to-Structure Generation for Agentic AI with a Universal Evaluation Frameworkcited by 2
- 2023Prompting Datasets: Data Discovery with Conversational Agentscited by 1
- 2025OmniStruct: Universal Text-to-Structure Generation across Diverse Schemascited by 0
- 2026EpiNarrate: Agentic Generation of Grounded Narratives from Epidemiological Scenario Projectionscited by 0
- 2026EpiNarrate: Agentic Generation of Grounded Narratives from Epidemiological Scenario Projections17 Jul 2026
- 2025OmniStruct: Universal Text-to-Structure Generation across Diverse Schemas23 Nov 2025
- 2025Structuring the Unstructured: A Systematic Review of Text-to-Structure Generation for Agentic AI with a Universal Evaluation Framework17 Aug 2025
- 2023Prompting Datasets: Data Discovery with Conversational Agents15 Dec 2023
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challengescited by 10
- 2026Efficient Table Retrieval and Understanding with Multimodal Large Language Modelscited by 2
- 2026ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Modelscited by 2
- 2026ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Models22 May 2026
- 2026Efficient Table Retrieval and Understanding with Multimodal Large Language Models7 Feb 2026
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challenges31 Jul 2025
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2021A Survey of Data Augmentation Approaches for NLPcited by 408
- 2021Measuring Attribution in Natural Language Generation Modelscited by 253
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2022A Contrastive Framework for Neural Text Generationcited by 224
- 2022Factuality Enhanced Language Models for Open-Ended Text Generationcited by 200
- 2021On Hallucination and Predictive Uncertainty in Conditional Language Generationcited by 176
- 2021Hurdles to Progress in Long-form Question Answeringcited by 166
- 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 166
- 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 154
- 2021NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristicscited by 153
12 most cited of 205 All 205 (JSON)
- 2026VERITYGATE: A Four-Gate Schema-Level Faithfulness Framework and Paired Benchmark for Grounded LLM Narrations over Structured Evidence30 Sep 2026
- 2026From Tables to Quantified Statements: Evaluating LLM Inference Generation through Executable Verification21 Sep 2026
- 2026TEAR: Table Extraction with Attribute Recommendation from Texts via Large Language Models14 Sep 2026
- 2026AnalysisBank: An Expert Analysis Pattern Library for Financial Report Generation1 Sep 2026
- 2026Provenance Before Prose: Claim-Locked Reporting for Statistical Text Generation26 Aug 2026
- 2026Cross-Domain, Multi-Task Data-to-Text Generation without In-Domain Training Data24 Aug 2026
- 2026Grounded Normative Rule Generation with Structured Search23 Aug 2026
- 2026A Survey of Large Models in Sports14 Aug 2026
- 2026Beyond Tables: Doc2DB-Bench for Relationally Faithful Document-to-Database Construction9 Aug 2026
- 2026Symphony of Bias: Exploring Gender Associations with Musical Instruments in Multimodal LLMs29 Jul 2026
- 2026Pitwall: Faithful Natural-Language Race-Strategy Briefings from a Calibrated Real-Time Monte Carlo Engine7 Jul 2026
- 2026Precision Is Not Faithfulness: Coverage-Aware Evaluation of Grounded Generation with a Complete Oracle8 Jun 2026
12 newest of 205 All 205 (JSON)