Sticking to the Facts: Confident Decoding for Faithful Data-to-Text Generation
Not on the map. Why?
Abstract (arXiv)
We address the issue of hallucination in data-to-text generation, i.e., reducing the generation of text that is unsupported by the source. We conjecture that hallucination can be caused by an encoder-decoder model generating content phrases without attending to the source; so we propose a confidence score to ensure that the model attends to the source whenever necessary, as well as a variational Bayes training framework that can learn the score from data. Experiments on the WikiBio (Lebretet al., 2016) dataset show that our approach is more faithful to the source than existing state-of-the-art approaches, according to both PARENT score (Dhingra et al., 2019) and human evaluation. We also report strong results on the WebNLG (Gardent et al., 2017) dataset.
Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 19; 2022: 9; 2023: 18; 2024: 12; 2025: 3.
62 papers.
Sort:
By area:
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2023Challenges and Applications of Large Language Modelscited by 251
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
- 2023A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generationcited by 202
- 2021On Hallucination and Predictive Uncertainty in Conditional Language Generationcited by 176
- 2021Hurdles to Progress in Long-form Question Answeringcited by 166
- 2021A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generationcited by 137
- 2021Annotating and Modeling Fine-grained Factuality in Summarizationcited by 131
- 2021Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Groundingcited by 106
- 2024HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detectioncited by 96
- 2021Evaluating Attribution in Dialogue Systems: The BEGIN Benchmarkcited by 75
38 more
- 2023Exposing Attention Glitches with Flip-Flop Language Modelingcited by 74
- 2023On the Calibration of Large Language Models and Alignmentcited by 72
- 2023Mitigating Large Language Model Hallucinations via Autonomous Knowledge Graph-based Retrofittingcited by 70
- 2020Text Generation by Learning from Demonstrationscited by 64
- 2025Large Language Models Hallucination: A Comprehensive Surveycited by 45
- 2022Conditional Generation with a Question-Answering Blueprintcited by 44
- 2023Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decodercited by 44
- 2024Hallucination Detection: Robustly Discerning Reliable Answers in Large Language Modelscited by 44
- 2023SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluationcited by 42
- 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
- 2021Data-to-text Generation with Macro Planningcited by 34
- 2024AI Hallucinations: A Misnomer Worth Clarifyingcited by 34
- 2023Teaching Language Models to Hallucinate Less with Synthetic Taskscited by 31
- 2021Focus Attention: Promoting Faithfulness and Diversity in Summarizationcited by 30
- 2024KnowPhish: Large Language Models Meet Multimodal Knowledge Graphs for Enhancing Reference-Based Phishing Detectioncited by 29
- 2022Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methodscited by 27
- 2023On Diversified Preferences of Large Language Model Alignmentcited by 26
- 2021Towards Faithfulness in Open Domain Table-to-text Generation from an Entity-centric Viewcited by 24
- 2021Logic-Consistency Text Generation from Semantic Parsescited by 23
- 2022Don't Say What You Don't Know: Improving the Consistency of Abstractive Summarization by Constraining Beam Searchcited by 23
- 2021Sketch and Refine: Towards Faithful and Informative Table-to-Text Generationcited by 21
- 2022Towards Tracing Factual Knowledge in Language Models Back to the Training Datacited by 21
- 2024Language Models in Dialogue: Conversational Maxims for Human-AI Interactionscited by 21
- 2021SynthBio: A Case Study in Human-AI Collaborative Curation of Text Datasetscited by 18
- 2024Towards Reliable Medical Question Answering: Techniques and Challenges in Mitigating Hallucinations in Language Modelscited by 15
- 2021DYPLOC: Dynamic Planning of Content Using Mixed Language Models for Text Generationcited by 11
- 2021Truth-Conditional Captioning of Time Series Datacited by 11
- 2021Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attributioncited by 10
- 2021AgreeSum: Agreement-Oriented Multi-Document Summarizationcited by 10
- 2022Innovations in Neural Data-to-text Generation: A Surveycited by 10
- 2022Generating Full Length Wikipedia Biographies: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographiescited by 7
- 2024The Effects of Hallucinations in Synthetic Training Data for Relation Extractioncited by 7
- 2022Query Expansion Using Contextual Clue Sampling with Language Modelscited by 5
- 2023Sequence-Level Certainty Reduces Hallucination In Knowledge-Grounded Dialogue Generationcited by 5
- 2025SCOPE: A Self-supervised Framework for Improving Faithfulness in Conditional Text Generationcited by 5
- 2025CLATTER: Comprehensive Entailment Reasoning for Hallucination Detectioncited by 5
- 2023Towards Table-to-Text Generation with Pretrained Language Model: A Table Structure Understanding and Text Deliberating Approachcited by 4
- 2023Generating Faithful Text From a Knowledge Graph with Noisy Reference Textcited by 4
50 most cited of 62 All 62 (JSON)
- 2025Large Language Models Hallucination: A Comprehensive Survey5 Oct 2025
- 2025CLATTER: Comprehensive Entailment Reasoning for Hallucination Detection5 Jun 2025
- 2025SCOPE: A Self-supervised Framework for Improving Faithfulness in Conditional Text Generation19 Feb 2025
- 2024An Extensive Evaluation of Factual Consistency in Large Language Models for Data-to-Text Generation28 Nov 2024
- 2024Do Robot Snakes Dream like Electric Sheep? Investigating the Effects of Architectural Inductive Biases on Hallucination22 Oct 2024
- 2024The Effects of Hallucinations in Synthetic Training Data for Relation Extraction10 Oct 2024
- 2024HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detection26 Sep 2024
- 2024Towards Reliable Medical Question Answering: Techniques and Challenges in Mitigating Hallucinations in Language Models25 Aug 2024
- 2024No Size Fits All: The Perils and Pitfalls of Leveraging LLMs Vary with Company Size21 Jul 2024
- 2024Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigation19 Jul 2024
- 2024Hallucination Detection: Robustly Discerning Reliable Answers in Large Language Models4 Jul 2024
- 2024Confidence-Aware Sub-Structure Beam Search (CABS): Mitigating Hallucination in Structured Data Generation with Large Language Models30 May 2024
38 more
- 2024Language Models in Dialogue: Conversational Maxims for Human-AI Interactions22 Mar 2024
- 2024KnowPhish: Large Language Models Meet Multimodal Knowledge Graphs for Enhancing Reference-Based Phishing Detection4 Mar 2024
- 2024AI Hallucinations: A Misnomer Worth Clarifying9 Jan 2024
- 2023On Diversified Preferences of Large Language Model Alignment12 Dec 2023
- 2023Mitigating Large Language Model Hallucinations via Autonomous Knowledge Graph-based Retrofitting22 Nov 2023
- 2023On the Calibration of Large Language Models and Alignment22 Nov 2023
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions9 Nov 2023
- 2023Blending Reward Functions via Few Expert Demonstrations for Faithful and Accurate Knowledge-Grounded Dialogue Generation2 Nov 2023
- 2023Sequence-Level Certainty Reduces Hallucination In Knowledge-Grounded Dialogue Generation28 Oct 2023
- 2023Automatic Logical Forms improve fidelity in Table-to-Text generation26 Oct 2023
- 2023Correction with Backtracking Reduces Hallucination in Summarization24 Oct 2023
- 2023Teaching Language Models to Hallucinate Less with Synthetic Tasks10 Oct 2023
- 2023Generating Faithful Text From a Knowledge Graph with Noisy Reference Text12 Aug 2023
- 2023Challenges and Applications of Large Language Models19 Jul 2023
- 2023A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generation8 Jul 2023
- 2023Knowledge Graph for NLG in the context of conversational agents4 Jul 2023
- 2023Exposing Attention Glitches with Flip-Flop Language Modeling1 Jun 2023
- 2023Mastering the ABCDs of Complex Questions: Answer-Based Claim Decomposition for Fine-grained Self-Evaluation24 May 2023
- 2023SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluation22 May 2023
- 2023Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decoder8 Apr 2023
- 2023Towards Table-to-Text Generation with Pretrained Language Model: A Table Structure Understanding and Text Deliberating Approach5 Jan 2023
- 2022Query Expansion Using Contextual Clue Sampling with Language Models13 Oct 2022
- 2022Informative Text Generation from Knowledge Triples26 Sep 2022
- 2022Innovations in Neural Data-to-text Generation: A Survey25 Jul 2022
- 2022Conditional Generation with a Question-Answering Blueprint1 Jul 2022
- 2022Towards Tracing Factual Knowledge in Language Models Back to the Training Data23 May 2022
- 2022Generating Full Length Wikipedia Biographies: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographies12 Apr 2022
- 2022Don't Say What You Don't Know: Improving the Consistency of Abstractive Summarization by Constraining Beam Search16 Mar 2022
- 2022Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods10 Mar 2022
- 2022Survey of Hallucination in Natural Language Generation8 Feb 2022
- 2021SynthBio: A Case Study in Human-AI Collaborative Curation of Text Datasets11 Nov 2021
- 2021Truth-Conditional Captioning of Time Series Data5 Oct 2021
- 2021Logic-Consistency Text Generation from Semantic Parses2 Aug 2021
- 2021AgreeSum: Agreement-Oriented Multi-Document Summarization4 Jun 2021
- 2021Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution3 Jun 2021
- 2021DYPLOC: Dynamic Planning of Content Using Mixed Language Models for Text Generation1 Jun 2021
- 2021Sketch and Refine: Towards Faithful and Informative Table-to-Text Generation31 May 2021
- 2021Focus Attention: Promoting Faithfulness and Diversity in Summarization25 May 2021
50 newest of 62 All 62 (JSON)
- 2020Text Generation by Learning from Demonstrationscited by 64
- 2020Text Generation by Learning from Demonstrations16 Sep 2020
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2023Challenges and Applications of Large Language Modelscited by 251
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
- 2023A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generationcited by 202
- 2021On Hallucination and Predictive Uncertainty in Conditional Language Generationcited by 176
- 2021Hurdles to Progress in Long-form Question Answeringcited by 166
- 2021A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generationcited by 137
- 2021Annotating and Modeling Fine-grained Factuality in Summarizationcited by 131
- 2021Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Groundingcited by 106
- 2024HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detectioncited by 96
- 2021Evaluating Attribution in Dialogue Systems: The BEGIN Benchmarkcited by 75
12 most cited of 58 All 58 (JSON)
- 2025Large Language Models Hallucination: A Comprehensive Survey5 Oct 2025
- 2025SCOPE: A Self-supervised Framework for Improving Faithfulness in Conditional Text Generation19 Feb 2025
- 2024An Extensive Evaluation of Factual Consistency in Large Language Models for Data-to-Text Generation28 Nov 2024
- 2024Do Robot Snakes Dream like Electric Sheep? Investigating the Effects of Architectural Inductive Biases on Hallucination22 Oct 2024
- 2024The Effects of Hallucinations in Synthetic Training Data for Relation Extraction10 Oct 2024
- 2024HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detection26 Sep 2024
- 2024Towards Reliable Medical Question Answering: Techniques and Challenges in Mitigating Hallucinations in Language Models25 Aug 2024
- 2024No Size Fits All: The Perils and Pitfalls of Leveraging LLMs Vary with Company Size21 Jul 2024
- 2024Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigation19 Jul 2024
- 2024Hallucination Detection: Robustly Discerning Reliable Answers in Large Language Models4 Jul 2024
- 2024Confidence-Aware Sub-Structure Beam Search (CABS): Mitigating Hallucination in Structured Data Generation with Large Language Models30 May 2024
- 2024Language Models in Dialogue: Conversational Maxims for Human-AI Interactions22 Mar 2024
12 newest of 58 All 58 (JSON)