Learning Neural Templates for Text Generation
Not on the map. Why?
Abstract (arXiv)
While neural, encoder-decoder models have had significant empirical success in text generation, there remain several unaddressed problems with this style of generation. Encoder-decoder models are largely (a) uninterpretable, and (b) difficult to control in terms of their phrasing or content. This work proposes a neural generation system using a hidden semi-markov model (HSMM) decoder, which learns latent, discrete templates jointly with learning to generate. We show that this model learns useful templates, and that these templates make generation both more interpretable and controllable. Furthermore, we show that this approach scales to real data sets and achieves strong performance nearing that of encoder-decoder text generation models.
Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 18; 2023: 13; 2024: 4; 2025: 1; 2026: 1.
61 papers.
Sort:
By area:
- 2021Large Language Models Can Be Strong Differentially Private Learnerscited by 405
- 2021A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generationcited by 137
- 2021Skill Induction and Planning with Latent Languagecited by 99
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Surveycited by 80
- 2021Planning with Learned Entity Prompts for Abstractive Summarizationcited by 75
- 2021Plan-then-Generate: Controlled Data-to-Text Generation via Planningcited by 52
- 2021Leveraging Language to Learn Program Abstractions and Search Heuristicscited by 44
- 2022Conditional Generation with a Question-Answering Blueprintcited by 44
- 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
- 2021What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarizationcited by 35
- 2023Benchmarking and Improving Text-to-SQL Generation under Ambiguitycited by 31
- 2021Sequence-to-Sequence Learning with Latent Neural Grammarscited by 30
38 more
- 2021Towards Faithfulness in Open Domain Table-to-text Generation from an Entity-centric Viewcited by 24
- 2021Few-Shot Table-to-Text Generation with Prototype Memorycited by 21
- 2022Neural Pipeline for Zero-Shot Data-to-Text Generationcited by 19
- 2021Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Datacited by 17
- 2021BERTifying the Hidden Markov Model for Multi-Source Weakly Supervised Named Entity Recognitioncited by 15
- 2021DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational Transformercited by 14
- 2023Towards Verifiable Text Generation with Symbolic Referencescited by 13
- 2022Learning Non-Autoregressive Models from Search for Unsupervised Sentence Summarizationcited by 12
- 2021GenNI: Human-AI Collaboration for Data-Backed Text Generationcited by 11
- 2023Stylized Data-to-Text Generation: A Case Study in the E-Commerce Domaincited by 11
- 2022Innovations in Neural Data-to-text Generation: A Surveycited by 10
- 2024DiffLM: Controllable Synthetic Data Generation via Diffusion Language Modelscited by 9
- 2021Search and Learn: Improving Semantic Coverage for Data-to-Text Generationcited by 8
- 2023Regeneration Learning: A Learning Paradigm for Data Generationcited by 8
- 2021AGGGEN: Ordering and Aggregating while Generatingcited by 7
- 2023Automatically Summarizing Evidence from Clinical Trials: A Prototype Highlighting Current Challengescited by 7
- 2023LLM Based Multi-Document Summarization Exploiting Main-Event Biased Monotone Submodular Content Extractioncited by 7
- 2022AutoTemplate: A Simple Recipe for Lexically Constrained Text Generationcited by 6
- 2023Improving User Controlled Table-To-Text Generation Robustnesscited by 6
- 2023PixT3: Pixel-based Table-To-Text Generationcited by 6
- 2022Attend, Memorize and Generate: Towards Faithful Table-to-Text Generation in Few Shotscited by 5
- 2023Sequentially Controlled Text Generationcited by 5
- 2021Data-to-text Generation by Splicing Together Nearest Neighborscited by 4
- 2021Automatic Document Sketching: Generating Drafts from Analogous Textscited by 4
- 2022TempLM: Distilling Language Models into Template-Based Generatorscited by 4
- 2022Sparse Conditional Hidden Markov Model for Weakly Supervised Named Entity Recognitioncited by 4
- 2024A Systematic Review of Data-to-Text NLGcited by 4
- 2021Nutribullets Hybrid: Multi-document Health Summarizationcited by 3
- 2024Triples-to-isiXhosa (T2X): Addressing the Challenges of Low-Resource Agglutinative Data-to-Text Generationcited by 3
- 2021Adversarial Machine Learning in Text Analysis and Generationcited by 2
- 2021Scaling Structured Inference with Randomizationcited by 2
- 2022Learning with Latent Structures in Natural Language Processing: A Surveycited by 2
- 2022Learning to Express in Knowledge-Grounded Conversationcited by 2
- 2023Biomembrane-based Memcapacitive Reservoir Computing System for Energy Efficient Temporal Data Processingcited by 2
- 2023Automatic Logical Forms improve fidelity in Table-to-Text generationcited by 2
- 2024Ontology-Free General-Domain Knowledge Graph-to-Text Generation Dataset Synthesis using Large Language Modelcited by 2
- 2021Transforming Multi-Conditioned Generation from Meaning Representationcited by 1
- 2021There Once Was a Really Bad Poet, It Was Automated but You Didn't Know Itcited by 1
50 most cited of 61 All 61 (JSON)
- 2026Characterizing Cultural Localization in AI-Generated Stories12 Jun 2026
- 2025Representing data in words: A context engineering approach27 Jan 2025
- 2024DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models5 Nov 2024
- 2024Ontology-Free General-Domain Knowledge Graph-to-Text Generation Dataset Synthesis using Large Language Model11 Sep 2024
- 2024Triples-to-isiXhosa (T2X): Addressing the Challenges of Low-Resource Agglutinative Data-to-Text Generation12 Mar 2024
- 2024A Systematic Review of Data-to-Text NLG13 Feb 2024
- 2023PixT3: Pixel-based Table-To-Text Generation16 Nov 2023
- 2023Towards Verifiable Text Generation with Symbolic References15 Nov 2023
- 2023Automatic Logical Forms improve fidelity in Table-to-Text generation26 Oct 2023
- 2023Benchmarking and Improving Text-to-SQL Generation under Ambiguity20 Oct 2023
- 2023LLM Based Multi-Document Summarization Exploiting Main-Event Biased Monotone Submodular Content Extraction5 Oct 2023
- 2023Optimizing Non-Autoregressive Transformers with Contrastive Learning23 May 2023
38 more
- 2023Biomembrane-based Memcapacitive Reservoir Computing System for Energy Efficient Temporal Data Processing19 May 2023
- 2023Stylized Data-to-Text Generation: A Case Study in the E-Commerce Domain5 May 2023
- 2023Automatically Summarizing Evidence from Clinical Trials: A Prototype Highlighting Current Challenges7 Mar 2023
- 2023Learning from Multiple Sources for Data-to-Text and Text-to-Data22 Feb 2023
- 2023Improving User Controlled Table-To-Text Generation Robustness20 Feb 2023
- 2023Regeneration Learning: A Learning Paradigm for Data Generation21 Jan 2023
- 2023Sequentially Controlled Text Generation5 Jan 2023
- 2022BotSIM: An End-to-End Bot Simulation Toolkit for Commercial Task-Oriented Dialog Systems29 Nov 2022
- 2022BotSIM: An End-to-End Bot Simulation Framework for Commercial Task-Oriented Dialog Systems22 Nov 2022
- 2022AutoTemplate: A Simple Recipe for Lexically Constrained Text Generation15 Nov 2022
- 2022An Overview on Controllable Text Generation via Variational Auto-Encoders15 Nov 2022
- 2022Mapping Process for the Task: Wikidata Statements to Text as Wikipedia Sentences23 Oct 2022
- 2022Investigating the Robustness of Natural Language Generation from Logical Forms via Counterfactual Samples16 Oct 2022
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey14 Oct 2022
- 2022Continuous Decomposition of Granularity for Neural Paraphrase Generation5 Sep 2022
- 2022Innovations in Neural Data-to-text Generation: A Survey25 Jul 2022
- 2022Towards Neural Numeric-To-Text Generation From Temporal Personal Health Data11 Jul 2022
- 2022Conditional Generation with a Question-Answering Blueprint1 Jul 2022
- 2022Learning Non-Autoregressive Models from Search for Unsupervised Sentence Summarization28 May 2022
- 2022Sparse Conditional Hidden Markov Model for Weakly Supervised Named Entity Recognition27 May 2022
- 2022TempLM: Distilling Language Models into Template-Based Generators23 May 2022
- 2022Learning to Express in Knowledge-Grounded Conversation12 Apr 2022
- 2022Neural Pipeline for Zero-Shot Data-to-Text Generation30 Mar 2022
- 2022Attend, Memorize and Generate: Towards Faithful Table-to-Text Generation in Few Shots1 Mar 2022
- 2022Learning with Latent Structures in Natural Language Processing: A Survey3 Jan 2022
- 2021Scaling Structured Inference with Randomization7 Dec 2021
- 2021Search and Learn: Improving Semantic Coverage for Data-to-Text Generation6 Dec 2021
- 2021GenNI: Human-AI Collaboration for Data-Backed Text Generation19 Oct 2021
- 2021DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational Transformer12 Oct 2021
- 2021Large Language Models Can Be Strong Differentially Private Learners12 Oct 2021
- 2021Skill Induction and Planning with Latent Language4 Oct 2021
- 2021Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Data9 Sep 2021
- 2021Sequence-to-Sequence Learning with Latent Neural Grammars2 Sep 2021
- 2021Plan-then-Generate: Controlled Data-to-Text Generation via Planning31 Aug 2021
- 2021Few-Shot Table-to-Text Generation with Prototype Memory27 Aug 2021
- 2021Leveraging Language to Learn Program Abstractions and Search Heuristics18 Jun 2021
- 2021Automatic Document Sketching: Generating Drafts from Analogous Texts14 Jun 2021
- 2021AGGGEN: Ordering and Aggregating while Generating10 Jun 2021
50 newest of 61 All 61 (JSON)
- 2021Large Language Models Can Be Strong Differentially Private Learnerscited by 405
- 2021A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generationcited by 137
- 2021Skill Induction and Planning with Latent Languagecited by 99
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Surveycited by 80
- 2021Planning with Learned Entity Prompts for Abstractive Summarizationcited by 75
- 2021Plan-then-Generate: Controlled Data-to-Text Generation via Planningcited by 52
- 2021Leveraging Language to Learn Program Abstractions and Search Heuristicscited by 44
- 2022Conditional Generation with a Question-Answering Blueprintcited by 44
- 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
- 2021What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarizationcited by 35
- 2023Benchmarking and Improving Text-to-SQL Generation under Ambiguitycited by 31
- 2021Sequence-to-Sequence Learning with Latent Neural Grammarscited by 30
12 most cited of 58 All 58 (JSON)
- 2026Characterizing Cultural Localization in AI-Generated Stories12 Jun 2026
- 2025Representing data in words: A context engineering approach27 Jan 2025
- 2024Ontology-Free General-Domain Knowledge Graph-to-Text Generation Dataset Synthesis using Large Language Model11 Sep 2024
- 2024Triples-to-isiXhosa (T2X): Addressing the Challenges of Low-Resource Agglutinative Data-to-Text Generation12 Mar 2024
- 2024A Systematic Review of Data-to-Text NLG13 Feb 2024
- 2023PixT3: Pixel-based Table-To-Text Generation16 Nov 2023
- 2023Towards Verifiable Text Generation with Symbolic References15 Nov 2023
- 2023Automatic Logical Forms improve fidelity in Table-to-Text generation26 Oct 2023
- 2023Benchmarking and Improving Text-to-SQL Generation under Ambiguity20 Oct 2023
- 2023LLM Based Multi-Document Summarization Exploiting Main-Event Biased Monotone Submodular Content Extraction5 Oct 2023
- 2023Optimizing Non-Autoregressive Transformers with Contrastive Learning23 May 2023
- 2023Biomembrane-based Memcapacitive Reservoir Computing System for Energy Efficient Temporal Data Processing19 May 2023
12 newest of 58 All 58 (JSON)