mlsanityData to 7 Oct 2026

Advancing Precise Outline-Conditioned Text Generation with Task Duality and Explicit Outline Control

arXiv 2305.14459 ↗First posted 23 May 2023cs.CL cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Existing works on outline-conditioned text generation typically aim to generate text using provided outlines as rough sketches, such as keywords and phrases. However, these approaches make it challenging to control the quality of text generation and assess consistency between outlines and generated texts due to lack of clarity and rationality of the rough outlines. In this paper, we introduce a novel text generation task called Precise Outline-conditioned Generation, which requires generating stories based on specific, sentence-level outlines. To facilitate research on this task, we construct two new datasets, WPOG and CDM. We provide strong baselines based on fine-tuning models such as BART and GPT-2, and evaluating zero-shot performance of models such as ChatGPT and Vicuna. Furthermore, we identify an issue of imbalanced utilization of the outline information in the precise outline-conditioned generation, which is ubiquitously observed across fine-tuned models and zero-shot inference models. To address this issue, we propose an explicit outline utilization control approach and a novel framework that leverages the task duality between summarization and generation. Experimental results show that the proposed approaches effectively alleviate the issue of imbalanced outline utilization and enhance the quality of precise outline-conditioned text generation for both fine-tuning and zero-shot settings.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 30 of its 48 references that are in the map. First posted on arXiv 23 May 2023.

Builds on

30 of 48 references.

References · 30

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  6. 2018Hierarchical Neural Story Generationcited by 1,182
  7. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
  8. 2015Teaching Machines to Read and Comprehendcited by 1,039
  9. 2015Pointer Networkscited by 882
  10. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
  11. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
  12. 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 374
18 more
  1. 2018Plan-And-Write: Towards Better Automatic Storytellingcited by 232
  2. 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
  3. 2019Strategies for Structuring Story Generationcited by 124
  4. 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
  5. 2020PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Trackingcited by 104
  6. 2020Content Planning for Neural Story Generation with Aristotelian Rescoringcited by 92
  7. 2020A Probabilistic Formulation of Unsupervised Text Style Transfercited by 70
  8. 2019Long and Diverse Text Generation with Planning-based Hierarchical Variational Modelcited by 62
  9. 2019Code Generation as a Dual Task of Code Summarizationcited by 62
  10. 2021Plan-then-Generate: Controlled Data-to-Text Generation via Planningcited by 52
  11. 2018Controllable Neural Story Plot Generation via Reward Shapingcited by 49
  12. 2019Topic-Guided Variational Autoencoders for Text Generationcited by 44
  13. 2018A Skeleton-Based Model for Promoting Coherence Among Sentences in Narrative Story Generationcited by 42
  14. 2022DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Generationcited by 30
  15. 2020Summarize, Outline, and Elaborate: Long-Text Generation via Hierarchical Supervision from Extractive Summariescited by 19
  16. 2021GraphPlan: Story Generation by Planning with Event Graphcited by 18
  17. 2020Progressive Generation of Long Text with Pretrained Language Modelscited by 14
  18. 2021Outline to Story: Fine-grained Controllable Story Generation from Cascaded Eventscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 1; 2026: 1.

5 papers.