mlsanityData to 14 Oct 2026

Discourse-Aware Neural Rewards for Coherent Text Generation

arXiv 1805.03766 ↗First posted 10 May 2018cs.CLcited by 28

Not on the map. Why?

Abstract (arXiv)

In this paper, we investigate the use of discourse-aware rewards with reinforcement learning to guide a model to generate long, coherent text. In particular, we propose to learn neural rewards to model cross-sentence ordering as a means to approximate desired discourse structure. Empirical results demonstrate that a generator trained with the learned reward produces more coherent and less repetitive text than models trained with cross-entropy or with reinforcement learning with commonly used scores as rewards.

Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 May 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 9; 2022: 8; 2023: 6; 2024: 3; 2025: 2.

28 papers.

Sort:

By area:

  1. 2024AutoSurvey: Large Language Models Can Automatically Write Surveyscited by 119
  2. 2021The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generationcited by 97
  3. 2022Faking Fake News for Real Fake News Detection: Propaganda-loaded Training Data Generationcited by 41
  4. 2023ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relationscited by 40
  5. 2022PLANET: Dynamic Content Planning in Autoregressive Transformers for Long-form Text Generationcited by 30
  6. 2021DAGN: Discourse-Aware Graph Network for Logical Reasoningcited by 28
  7. 2022APPDIA: A Discourse-aware Transformer-based Style Transfer Model for Offensive Social Media Conversationscited by 23
  8. 2023DiscoPrompt: Path Prediction Prompt Tuning for Implicit Discourse Relation Recognitioncited by 23
  9. 2022Why is constrained neural language generation particularly challenging?cited by 19
  10. 2021OpenViDial 2.0: A Larger-Scale, Open-Domain Dialogue Generation Dataset with Visual Contextscited by 16
  11. 2021DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational Transformercited by 14
  12. 2023DisCGen: A Framework for Discourse-Informed Counterspeech Generationcited by 14
16 more
  1. 2023Self-Consistent Narrative Prompts on Abductive Natural Language Inferencecited by 11
  2. 2024RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarizationcited by 11
  3. 2021Transferring Knowledge from Text to Video: Zero-Shot Anticipation for Procedural Actionscited by 10
  4. 2024Coherence-Driven Multimodal Safety Dialogue with Active Learning for Embodied Agentscited by 8
  5. 2025AutoSurvey2: Empowering Researchers with Next Level Automated Literature Surveyscited by 8
  6. 2021Learning from Executions for Semantic Parsingcited by 7
  7. 2021Exploring Discourse Structures for Argument Impact Classificationcited by 7
  8. 2021Hallmarks of Human-Machine Collaboration: A framework for assessment in the DARPA Communicating with Computers Programcited by 6
  9. 2023Sequentially Controlled Text Generationcited by 5
  10. 2021Using BERT Encoding and Sentence-Level Language Model for Sentence Orderingcited by 4
  11. 2022Ratatouille: A tool for Novel Recipe Generationcited by 4
  12. 2022Discourse-Aware Graph Networks for Textual Logical Reasoningcited by 2
  13. 2022Recipe Generation from Unsegmented Cooking Videoscited by 2
  14. 2022Plot Writing From Pre-Trained Language Modelscited by 1
  15. 2023Instruct-SCTG: Guiding Sequential Controlled Text Generation through Instructionscited by 1
  16. 2025Fine-Grained Evaluation for Implicit Discourse Relation Recognitioncited by 1