mlsanityData to 7 Oct 2026

Discourse Coherence in the Wild: A Dataset, Evaluation and Methods

arXiv 1805.04993 ↗First posted 14 May 2018cs.CLcited by 20

Not on the map. Why?

Abstract (arXiv)

To date there has been very little work on assessing discourse coherence methods on real-world data. To address this, we present a new corpus of real-world texts (GCDC) as well as the first large-scale evaluation of leading discourse coherence algorithms. We show that neural models, including two that we introduce here (SentAvg and ParSeq), tend to perform best. We analyze these performance differences and discuss patterns we observed in low coherence texts in four domains.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 May 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 2; 2023: 5; 2024: 4; 2025: 4; 2026: 1.

20 papers.

Sort:

By area:

  1. 2023LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Modelscited by 66
  2. 2022DiscoScore: Evaluating Text Generation with BERT and Discourse Coherencecited by 35
  3. 2025Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challengescited by 31
  4. 2022Model Criticism for Long-Form Text Generationcited by 21
  5. 2021Is Incoherence Surprising? Targeted Evaluation of Coherence Prediction from Language Modelscited by 15
  6. 2021Plot-guided Adversarial Example Construction for Evaluating Open-domain Story Generationcited by 13
  7. 2023CoheSentia: A Novel Benchmark of Incremental versus Holistic Assessment of Coherence in Generated Textscited by 9
  8. 2025Reference-free Evaluation Metrics for Text Generation: A Surveycited by 9
  9. 2021Evaluating Document Coherence Modellingcited by 8
  10. 2024RepEval: Effective Text Evaluation with LLM Representationcited by 6
  11. 2024SkillAggregation: Reference-free LLM-Dependent Aggregationcited by 6
  12. 2023Modeling Structural Similarities between Documents for Coherence Assessment with Graph Convolutional Networkscited by 4
8 more
  1. 2023A Novel Computational and Modeling Foundation for Automatic Coherence Assessmentcited by 4
  2. 2023BBScore: A Brownian Bridge Based Metric for Assessing Text Coherencecited by 4
  3. 2021Transformer Models for Text Coherence Assessmentcited by 3
  4. 2024DECOR: Improving Coherence in L2 English Writing with a Novel Benchmark for Incoherence Detection, Reasoning, and Rewritingcited by 2
  5. 2025Joint Modeling of Entities and Discourse Relations for Coherence Assessmentcited by 2
  6. 2024BBScoreV2: Learning Time-Evolution and Latent Alignment from Stochastic Representationcited by 0
  7. 2025Mass-Scale Analysis of In-the-Wild Conversations Reveals Complexity Bounds on LLM Jailbreakingcited by 0
  8. 2026Does Linguistic Structure Enrichment Enhance Coherence Assessment? Not With Current Architecturescited by 0