mlsanityData to 7 Oct 2026

Which course? Discourse! Teaching Discourse and Generation in the Era of LLMs

arXiv 2602.02878 ↗First posted 2 Feb 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The field of NLP has undergone vast, continuous transformations over the past few years, sparking debates going beyond discipline boundaries. This begs important questions in education: how do we design courses that bridge sub-disciplines in this shifting landscape? This paper explores this question from the angle of discourse processing, an area with rich linguistic insights and computational models for the intentional, attentional, and coherence structure of language. Discourse is highly relevant for open-ended or long-form text generation, yet this connection is under-explored in existing undergraduate curricula. We present a new course, "Computational Discourse and Natural Language Generation". The course is collaboratively designed by a team with complementary expertise and was offered for the first time in Fall 2025 as an upper-level undergraduate course, cross-listed between Linguistics and Computer Science. Our philosophy is to deeply integrate the theoretical and empirical aspects, and create an exploratory mindset inside the classroom and in the assignments. This paper describes the course in detail and concludes with takeaways from an independent survey as well as our vision for future directions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 50 of its 87 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

50 of 87 references.

References · 50

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2020Scaling Laws for Neural Language Modelscited by 6,411
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  6. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  7. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  8. 2020Learning to summarize from human feedbackcited by 2,562
  9. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
  10. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
  11. 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 553
  12. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 417
38 more
  1. 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 416
  2. 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
  3. 2016Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependenciescited by 350
  4. 2021Recursively Summarizing Books with Human Feedbackcited by 287
  5. 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 251
  6. 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 236
  7. 2021Implicit Representations of Meaning in Neural Language Modelscited by 179
  8. 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 168
  9. 2019Neural Language Models as Psycholinguistic Subjects: Representations of Syntactic Statecited by 137
  10. 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
  11. 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 137
  12. 2019Discourse-Aware Neural Extractive Text Summarizationcited by 104
  13. 2025The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMscited by 72
  14. 2023Factually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedbackcited by 71
  15. 2022minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Modelscited by 58
  16. 2025How Linguistics Learned to Stop Worrying and Love the Language Modelscited by 50
  17. 2025Large Language Model Hacking: Quantifying the Hidden Risks of Using LLMs for Text Annotationcited by 43
  18. 2022ClarifyDelphi: Reinforced Clarification Questions with Defeasibility Rewards for Social and Moral Situationscited by 36
  19. 2022DiscoScore: Evaluating Text Generation with BERT and Discourse Coherencecited by 35
  20. 2020QADiscourse -- Discourse Relations as QA Pairs: Representation, Crowdsourcing and Baselinescited by 34
  21. 2025Pixels Versus Priors: Controlling Knowledge Priors in Vision-Language Models through Visual Counterfactscited by 30
  22. 2025Finding Flawed Fictions: Evaluating Complex Reasoning in Language Models via Plot Hole Detectioncited by 24
  23. 2021Discourse Comprehension: A Question Answering Framework to Represent Sentence Connectionscited by 19
  24. 2022How Do We Answer Complex Questions: Discourse Structure of Long-form Answerscited by 19
  25. 2023QUDEVAL: The Evaluation of Questions Under Discussion Discourse Parsingcited by 19
  26. 2021Pragmatic competence of pre-trained language models through the lens of discourse connectivescited by 16
  27. 2021Is Incoherence Surprising? Targeted Evaluation of Coherence Prediction from Language Modelscited by 15
  28. 2025PrefPalette: Personalized Preference Modeling with Latent Attributescited by 15
  29. 2023Elaborative Simplification as Implicit Questions Under Discussioncited by 14
  30. 2024InfoLossQA: Characterizing and Recovering Information Loss in Text Simplificationcited by 14
  31. 2025QUDsim: Quantifying Discourse Similarities in LLM-Generated Textcited by 13
  32. 2025Behavioral Analysis of Information Salience in Large Language Modelscited by 11
  33. 2024Which questions should I answer? Salience Prediction of Inquisitive Questionscited by 8
  34. 2025Frankentext: Stitching random text fragments into long-form narrativescited by 8
  35. 2025GUM-SAGE: A Novel Dataset and Approach for Graded Entity Salience Predictioncited by 6
  36. 2024Explicating the Implicit: Argument Detection Beyond Sentence Boundariescited by 4
  37. 2025Explanatory Summarization with Discourse-Driven Planningcited by 4
  38. 2025Is It JUST Semantics? A Case Study of Discourse Particle Understanding in LLMscited by 3

Built on by

Not cited yet.