mlsanityData to 14 Oct 2026

Llamipa: An Incremental Discourse Parser

arXiv 2406.18256 ↗First posted 26 Jun 2024cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

This paper provides the first discourse parsing experiments with a large language model(LLM) finetuned on corpora annotated in the style of SDRT (Segmented Discourse Representation Theory Asher, 1993; Asher and Lascarides, 2003). The result is a discourse parser, Llamipa (Llama Incremental Parser), that leverages discourse context, leading to substantial performance gains over approaches that use encoder-only models to provide local, context-sensitive representations of discourse units. Furthermore, it can process discourse data incrementally, which is essential for the eventual use of discourse information in downstream tasks.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 15 of its 40 references that are in the map. First posted on arXiv 26 Jun 2024.

Builds on

15 of 40 references.

References · 15

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  5. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
  6. 2015The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systemscited by 172
  7. 2018A Deep Sequential Model for Discourse Parsing on Multi-Party Dialoguescited by 38
  8. 2019Modeling Graph Structure in Transformer for Better AMR-to-Text Generationcited by 35
  9. 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Studycited by 24
  10. 2021Improving Multi-Party Dialogue Discourse Parsing via Domain Integrationcited by 14
  11. 2020Unleashing the Power of Neural Discourse Parsers -- A Context and Structure Aware Approach Using Large Scale Pretrainingcited by 5
  12. 2023Discourse Structure Extraction from Pre-Trained and Fine-Tuned Language Models in Dialoguescited by 4
3 more
  1. 2023Structured Dialogue Discourse Parsingcited by 4
  2. 2024Can we obtain significant success in RST discourse parsing by using Large Language Models?cited by 4
  3. 2024Prompting Implicit Discourse Relation Annotationcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.

  1. 2025Multi-Party Conversational Agents: A Surveycited by 7
  2. 2025Towards Actionable Pedagogical Feedback: A Multi-Perspective Analysis of Mathematics Teaching and Tutoring Dialoguecited by 2
  3. 2025DIMSUM: Discourse in Mathematical Reasoning as a Supervision Modulecited by 1
  4. 2025On the Influence of Discourse Relations in Persuasive Textscited by 0