mlsanityData to 14 Oct 2026

Self- and Pseudo-self-supervised Prediction of Speaker and Key-utterance for Multi-party Dialogue Reading Comprehension

arXiv 2109.03772 ↗First posted 8 Sep 2021cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

Multi-party dialogue machine reading comprehension (MRC) brings tremendous challenge since it involves multiple speakers at one dialogue, resulting in intricate speaker information flows and noisy dialogue contexts. To alleviate such difficulties, previous models focus on how to incorporate these information using complex graph-based modules and additional manually labeled data, which is usually rare in real scenarios. In this paper, we design two labour-free self- and pseudo-self-supervised prediction tasks on speaker and key-utterance to implicitly model the speaker information flows, and capture salient clues in a long dialogue. Experimental results on two benchmark datasets have justified the effectiveness of our method over competitive baselines and current state-of-the-art models.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 33 of its 40 references that are in the map. First posted on arXiv 8 Sep 2021.

Builds on

33 of 40 references.

References · 33

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2017Graph Attention Networkscited by 8,923
  6. 2016Layer Normalizationcited by 5,669
  7. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  8. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  9. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  10. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  11. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  12. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
21 more
  1. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  2. 2015Teaching Machines to Read and Comprehendcited by 1,049
  3. 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 861
  4. 2018CoQA: A Conversational Question Answering Challengecited by 683
  5. 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 186
  6. 2015The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systemscited by 172
  7. 2019DREAM: A Challenge Dataset and Models for Dialogue-Based Reading Comprehensioncited by 156
  8. 2020MuTual: A Dataset for Multi-Turn Dialogue Reasoningcited by 115
  9. 2016Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbotscited by 103
  10. 2020Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbotscited by 73
  11. 2020Dialogue-Based Relation Extractioncited by 68
  12. 2018Modeling Multi-turn Conversation with Deep Utterance Aggregationcited by 65
  13. 2020Molweni: A Challenge Multiparty Dialogues-based Machine Reading Comprehension Dataset with Discourse Structurecited by 60
  14. 2015Natural Language Inference by Tree-Based Convolution and Heuristic Matchingcited by 43
  15. 2019GSN: A Graph-Structured Network for Multi-Party Dialoguescited by 26
  16. 2020Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn Dialoguecited by 26
  17. 2020Response Selection for Multi-Party Conversations with Dynamic Topic Trackingcited by 26
  18. 2020Multi-turn Response Selection using Dialogue Dependency Relationscited by 23
  19. 2021DADgraph: A Discourse-aware Dialogue Graph Neural Network for Multiparty Dialogue Machine Reading Comprehensioncited by 16
  20. 2020Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-based Question Answeringcited by 13
  21. 2021Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledgecited by 10

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 3; 2023: 7; 2024: 1; 2025: 1.

13 papers.

Sort:

By area: