Self- and Pseudo-self-supervised Prediction of Speaker and Key-utterance for Multi-party Dialogue Reading Comprehension
Not on the map. Why?
Abstract (arXiv)
Multi-party dialogue machine reading comprehension (MRC) brings tremendous challenge since it involves multiple speakers at one dialogue, resulting in intricate speaker information flows and noisy dialogue contexts. To alleviate such difficulties, previous models focus on how to incorporate these information using complex graph-based modules and additional manually labeled data, which is usually rare in real scenarios. In this paper, we design two labour-free self- and pseudo-self-supervised prediction tasks on speaker and key-utterance to implicitly model the speaker information flows, and capture salient clues in a long dialogue. Experimental results on two benchmark datasets have justified the effectiveness of our method over competitive baselines and current state-of-the-art models.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 33 of its 40 references that are in the map. First posted on arXiv 8 Sep 2021.
Builds on
33 of 40 references.
References · 33
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2017Graph Attention Networkscited by 8,854
- 2016Layer Normalizationcited by 5,579
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
21 more
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2015Teaching Machines to Read and Comprehendcited by 1,039
- 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
- 2018CoQA: A Conversational Question Answering Challengecited by 674
- 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 184
- 2015The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systemscited by 172
- 2019DREAM: A Challenge Dataset and Models for Dialogue-Based Reading Comprehensioncited by 156
- 2020MuTual: A Dataset for Multi-Turn Dialogue Reasoningcited by 114
- 2016Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbotscited by 103
- 2020Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbotscited by 73
- 2020Dialogue-Based Relation Extractioncited by 68
- 2018Modeling Multi-turn Conversation with Deep Utterance Aggregationcited by 65
- 2020Molweni: A Challenge Multiparty Dialogues-based Machine Reading Comprehension Dataset with Discourse Structurecited by 60
- 2015Natural Language Inference by Tree-Based Convolution and Heuristic Matchingcited by 42
- 2019GSN: A Graph-Structured Network for Multi-Party Dialoguescited by 26
- 2020Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn Dialoguecited by 26
- 2020Response Selection for Multi-Party Conversations with Dynamic Topic Trackingcited by 26
- 2020Multi-turn Response Selection using Dialogue Dependency Relationscited by 23
- 2021DADgraph: A Discourse-aware Dialogue Graph Neural Network for Multiparty Dialogue Machine Reading Comprehensioncited by 16
- 2020Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-based Question Answeringcited by 13
- 2021Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledgecited by 10
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 7; 2024: 1; 2025: 1.
13 papers.
Sort:
By area:
- 2023Multi-level Contrastive Learning for Script-based Character Understandingcited by 15
- 2021Enhanced Speaker-aware Multi-party Multi-turn Dialogue Comprehensioncited by 13
- 2022Back to the Future: Bidirectional Information Decoupling Network for Multi-turn Dialogue Modelingcited by 7
- 2023EM Pre-training for Multi-party Dialogue Response Generationcited by 7
- 2023Multi-Granularity Prompts for Topic Shift Detection in Dialoguecited by 6
- 2025Multi-Party Conversational Agents: A Surveycited by 6
- 2022Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learningcited by 5
- 2023Topic Shift Detection in Chinese Dialogues: Corpus and Benchmarkcited by 4
- 2023Pre-training Multi-party Dialogue Models with Latent Discourse Inferencecited by 4
- 2023Multi-turn Dialogue Comprehension from a Topic-aware Perspectivecited by 4
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claimscited by 1
- 2022Question-Interlocutor Scope Realized Graph Modeling over Key Utterances for Dialogue Reading Comprehensioncited by 0
- 2025Multi-Party Conversational Agents: A Survey24 May 2025
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims21 Nov 2024
- 2023Multi-level Contrastive Learning for Script-based Character Understanding20 Oct 2023
- 2023Multi-turn Dialogue Comprehension from a Topic-aware Perspective18 Sep 2023
- 2023Pre-training Multi-party Dialogue Models with Latent Discourse Inference24 May 2023
- 2023Multi-Granularity Prompts for Topic Shift Detection in Dialogue23 May 2023
- 2023EM Pre-training for Multi-party Dialogue Response Generation21 May 2023
- 2023Coreference-aware Double-channel Attention Network for Multi-party Dialogue Reading Comprehension15 May 2023
- 2023Topic Shift Detection in Chinese Dialogues: Corpus and Benchmark2 May 2023
- 2022Question-Interlocutor Scope Realized Graph Modeling over Key Utterances for Dialogue Reading Comprehension26 Oct 2022
- 2022Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning19 Oct 2022
- 2022Back to the Future: Bidirectional Information Decoupling Network for Multi-turn Dialogue Modeling18 Apr 2022
1 more
- 2025Multi-Party Conversational Agents: A Surveycited by 6
- 2025Multi-Party Conversational Agents: A Survey24 May 2025
- 2023Multi-level Contrastive Learning for Script-based Character Understandingcited by 15
- 2021Enhanced Speaker-aware Multi-party Multi-turn Dialogue Comprehensioncited by 13
- 2022Back to the Future: Bidirectional Information Decoupling Network for Multi-turn Dialogue Modelingcited by 7
- 2023EM Pre-training for Multi-party Dialogue Response Generationcited by 7
- 2023Multi-Granularity Prompts for Topic Shift Detection in Dialoguecited by 6
- 2022Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learningcited by 5
- 2023Topic Shift Detection in Chinese Dialogues: Corpus and Benchmarkcited by 4
- 2023Pre-training Multi-party Dialogue Models with Latent Discourse Inferencecited by 4
- 2023Multi-turn Dialogue Comprehension from a Topic-aware Perspectivecited by 4
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claimscited by 1
- 2022Question-Interlocutor Scope Realized Graph Modeling over Key Utterances for Dialogue Reading Comprehensioncited by 0
- 2023Coreference-aware Double-channel Attention Network for Multi-party Dialogue Reading Comprehensioncited by 0
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims21 Nov 2024
- 2023Multi-level Contrastive Learning for Script-based Character Understanding20 Oct 2023
- 2023Multi-turn Dialogue Comprehension from a Topic-aware Perspective18 Sep 2023
- 2023Pre-training Multi-party Dialogue Models with Latent Discourse Inference24 May 2023
- 2023Multi-Granularity Prompts for Topic Shift Detection in Dialogue23 May 2023
- 2023EM Pre-training for Multi-party Dialogue Response Generation21 May 2023
- 2023Coreference-aware Double-channel Attention Network for Multi-party Dialogue Reading Comprehension15 May 2023
- 2023Topic Shift Detection in Chinese Dialogues: Corpus and Benchmark2 May 2023
- 2022Question-Interlocutor Scope Realized Graph Modeling over Key Utterances for Dialogue Reading Comprehension26 Oct 2022
- 2022Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning19 Oct 2022
- 2022Back to the Future: Bidirectional Information Decoupling Network for Multi-turn Dialogue Modeling18 Apr 2022
- 2021Enhanced Speaker-aware Multi-party Multi-turn Dialogue Comprehension9 Sep 2021