TIAGE: A Benchmark for Topic-Shift Aware Dialog Modeling
Not on the map. Why?
Abstract (arXiv)
Human conversations naturally evolve around different topics and fluently move between them. In research on dialog systems, the ability to actively and smoothly transition to new topics is often ignored. In this paper we introduce TIAGE, a new topic-shift aware dialog benchmark constructed utilizing human annotations on topic shifts. Based on TIAGE, we introduce three tasks to investigate different scenarios of topic-shift modeling in dialog settings: topic-shift detection, topic-shift triggered response generation and topic-aware dialog generation. Experiments on these tasks show that the topic-shift signals in TIAGE are useful for topic-shift response generation. On the other hand, dialog systems still struggle to decide when to change topic. This indicates further research is needed in topic-shift aware dialog modeling.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 16 of its 32 references that are in the map. First posted on arXiv 9 Sep 2021.
Builds on
16 of 32 references.
References · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
- 2018Text Segmentation as a Supervised Learning Taskcited by 76
- 2019Target-Guided Open-Domain Conversationcited by 66
- 2019Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphscited by 59
- 2018Dialogue Learning with Human Teaching and Feedback in End-to-End Trainable Task-Oriented Dialogue Systemscited by 53
- 2019SECTOR: A Neural Model for Coherent Topic Segmentation and Classificationcited by 48
- 2019Approximating Interactive Human Evaluation with Self-Play for Open-Domain Dialog Systemscited by 42
4 more
- 2020Two-Level Transformer and Auxiliary Coherence Modeling for Improved Text Segmentationcited by 41
- 2019Improving Robustness of Task Oriented Dialog Systemscited by 15
- 2019Generic Intent Representation in Web Searchcited by 12
- 2018Sounding Board: A User-Centric and Content-Driven Social Chatbotcited by 11
Built on by
Citing papers per year: 2022: 2; 2023: 6; 2024: 5; 2025: 6; 2026: 3.
22 papers.
Sort:
By area:
- 2025On Memory Construction and Retrieval for Personalized Conversational Agentscited by 105
- 2023A Survey on Proactive Dialogue Systems: Problems, Methods, and Prospectscited by 66
- 2022Neural Approaches to Conversational Information Retrievalcited by 42
- 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Studycited by 24
- 2024LLM Task Interference: An Initial Study on the Impact of Task-Switch in Conversational Historycited by 19
- 2023Mind the Gap Between Conversations for Improved Long-Term Dialogue Generationcited by 13
- 2023SuperDialseg: A Large-scale Dataset for Supervised Dialogue Segmentationcited by 10
- 2023Multi-Granularity Prompts for Topic Shift Detection in Dialoguecited by 6
- 2024Recent Trends in Linear Text Segmentation: a Surveycited by 6
- 2024Taking a turn for the better: Conversation redirection throughout the course of mental-health therapycited by 5
- 2023Topic Shift Detection in Chinese Dialogues: Corpus and Benchmarkcited by 4
- 2024MP2D: An Automated Topic Shift Dialogue Generation Framework Leveraging Knowledge Graphscited by 4
10 more
- 2026ES-Mem: Event Segmentation-Based Memory for Long-Term Dialogue Agentscited by 4
- 2024Unsupervised Mutual Learning of Discourse Parsing and Topic Segmentation in Dialoguecited by 3
- 2025Dynamics of Spontaneous Topic Changes in Next Token Prediction with Self-Attentioncited by 2
- 2025Breaking the Stigma! Unobtrusively Probe Symptoms in Depression Disorder Diagnosis Dialoguecited by 2
- 2025PaRT: Enhancing Proactive Social Chatbots with Personalized Real-Time Retrievalcited by 2
- 2022Reinforced Approximate Exploratory Data Analysiscited by 1
- 2025When F1 Fails: Granularity-Aware Evaluation for Dialogue Topic Segmentationcited by 1
- 2025DASH: Dialogue-Aware Similarity and Handshake Recognition for Topic Segmentation in Public-Channel Conversationscited by 0
- 2026Beyond Continuity: Challenges of Context Switching in Multi-Turn Dialogue with LLMscited by 0
- 2026CobSeg: Coherence Boundary Modeling for Dialogue Topic Segmentationcited by 0
- 2026CobSeg: Coherence Boundary Modeling for Dialogue Topic Segmentation29 May 2026
- 2026Beyond Continuity: Challenges of Context Switching in Multi-Turn Dialogue with LLMs10 May 2026
- 2026ES-Mem: Event Segmentation-Based Memory for Long-Term Dialogue Agents12 Jan 2026
- 2025When F1 Fails: Granularity-Aware Evaluation for Dialogue Topic Segmentation18 Dec 2025
- 2025DASH: Dialogue-Aware Similarity and Handshake Recognition for Topic Segmentation in Public-Channel Conversations17 Dec 2025
- 2025PaRT: Enhancing Proactive Social Chatbots with Personalized Real-Time Retrieval29 Apr 2025
- 2025On Memory Construction and Retrieval for Personalized Conversational Agents8 Feb 2025
- 2025Breaking the Stigma! Unobtrusively Probe Symptoms in Depression Disorder Diagnosis Dialogue25 Jan 2025
- 2025Dynamics of Spontaneous Topic Changes in Next Token Prediction with Self-Attention10 Jan 2025
- 2024Recent Trends in Linear Text Segmentation: a Survey25 Nov 2024
- 2024Taking a turn for the better: Conversation redirection throughout the course of mental-health therapy9 Oct 2024
- 2024Unsupervised Mutual Learning of Discourse Parsing and Topic Segmentation in Dialogue30 May 2024
10 more
- 2024MP2D: An Automated Topic Shift Dialogue Generation Framework Leveraging Knowledge Graphs9 Mar 2024
- 2024LLM Task Interference: An Initial Study on the Impact of Task-Switch in Conversational History28 Feb 2024
- 2023Mind the Gap Between Conversations for Improved Long-Term Dialogue Generation24 Oct 2023
- 2023Multi-Granularity Prompts for Topic Shift Detection in Dialogue23 May 2023
- 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Study15 May 2023
- 2023SuperDialseg: A Large-scale Dataset for Supervised Dialogue Segmentation15 May 2023
- 2023A Survey on Proactive Dialogue Systems: Problems, Methods, and Prospects4 May 2023
- 2023Topic Shift Detection in Chinese Dialogues: Corpus and Benchmark2 May 2023
- 2022Reinforced Approximate Exploratory Data Analysis12 Dec 2022
- 2022Neural Approaches to Conversational Information Retrieval13 Jan 2022
- 2023A Survey on Proactive Dialogue Systems: Problems, Methods, and Prospectscited by 66
- 2022Neural Approaches to Conversational Information Retrievalcited by 42
- 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Studycited by 24
- 2024LLM Task Interference: An Initial Study on the Impact of Task-Switch in Conversational Historycited by 19
- 2023Mind the Gap Between Conversations for Improved Long-Term Dialogue Generationcited by 13
- 2023SuperDialseg: A Large-scale Dataset for Supervised Dialogue Segmentationcited by 10
- 2023Multi-Granularity Prompts for Topic Shift Detection in Dialoguecited by 6
- 2024Recent Trends in Linear Text Segmentation: a Surveycited by 6
- 2024Taking a turn for the better: Conversation redirection throughout the course of mental-health therapycited by 5
- 2023Topic Shift Detection in Chinese Dialogues: Corpus and Benchmarkcited by 4
- 2024MP2D: An Automated Topic Shift Dialogue Generation Framework Leveraging Knowledge Graphscited by 4
- 2026ES-Mem: Event Segmentation-Based Memory for Long-Term Dialogue Agentscited by 4
12 most cited of 21 All 21 (JSON)
- 2026CobSeg: Coherence Boundary Modeling for Dialogue Topic Segmentation29 May 2026
- 2026Beyond Continuity: Challenges of Context Switching in Multi-Turn Dialogue with LLMs10 May 2026
- 2026ES-Mem: Event Segmentation-Based Memory for Long-Term Dialogue Agents12 Jan 2026
- 2025When F1 Fails: Granularity-Aware Evaluation for Dialogue Topic Segmentation18 Dec 2025
- 2025DASH: Dialogue-Aware Similarity and Handshake Recognition for Topic Segmentation in Public-Channel Conversations17 Dec 2025
- 2025PaRT: Enhancing Proactive Social Chatbots with Personalized Real-Time Retrieval29 Apr 2025
- 2025Breaking the Stigma! Unobtrusively Probe Symptoms in Depression Disorder Diagnosis Dialogue25 Jan 2025
- 2025Dynamics of Spontaneous Topic Changes in Next Token Prediction with Self-Attention10 Jan 2025
- 2024Recent Trends in Linear Text Segmentation: a Survey25 Nov 2024
- 2024Taking a turn for the better: Conversation redirection throughout the course of mental-health therapy9 Oct 2024
- 2024Unsupervised Mutual Learning of Discourse Parsing and Topic Segmentation in Dialogue30 May 2024
- 2024MP2D: An Automated Topic Shift Dialogue Generation Framework Leveraging Knowledge Graphs9 Mar 2024
12 newest of 21 All 21 (JSON)