Conversations Gone Awry: Detecting Early Signs of Conversational Failure
Not on the map. Why?
Abstract (arXiv)
One of the main challenges online social systems face is the prevalence of antisocial behavior, such as harassment and personal attacks. In this work, we introduce the task of predicting from the very start of a conversation whether it will get out of hand. As opposed to detecting undesirable behavior after the fact, this task aims to enable early, actionable prediction at a time when the conversation might still be salvaged. To this end, we develop a framework for capturing pragmatic devices---such as politeness strategies and rhetorical prompts---used to start a conversation, and analyze their relation to its future trajectory. Applying this framework in a controlled setting, we demonstrate the feasibility of detecting early warning signs of antisocial behavior in online discussions.
Key facts. Cited by 73 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 8; 2023: 14; 2024: 10; 2025: 10; 2026: 13.
73 papers.
Sort:
By area:
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2023CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotationcited by 93
- 2021Time Waits for No One! Analysis and Challenges of Temporal Misalignmentcited by 91
- 2021Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contextscited by 56
- 2023Rehearsal: Simulating Conflict to Teach Conflict Resolutioncited by 54
- 2022Neural Approaches to Conversational Information Retrievalcited by 41
- 2023Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Modelscited by 37
- 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
- 2022Robust Conversational Agents against Imperceptible Toxicity Triggerscited by 23
- 2021Artificial intelligence in communication impacts language and social relationshipscited by 22
- 2021Conversations Gone Alright: Quantifying and Predicting Prosocial Outcomes in Online Conversationscited by 20
- 2021Abuse is Contextual, What about NLP? The Role of Context in Abusive Language Annotation and Detectioncited by 19
38 more
- 2021I Beg to Differ: A study of constructive disagreement in online conversationscited by 18
- 2021Detecting Community Sensitive Norm Violations in Online Conversationscited by 18
- 2024Accounting for Sycophancy in Language Model Uncertainty Estimationcited by 18
- 2021Dynamic Forecasting of Conversation Derailmentcited by 16
- 2022Proactive Moderation of Online Discussions: Existing Practices and the Potential for Algorithmic Supportcited by 15
- 2021An Exploratory Analysis of the Relation Between Offensive Language and Mental Healthcited by 14
- 2021CONDA: a CONtextual Dual-Annotated dataset for in-game toxicity understanding and detectioncited by 14
- 2023Watch Your Language: Investigating Content Moderation with Large Language Modelscited by 14
- 2021Countering Online Hate Speech: An NLP Perspectivecited by 12
- 2021Decision-Focused Summarizationcited by 11
- 2022Thread With Caution: Proactively Helping Users Assess and Deescalate Tension in Their Online Discussionscited by 11
- 2025BASIL: Bayesian Assessment of Sycophancy in LLMscited by 11
- 2024An LLM Feature-based Framework for Dialogue Constructiveness Assessmentcited by 9
- 2024Do LLMs suffer from Multi-Party Hangover? A Diagnostic Approach to Addressee Recognition and Response Selection in Conversationscited by 9
- 2022Automated Identification of Toxic Code Reviews Using ToxiCRcited by 8
- 2024Computational Politeness in Natural Language Processing: A Surveycited by 8
- 2025Evaluation and Facilitation of Online Discussions in the LLM Era: A Surveycited by 8
- 2026Evaluating Decision Models for Text Annotation in Computational Social Sciencecited by 8
- 2023CPL-NoViD: Context-Aware Prompt-based Learning for Norm Violation Detection in Online Communitiescited by 7
- 2021WLV-RIT at SemEval-2021 Task 5: A Neural Transformer Framework for Detecting Toxic Spanscited by 6
- 2021Toxicity Detection can be Sensitive to the Conversational Contextcited by 6
- 2022How to disagree well: Investigating the dispute tactics used on Wikipediacited by 6
- 2022DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarizationcited by 6
- 2023Your spouse needs professional help: Determining the Contextual Appropriateness of Messages through Modeling Social Relationshipscited by 6
- 2024Deal, or no deal (or who knows)? Forecasting Uncertainty in Conversations using Large Language Modelscited by 6
- 2022Predicting the Type and Target of Offensive Social Media Posts in Marathicited by 5
- 2025Echoes of Discord: Forecasting Hater Reactions to Counterspeechcited by 5
- 2025Towards a Perspectivist Turn in Argument Quality Assessmentcited by 5
- 2021Linguistic Characterization of Divisive Topics Online: Case Studies on Contentiousness in Abortion, Climate Change, and Gun Controlcited by 4
- 2025Words Like Knives: Backstory-Personalized Modeling and Detection of Violent Communicationcited by 4
- 2024Putting Context in Context: the Impact of Discussion Structure on Text Classificationcited by 3
- 2021A Survey of Online Hate Speech through the Causal Lenscited by 2
- 2023Conversation Modeling to Predict Derailmentcited by 2
- 2023A Deeper (Autoregressive) Approach to Non-Convergent Discourse Parsingcited by 2
- 2023Dimensions of Online Conflict: Towards Modeling Agonismcited by 2
- 2024Social Orientation: A New Feature for Dialogue Analysiscited by 2
- 2025Conversations Gone Awry, But Then? Evaluating Conversational Forecasting Modelscited by 2
- 2025Learning When to Quit in Sales Conversationscited by 2
50 most cited of 73 All 73 (JSON)
- 2026Evaluating Decision Models for Text Annotation in Computational Social Science21 Sep 2026
- 2026Vishing-Tactics-Bench: Forecasting Exploitation Trajectories in Voice Phishing Calls7 Sep 2026
- 2026Adapting from Downturns: Prediction of Long-Term Conversational-Skill Development in Mental-Health Crisis Counselors3 Sep 2026
- 2026Leveraging Speech Acts for Low-Data and Cross-Domain Conversation Derailment Forecasting26 Aug 2026
- 2026ConVAWG: A Retrieval-Grounded Framework for Controlled Synthetic Dialogue Generation in Violence Against Women and Girls11 Aug 2026
- 2026Do Social Patterns Hold in Synthetic Data? Analyzing Cyberbullying Dynamics in LLM-Generated and Authentic Dialogues15 Jul 2026
- 2026Who Plays Which Role When? Communication Role Dynamics for Peer Recognition and Team Performance Prediction26 Jun 2026
- 2026Benchmarking Multi-Modal Graph-based Social Media Popularity Prediction25 Jun 2026
- 2026Wait! There's a Way Out: A Decision Mechanism for Forecasting Conversational Derailment28 May 2026
- 2026Cyberbullying Governance on Social Media: A Unified Framework from Content Identification to Intervention26 May 2026
- 2026Phase Transitions in Affective Meaning Divergence: The Hidden Drift Before the Break9 May 2026
- 2026Bye Bye Perspective API: Lessons for Building and Governing Measurement Infrastructure28 Apr 2026
38 more
- 2026The geometry of online conversations and the causal antecedents of conflictual discourse17 Feb 2026
- 2025Learning When to Quit in Sales Conversations3 Nov 2025
- 2025On the Sensitivity of Instruction-tuned LLMs to Harmful Sentences in Long Inputs7 Oct 2025
- 2025BASIL: Bayesian Assessment of Sycophancy in LLMs23 Aug 2025
- 2025Conversations Gone Awry, But Then? Evaluating Conversational Forecasting Models25 Jul 2025
- 2025Words Like Knives: Backstory-Personalized Modeling and Detection of Violent Communication27 May 2025
- 2025Forecasting Conversation Derailments Through Generation11 Apr 2025
- 2025Evaluation and Facilitation of Online Discussions in the LLM Era: A Survey3 Mar 2025
- 2025Towards a Perspectivist Turn in Argument Quality Assessment20 Feb 2025
- 2025Synthetic Audio Helps for Cognitive State Tasks10 Feb 2025
- 2025Echoes of Discord: Forecasting Hater Reactions to Counterspeech27 Jan 2025
- 2024How Do Users Negotiate Harmful Value Conflicts with AI Companions? A Study with Minion, a Technology Probe for In-Situ Human-AI Conflict Response11 Nov 2024
- 2024Accounting for Sycophancy in Language Model Uncertainty Estimation17 Oct 2024
- 2024Observing the Southern US Culture of Honor Using Large-Scale Social Media Analysis11 Oct 2024
- 2024Do LLMs suffer from Multi-Party Hangover? A Diagnostic Approach to Addressee Recognition and Response Selection in Conversations27 Sep 2024
- 2024Computational Politeness in Natural Language Processing: A Survey28 Jun 2024
- 2024An LLM Feature-based Framework for Dialogue Constructiveness Assessment20 Jun 2024
- 2024The Branch Not Taken: Predicting Branching in Online Conversations21 Apr 2024
- 2024Social Orientation: A New Feature for Dialogue Analysis26 Feb 2024
- 2024Deal, or no deal (or who knows)? Forecasting Uncertainty in Conversations using Large Language Models5 Feb 2024
- 2024Putting Context in Context: the Impact of Discussion Structure on Text Classification5 Feb 2024
- 2023Predicting Evoked Emotions in Conversations31 Dec 2023
- 2023Hashing it Out: Predicting Unhealthy Conversations on Twitter17 Nov 2023
- 2023Dimensions of Online Conflict: Towards Modeling Agonism6 Nov 2023
- 2023CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation24 Oct 2023
- 2023Watch Your Language: Investigating Content Moderation with Large Language Models25 Sep 2023
- 2023Rehearsal: Simulating Conflict to Teach Conflict Resolution21 Sep 2023
- 2023Your spouse needs professional help: Determining the Contextual Appropriateness of Messages through Modeling Social Relationships6 Jul 2023
- 2023Conversation Derailment Forecasting with Graph Convolutional Networks22 Jun 2023
- 2023Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Models7 Jun 2023
- 2023Centering the Margins: Outlier-Based Identification of Harmed Populations in Toxicity Detection24 May 2023
- 2023A Deeper (Autoregressive) Approach to Non-Convergent Discourse Parsing21 May 2023
- 2023CPL-NoViD: Context-Aware Prompt-based Learning for Norm Violation Detection in Online Communities16 May 2023
- 2023Can Large Language Models Transform Computational Social Science?12 Apr 2023
- 2023Conversation Modeling to Predict Derailment20 Mar 2023
- 2022DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization20 Dec 2022
- 2022How to disagree well: Investigating the dispute tactics used on Wikipedia16 Dec 2022
- 2022Thread With Caution: Proactively Helping Users Assess and Deescalate Tension in Their Online Discussions2 Dec 2022
50 newest of 73 All 73 (JSON)
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2023CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotationcited by 93
- 2021Time Waits for No One! Analysis and Challenges of Temporal Misalignmentcited by 91
- 2021Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contextscited by 56
- 2023Rehearsal: Simulating Conflict to Teach Conflict Resolutioncited by 54
- 2022Neural Approaches to Conversational Information Retrievalcited by 41
- 2023Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Modelscited by 37
- 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
- 2021Artificial intelligence in communication impacts language and social relationshipscited by 22
- 2021Conversations Gone Alright: Quantifying and Predicting Prosocial Outcomes in Online Conversationscited by 20
- 2021Abuse is Contextual, What about NLP? The Role of Context in Abusive Language Annotation and Detectioncited by 19
- 2021I Beg to Differ: A study of constructive disagreement in online conversationscited by 18
12 most cited of 71 All 71 (JSON)
- 2026Evaluating Decision Models for Text Annotation in Computational Social Science21 Sep 2026
- 2026Vishing-Tactics-Bench: Forecasting Exploitation Trajectories in Voice Phishing Calls7 Sep 2026
- 2026Adapting from Downturns: Prediction of Long-Term Conversational-Skill Development in Mental-Health Crisis Counselors3 Sep 2026
- 2026Leveraging Speech Acts for Low-Data and Cross-Domain Conversation Derailment Forecasting26 Aug 2026
- 2026ConVAWG: A Retrieval-Grounded Framework for Controlled Synthetic Dialogue Generation in Violence Against Women and Girls11 Aug 2026
- 2026Who Plays Which Role When? Communication Role Dynamics for Peer Recognition and Team Performance Prediction26 Jun 2026
- 2026Benchmarking Multi-Modal Graph-based Social Media Popularity Prediction25 Jun 2026
- 2026Wait! There's a Way Out: A Decision Mechanism for Forecasting Conversational Derailment28 May 2026
- 2026Cyberbullying Governance on Social Media: A Unified Framework from Content Identification to Intervention26 May 2026
- 2026Phase Transitions in Affective Meaning Divergence: The Hidden Drift Before the Break9 May 2026
- 2026Bye Bye Perspective API: Lessons for Building and Governing Measurement Infrastructure28 Apr 2026
- 2026The geometry of online conversations and the causal antecedents of conflictual discourse17 Feb 2026
12 newest of 71 All 71 (JSON)