ConvoKit: A Toolkit for the Analysis of Conversations
Not on the map. Why?
Abstract (arXiv)
This paper describes the design and functionality of ConvoKit, an open-source toolkit for analyzing conversations and the social interactions embedded within. ConvoKit provides an unified framework for representing and manipulating conversational data, as well as a large and diverse collection of conversational datasets. By providing an intuitive interface for exploring and interacting with conversational data, this toolkit lowers the technical barriers for the broad adoption of computational methods for conversational analysis.
Key facts. Cited by 71 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 10; 2023: 6; 2024: 13; 2025: 21; 2026: 14.
71 papers.
Sort:
By area:
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 115
- 2022Same Author or Just Same Topic? Towards Content-Independent Style Representationscited by 83
- 2023When Do Annotator Demographics Matter? Measuring the Influence of Annotator Demographics with the POPQUORN Datasetcited by 51
- 2021Accounting for Agreement Phenomena in Sentence Comprehension with Transformer Language Models: Effects of Similarity-based Interference on Surprisal and Attentioncited by 26
- 2024"They are uncultured": Unveiling Covert Harms and Social Threats in LLM Generated Conversationscited by 24
- 2024WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wildcited by 20
- 2021I Beg to Differ: A study of constructive disagreement in online conversationscited by 18
- 2021Idiosyncratic but not Arbitrary: Learning Idiolects in Online Registers Reveals Distinctive yet Consistent Individual Stylescited by 18
- 2021The R-U-A-Robot Dataset: Helping Avoid Chatbot Deception by Detecting User Questions About Human or Non-Human Identitycited by 16
- 2022Computationally Identifying Funneling and Focusing Questions in Classroom Discoursecited by 15
- 2022Proactive Moderation of Online Discussions: Existing Practices and the Potential for Algorithmic Supportcited by 15
38 more
- 2023''Fifty Shades of Bias'': Normative Ratings of Gender Bias in GPT Generated English Textcited by 15
- 2025How Deep Is Representational Bias in LLMs? The Cases of Caste and Religioncited by 14
- 2024Edu-ConvoKit: An Open-Source Library for Education Conversation Datacited by 11
- 2023HANSEN: Human and AI Spoken Text Benchmark for Authorship Analysiscited by 10
- 2024An LLM Feature-based Framework for Dialogue Constructiveness Assessmentcited by 9
- 2025What do Large Language Models Say About Animals? Investigating Risks of Animal Harm in Generated Textcited by 9
- 2021The structure of online social networks modulates the rate of lexical changecited by 8
- 2023Opening up Minds with Argumentative Dialoguescited by 8
- 2025Cut Costs, Not Accuracy: LLM-Powered Data Processing with Guaranteescited by 8
- 2026OdysSim: Building Foundation Models for Human Behavior Simulationcited by 8
- 2026Evaluating Decision Models for Text Annotation in Computational Social Sciencecited by 8
- 2022Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Surveycited by 6
- 2023Assessing the efficacy of large language models in generating accurate teacher responsescited by 6
- 2024Deal, or no deal (or who knows)? Forecasting Uncertainty in Conversations using Large Language Modelscited by 6
- 2024How Did We Get Here? Summarizing Conversation Dynamicscited by 6
- 2022Can Unsupervised Knowledge Transfer from Social Discussions Help Argument Mining?cited by 5
- 2022Shedding New Light on the Language of the Dark Webcited by 5
- 2024Taking a turn for the better: Conversation redirection throughout the course of mental-health therapycited by 5
- 2025Sycophantic AI Decreases Prosocial Intentions and Promotes Dependencecited by 5
- 2025Residualized Similarity for Faithfully Explainable Authorship Verificationcited by 4
- 2025so much depends / upon / a whitespace: Why Whitespace Matters for Poets and LLMscited by 4
- 2022RSTGen: Imbuing Fine-Grained Interpretable Control into Long-FormText Generatorscited by 3
- 2024ASTPrompter: Preference-Aligned Automated Language Model Red-Teaming to Generate Low-Perplexity Unsafe Promptscited by 3
- 2025Social Story Frames: Contextual Reasoning about Narrative Intent and Receptioncited by 3
- 2026CALM-IT: Generating Realistic Long-Form Motivational Interviewing Dialogues with Dual-Actor Conversational Dynamics Trackingcited by 3
- 2026Learning User Simulators with Turing Rewardscited by 3
- 2022Building and curating conversational corpora for diversity-aware language science and technologycited by 2
- 2025Conversations Gone Awry, But Then? Evaluating Conversational Forecasting Modelscited by 2
- 2025From Passive to Persuasive: Localized Activation Injection for Empathy and Negotiationcited by 2
- 2021Open-Mindedness and Style Coordination in Argumentative Discussionscited by 1
- 2021Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Modelscited by 1
- 2024The Branch Not Taken: Predicting Branching in Online Conversationscited by 1
- 2024Using RL to Identify Divisive Perspectives Improves LLMs Abilities to Identify Communities on Social Mediacited by 1
- 2024Real World Conversational Entity Linking Requires More Than Zeroshotscited by 1
- 2024Observing the Southern US Culture of Honor Using Large-Scale Social Media Analysiscited by 1
- 2025A Similarity Measure for Comparing Conversational Dynamicscited by 1
- 2025Op-Fed: Opinion, Stance, and Monetary Policy Annotations on FOMC Transcripts Using Active Learningcited by 1
- 2025AITutor-EvalKit: Exploring the Capabilities of AI Tutorscited by 1
50 most cited of 71 All 71 (JSON)
- 2026From Utterances to Networks: Modelling Slang Adoption and Diffusion Across Subreddits22 Sep 2026
- 2026Evaluating Decision Models for Text Annotation in Computational Social Science21 Sep 2026
- 2026Pretrained Persona Mixture Models and Tandem Models for Human Simulation18 Sep 2026
- 2026Adapting from Downturns: Prediction of Long-Term Conversational-Skill Development in Mental-Health Crisis Counselors3 Sep 2026
- 2026PolyDebate: A Game-Orchestrated Multimodal System for Debate Skills Practice and Evaluation17 Aug 2026
- 2026PHASE-Tree: Modeling Character-State Evolution in Long-Horizon Role-Playing Dialogue7 Aug 2026
- 2026TRAIL: A Platform for Configurable Human--AI Teaming Experiments13 Jul 2026
- 2026Information Dynamics of Language Communication29 Jun 2026
- 2026Diagnosing and Mitigating Compounding Failures in Agentic Persuasion via Taxonomic Strategy Retrieval23 Jun 2026
- 2026Learning User Simulators with Turing Rewards17 Jun 2026
- 2026OdysSim: Building Foundation Models for Human Behavior Simulation12 Jun 2026
- 2026Adversarial Creation and Detection of AI-Generated Social Bot Content5 Jun 2026
38 more
- 2026CALM-IT: Generating Realistic Long-Form Motivational Interviewing Dialogues with Dual-Actor Conversational Dynamics Tracking15 Jan 2026
- 2026LLMberjack: Guided Trimming of Debate Trees for Multi-Party Conversation Creation7 Jan 2026
- 2025Patterns vs. Patients: Evaluating LLMs against Mental Health Professionals on Personality Disorder Diagnosis through First-Person Narratives23 Dec 2025
- 2025Affect, Body, Cognition, Demographics, and Emotion: The ABCDE of Text Features for Computational Affective Science19 Dec 2025
- 2025Social Story Frames: Contextual Reasoning about Narrative Intent and Reception17 Dec 2025
- 2025Heard or Halted? Gender, Interruptions, and Emotional Tone in U.S. Supreme Court Oral Arguments5 Dec 2025
- 2025AITutor-EvalKit: Exploring the Capabilities of AI Tutors3 Dec 2025
- 2025From Passive to Persuasive: Localized Activation Injection for Empathy and Negotiation16 Nov 2025
- 2025so much depends / upon / a whitespace: Why Whitespace Matters for Poets and LLMs19 Oct 2025
- 2025Residualized Similarity for Faithfully Explainable Authorship Verification6 Oct 2025
- 2025Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence1 Oct 2025
- 2025Op-Fed: Opinion, Stance, and Monetary Policy Annotations on FOMC Transcripts Using Active Learning16 Sep 2025
- 2025Cut Costs, Not Accuracy: LLM-Powered Data Processing with Guarantees2 Sep 2025
- 2025Conversational DNA: A Visual Language and Interactive Atlas of Human and AI Dialogue11 Aug 2025
- 2025Conversations Gone Awry, But Then? Evaluating Conversational Forecasting Models25 Jul 2025
- 2025A Similarity Measure for Comparing Conversational Dynamics25 Jul 2025
- 2025How Deep Is Representational Bias in LLMs? The Cases of Caste and Religion22 Jul 2025
- 2025Time is On My Side: Dynamics of Talk-Time Sharing in Video-chat Conversations25 Jun 2025
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMs20 May 2025
- 2025ConceptCarve: Dynamic Realization of Evidence9 Apr 2025
- 2025Splits! Flexible Sociocultural Linguistic Investigation at Scale6 Apr 2025
- 2025From Smor-re-brod to Subwords: Training LLMs on Danish, One Morpheme at a Time2 Apr 2025
- 2025What do Large Language Models Say About Animals? Investigating Risks of Animal Harm in Generated Text3 Mar 2025
- 2024Observing the Southern US Culture of Honor Using Large-Scale Social Media Analysis11 Oct 2024
- 2024Taking a turn for the better: Conversation redirection throughout the course of mental-health therapy9 Oct 2024
- 2024WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild5 Sep 2024
- 2024Real World Conversational Entity Linking Requires More Than Zeroshots2 Sep 2024
- 2024Examining Gender and Power on Wikipedia Through Face and Politeness5 Aug 2024
- 2024ASTPrompter: Preference-Aligned Automated Language Model Red-Teaming to Generate Low-Perplexity Unsafe Prompts12 Jul 2024
- 2024An LLM Feature-based Framework for Dialogue Constructiveness Assessment20 Jun 2024
- 2024Using RL to Identify Divisive Perspectives Improves LLMs Abilities to Identify Communities on Social Media3 Jun 2024
- 2024"They are uncultured": Unveiling Covert Harms and Social Threats in LLM Generated Conversations8 May 2024
- 2024How Did We Get Here? Summarizing Conversation Dynamics29 Apr 2024
- 2024The Branch Not Taken: Predicting Branching in Online Conversations21 Apr 2024
- 2024Edu-ConvoKit: An Open-Source Library for Education Conversation Data7 Feb 2024
- 2024Deal, or no deal (or who knows)? Forecasting Uncertainty in Conversations using Large Language Models5 Feb 2024
- 2023''Fifty Shades of Bias'': Normative Ratings of Gender Bias in GPT Generated English Text26 Oct 2023
- 2023HANSEN: Human and AI Spoken Text Benchmark for Authorship Analysis25 Oct 2023
50 newest of 71 All 71 (JSON)
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 115
- 2022Same Author or Just Same Topic? Towards Content-Independent Style Representationscited by 83
- 2023When Do Annotator Demographics Matter? Measuring the Influence of Annotator Demographics with the POPQUORN Datasetcited by 51
- 2021Accounting for Agreement Phenomena in Sentence Comprehension with Transformer Language Models: Effects of Similarity-based Interference on Surprisal and Attentioncited by 26
- 2024"They are uncultured": Unveiling Covert Harms and Social Threats in LLM Generated Conversationscited by 24
- 2024WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wildcited by 20
- 2021I Beg to Differ: A study of constructive disagreement in online conversationscited by 18
- 2021Idiosyncratic but not Arbitrary: Learning Idiolects in Online Registers Reveals Distinctive yet Consistent Individual Stylescited by 18
- 2021The R-U-A-Robot Dataset: Helping Avoid Chatbot Deception by Detecting User Questions About Human or Non-Human Identitycited by 16
- 2022Computationally Identifying Funneling and Focusing Questions in Classroom Discoursecited by 15
- 2022Proactive Moderation of Online Discussions: Existing Practices and the Potential for Algorithmic Supportcited by 15
12 most cited of 69 All 69 (JSON)
- 2026From Utterances to Networks: Modelling Slang Adoption and Diffusion Across Subreddits22 Sep 2026
- 2026Evaluating Decision Models for Text Annotation in Computational Social Science21 Sep 2026
- 2026Pretrained Persona Mixture Models and Tandem Models for Human Simulation18 Sep 2026
- 2026Adapting from Downturns: Prediction of Long-Term Conversational-Skill Development in Mental-Health Crisis Counselors3 Sep 2026
- 2026PolyDebate: A Game-Orchestrated Multimodal System for Debate Skills Practice and Evaluation17 Aug 2026
- 2026PHASE-Tree: Modeling Character-State Evolution in Long-Horizon Role-Playing Dialogue7 Aug 2026
- 2026TRAIL: A Platform for Configurable Human--AI Teaming Experiments13 Jul 2026
- 2026Information Dynamics of Language Communication29 Jun 2026
- 2026Learning User Simulators with Turing Rewards17 Jun 2026
- 2026OdysSim: Building Foundation Models for Human Behavior Simulation12 Jun 2026
- 2026Adversarial Creation and Detection of AI-Generated Social Bot Content5 Jun 2026
- 2026CALM-IT: Generating Realistic Long-Form Motivational Interviewing Dialogues with Dual-Actor Conversational Dynamics Tracking15 Jan 2026
12 newest of 69 All 69 (JSON)