mlsanityData to 14 Oct 2026

Topic-Conversation Relevance (TCR) Dataset and Benchmarks

arXiv 2411.00038 ↗First posted 29 Oct 2024cs.CL cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Workplace meetings are vital to organizational collaboration, yet a large percentage of meetings are rated as ineffective. To help improve meeting effectiveness by understanding if the conversation is on topic, we create a comprehensive Topic-Conversation Relevance (TCR) dataset that covers a variety of domains and meeting styles. The TCR dataset includes 1,500 unique meetings, 22 million words in transcripts, and over 15,000 meeting topics, sourced from both newly collected Speech Interruption Meeting (SIM) data and existing public datasets. Along with the text data, we also open source scripts to generate synthetic meetings or create augmented meetings from the TCR dataset to enhance data diversity. For each data source, benchmarks are created using GPT-4 to evaluate the model accuracy in understanding transcription-topic relevance.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 12 of its 34 references that are in the map. First posted on arXiv 29 Oct 2024.

Builds on

12 of 34 references.

References · 12

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  3. 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 365
  4. 2023Understanding Social Reasoning in Language Models with Language Modelscited by 172
  5. 2023MeetingBank: A Benchmark Dataset for Meeting Summarizationcited by 84
  6. 2022Can language models handle recursively nested grammatical structures? A case study on comparing models and humanscited by 41
  7. 2023Do large language models resemble humans in language use?cited by 34
  8. 2021Meeting Effectiveness and Inclusiveness in Remote Collaborationcited by 4
  9. 2022ALIGNMEET: A Comprehensive Tool for Meeting Annotation, Alignment, and Evaluationcited by 3
  10. 2021Team Hitachi @ AutoMin 2021: Reference-free Automatic Minuting Pipeline with Argument Structure Construction over Topic-based Summarizationcited by 2
  11. 2023Improving Meeting Inclusiveness using Speech Interruption Analysiscited by 2
  12. 2024Mental Models of Meeting Goals: Supporting Intentionality in Meeting Technologiescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

  1. 2025Are LLM Agents Behaviorally Coherent? Latent Profiles for Social Simulationcited by 4
  2. 2026Evaluating LLM-Simulated Conversations in Modeling Inconsistent and Uncollaborative Behaviors in Human Social Interactioncited by 0
  3. 2026CIG: Measuring Conversational Information Gain in Deliberative Dialogues with Semantic Memory Dynamicscited by 0
  4. 2026GLARE: Generative Learning via Adversarial Reward Estimation For Social Dynamics Forecastingcited by 0
  5. 2026Zero-Shot Cue-Grounded Topic Segmentation of Spoken Documentscited by 0