MeetingBank: A Benchmark Dataset for Meeting Summarization
Not on the map. Why?
Abstract (arXiv)
As the number of recorded meetings increases, it becomes increasingly important to utilize summarization technology to create useful summaries of these recordings. However, there is a crucial lack of annotated meeting corpora for developing this technology, as it can be hard to collect meetings, especially when the topics discussed are confidential. Furthermore, meeting summaries written by experienced writers are scarce, making it hard for abstractive summarizers to produce sensible output without a reliable reference. This lack of annotated corpora has hindered the development of meeting summarization technology. In this paper, we present MeetingBank, a new benchmark dataset of city council meetings over the past decade. MeetingBank is unique among other meeting corpora due to its divide-and-conquer approach, which involves dividing professionally written meeting minutes into shorter passages and aligning them with specific segments of the meeting. This breaks down the process of summarizing a lengthy meeting into smaller, more manageable tasks. The dataset provides a new testbed of various meeting summarization systems and also allows the public to gain insight into how council decisions are made. We make the collection, including meeting video links, transcripts, reference summaries, agenda, and other metadata, publicly available to facilitate the development of better meeting summarization techniques. Our dataset can be accessed at: https://meetingbank.github.io
Key facts. Cited by 84 papers in the map (data through 14 Oct 2026). Builds on 37 of its 68 references that are in the map. First posted on arXiv 27 May 2023.
Builds on
37 of 68 references.
References · 37
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 674
- 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 535
- 2023Benchmarking Large Language Models for News Summarizationcited by 445
25 more
- 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
- 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 418
- 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 365
- 2021Efficient Attentions for Long Document Summarizationcited by 345
- 2022News Summarization and Evaluation in the Era of GPT-3cited by 327
- 2018Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategiescited by 294
- 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 183
- 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 161
- 2019BillSum: A Corpus for Automatic Summarization of US Legislationcited by 117
- 2021MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarizationcited by 104
- 2020Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summarycited by 88
- 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 79
- 2021DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarizationcited by 72
- 2021Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documentscited by 65
- 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literaturecited by 55
- 2018Unsupervised Abstractive Meeting Summarization with Multi-Sentence Compression and Budgeted Submodular Maximizationcited by 46
- 2022Toward Unifying Text Segmentation and Long Document Summarizationcited by 28
- 2020Screenplay Summarization Using Latent Narrative Structurecited by 23
- 2021StreamHover: Livestream Transcript Summarization and Annotationcited by 15
- 2020How Domain Terminology Affects Meeting Summarization Performancecited by 14
- 2021A Sliding-Window Approach to Automatic Creation of Meeting Minutescited by 14
- 2021A preliminary study on evaluating Consultation Notes with Post-Editingcited by 10
- 2022Towards Abstractive Grounded Summarization of Podcast Transcriptscited by 8
- 2021SummerTime: Text Summarization Toolkit for Non-expertscited by 6
- 2020Align then Summarize: Automatic Alignment Methods for Summarization Corpus Creationcited by 1
Built on by
Citing papers per year: 2023: 6; 2024: 26; 2025: 20; 2026: 32.
84 papers.
Sort:
By area:
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 348
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 257
- 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 102
- 2023TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Modelscited by 66
- 2024TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarizationcited by 66
- 2023Data Contamination Quiz: A Tool to Detect and Estimate Contamination in Large Language Modelscited by 47
- 2024AdaCAD: Adaptively Decoding to Balance Conflicts between Contextual and Parametric Knowledgecited by 37
- 2023Building Real-World Meeting Summarization Systems using Large Language Models: A Practical Perspectivecited by 34
- 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
- 2024Learning to Summarize from LLM-generated Feedbackcited by 24
- 2024TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement Learningcited by 22
38 more
- 2025Benchmarking LLM Faithfulness in RAG with Evolving Leaderboardscited by 20
- 2024Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Coursecited by 19
- 2024CriSPO: Multi-Aspect Critique-Suggestion-guided Automatic Prompt Optimization for Text Generationcited by 18
- 2024SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generationcited by 12
- 2025Forget Forgetting: Continual Learning in a World of Abundant Memorycited by 11
- 2025Towards Multi-dimensional Evaluation of LLM Summarization across Domains and Languagescited by 11
- 2025Faithful, Unfaithful or Ambiguous? Multi-Agent Debate with Initial Stance for Summary Evaluationcited by 10
- 2024GlobeSumm: A Challenging Benchmark Towards Unifying Multi-lingual, Cross-lingual and Multi-document News Summarizationcited by 9
- 2024Tell me what I need to know: Exploring LLM-based (Personalized) Abstractive Multi-Source Meeting Summarizationcited by 9
- 2025MAMM-Refine: A Recipe for Improving Faithfulness in Generation with Multi-Agent Collaborationcited by 9
- 2025OASIS: Online Sample Selection for Continual Visual Instruction Tuningcited by 9
- 2024PMoE: Progressive Mixture of Experts with Asymmetric Transformer for Continual Learningcited by 8
- 2026On-Policy Replay for Continual Supervised Fine-Tuningcited by 8
- 2023Adapter-based Selective Knowledge Distillation for Federated Multi-domain Meeting Summarizationcited by 6
- 2023Zebra: Extending Context Window with Layerwise Grouped Local-Global Attentioncited by 6
- 2024Efficient Data Generation for Source-grounded Information-seeking Dialogs: A Use Case for Meeting Transcriptscited by 6
- 2025Dynamic Compressing Prompts for Efficient Inference of Large Language Modelscited by 6
- 2024Topic-Conversation Relevance (TCR) Dataset and Benchmarkscited by 5
- 2025EFPC: Towards Efficient and Flexible Prompt Compressioncited by 5
- 2025Summarizing Speech: A Comprehensive Surveycited by 5
- 2024Salient Information Prompting to Steer Content in Prompt-based Abstractive Summarizationcited by 4
- 2024Is my Meeting Summary Good? Estimating Quality with a Multi-LLM Evaluatorcited by 4
- 2024Learning to Verify Summary Facts with Fine-Grained LLM Feedbackcited by 4
- 2025ReFeed: Multi-dimensional Summarization Refinement with Reflective Reasoning on Feedbackcited by 4
- 2025MOOSComp: Improving Lightweight Long-Context Compressor via Mitigating Over-Smoothing and Incorporating Outlier Scorescited by 4
- 2024Leveraging Discourse Structure for Extractive Meeting Summarizationcited by 3
- 2024Towards Enhancing Coherence in Extractive Summarization: Dataset and Experiments with LLMscited by 3
- 2025FaithLens: Detecting and Explaining Faithfulness Hallucinationcited by 3
- 2024Detecting Errors through Ensembling Prompts (DEEP): An End-to-End LLM Framework for Detecting Factual Errorscited by 2
- 2024Take Only What You Need: Rank Minimization as an Implicit Forgetting Regularizer in Continual Learningcited by 2
- 2025You need to MIMIC to get FAME: Solving Meeting Transcript Scarcity with a Multi-Agent Conversationscited by 2
- 2025Parameter Importance-Driven Continual Learning for Foundation Modelscited by 2
- 2023Zero-shot Conversational Summarization Evaluations with small Large Language Modelscited by 1
- 2025What Are They Talking About? A Benchmark of Knowledge-Grounded Discussion Summarizationcited by 1
- 2025Cmprsr: Abstractive Token-Level Question-Agnostic Prompt Compressorcited by 1
- 2026Lessons from the Field: An Adaptable Lifecycle Approach to Applied Dialogue Summarizationcited by 1
- 2026Reliability-Aware Determinantal Point Processes for Robust Informative Data Selection in Large Language Modelscited by 1
- 2026MMTB: Evaluating Terminal Agents on Multimedia-File Taskscited by 1
50 most cited of 84 All 84 (JSON)
- 2026Blocking at the Boundary: Auditing Long-Horizon Agents against Staged Prompt Injection4 Oct 2026
- 2026Stabilizing language models under continual learning via condition-anchored distillation3 Oct 2026
- 2026Zero-Shot Cue-Grounded Topic Segmentation of Spoken Documents28 Sep 2026
- 2026Muon Can Outperform Dedicated Continual Learning Methods21 Sep 2026
- 2026GLARE: Generative Learning via Adversarial Reward Estimation For Social Dynamics Forecasting10 Sep 2026
- 2026CAMFT: Conflict-Aware Mergeable Fine-Tuning for Large Language Models6 Sep 2026
- 2026Speak for Me: Giving LLMs the Situational Awareness to Participate in a Meeting3 Sep 2026
- 2026Token Distribution versus Data Volume: Domain Balancing in Multi-Domain Meeting Summarisation16 Aug 2026
- 2026SoftmaxGRPO: Learning to Reason using Softmax Advantage Group Estimation10 Aug 2026
- 2026TIDES: A Longitudinal Bilingual Dataset for Modeling Multi-Party Social Dynamics3 Aug 2026
- 2026Dialogue Summarization with Emotion Dynamics Using Topic- and Participant-Centric Decomposition16 Jul 2026
- 2026Detecting Hallucinations in Retrieval-Augmented Generation through Grounding-Aware Sensitivity by Perturbation (GASP)5 Jul 2026
38 more
- 2026Evaluation-as-Search: Adaptive Discovery of Grounding Failures in Meeting Assistants30 Jun 2026
- 2026Topic-to-Timestamp Alignment by Constrained Evidence Selection18 Jun 2026
- 2026Large Language Models Do Not Always Need Readable Language18 Jun 2026
- 2026A Large-Scale Multi-Dimensional Empirical Study of LLMs for Conversation Summarization14 Jun 2026
- 2026Sparse Subspace-to-Expert Sharing for Task-Agnostic Continual Learning5 Jun 2026
- 2026On-Policy Replay for Continual Supervised Fine-Tuning28 May 2026
- 2026MMTB: Evaluating Terminal Agents on Multimedia-File Tasks8 May 2026
- 2026Evaluating AI Meeting Summaries with a Reusable Cross-Domain Pipeline23 Apr 2026
- 2026Rethinking Meeting Effectiveness: A Benchmark and Framework for Temporal Fine-grained Automatic Meeting Effectiveness Evaluation19 Apr 2026
- 2026Understanding the Effects of Safety Unalignment on Large Language Models2 Apr 2026
- 2026What Do Claim Verification Datasets Actually Test? A Reasoning Trace Analysis2 Apr 2026
- 2026ThinknCheck: Grounded Claim Verification with Compact, Reasoning-Driven, and Interpretable Models2 Apr 2026
- 2026CitiLink-Summ: Summarization of Discussion Subjects in European Portuguese Municipal Meeting Minutes18 Feb 2026
- 2026CitiLink-Minutes: A Multilayer Annotated Dataset of Municipal Meeting Minutes12 Feb 2026
- 2026NLP for Local Governance Meeting Records: A Focus Article on Tasks, Datasets, Metrics and Benchmark8 Feb 2026
- 2026DIAL-SUMMER: A Structured Evaluation Framework of Hierarchical Errors in Dialogue Summaries8 Feb 2026
- 2026Reliability-Aware Determinantal Point Processes for Robust Informative Data Selection in Large Language Models31 Jan 2026
- 2026Split-on-Share: Mixture of Sparse Experts for Task-Agnostic Continual Learning24 Jan 2026
- 2026Lessons from the Field: An Adaptable Lifecycle Approach to Applied Dialogue Summarization13 Jan 2026
- 2026VotIE: Information Extraction from Meeting Minutes7 Jan 2026
- 2025FaithLens: Detecting and Explaining Faithfulness Hallucination23 Dec 2025
- 2025Parameter Importance-Driven Continual Learning for Foundation Models19 Nov 2025
- 2025Cmprsr: Abstractive Token-Level Question-Agnostic Prompt Compressor15 Nov 2025
- 2025SynClaimEval: A Framework for Evaluating the Utility of Synthetic Data in Long-Context Claim Verification12 Nov 2025
- 2025When Compression Becomes an Attack Surface: Black-Box Attacks on Prompt-Compressed LLM Agents27 Oct 2025
- 2025Scaling Decentralized Learning with FLock21 Jul 2025
- 2025Towards Multi-dimensional Evaluation of LLM Summarization across Domains and Languages31 May 2025
- 2025OASIS: Online Sample Selection for Continual Visual Instruction Tuning27 May 2025
- 2025textttDIAMONDs: A Dataset for mathbbDynamic mathbbInformation mathbbAnd mathbbMental modeling mathbbOf mathbbNumeric mathbbDiscussions19 May 2025
- 2025What Are They Talking About? A Benchmark of Knowledge-Grounded Discussion Summarization18 May 2025
- 2025Benchmarking LLM Faithfulness in RAG with Evolving Leaderboards7 May 2025
- 2025MOOSComp: Improving Lightweight Long-Context Compressor via Mitigating Over-Smoothing and Incorporating Outlier Scores23 Apr 2025
- 2025Dynamic Compressing Prompts for Efficient Inference of Large Language Models15 Apr 2025
- 2025Summarizing Speech: A Comprehensive Survey10 Apr 2025
- 2025ReFeed: Multi-dimensional Summarization Refinement with Reflective Reasoning on Feedback27 Mar 2025
- 2025MAMM-Refine: A Recipe for Improving Faithfulness in Generation with Multi-Agent Collaboration19 Mar 2025
- 2025EFPC: Towards Efficient and Flexible Prompt Compression11 Mar 2025
- 2025You need to MIMIC to get FAME: Solving Meeting Transcript Scarcity with a Multi-Agent Conversations18 Feb 2025
50 newest of 84 All 84 (JSON)
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 348
- 2025Dynamic Compressing Prompts for Efficient Inference of Large Language Modelscited by 6
- 2025EFPC: Towards Efficient and Flexible Prompt Compressioncited by 5
- 2025Cmprsr: Abstractive Token-Level Question-Agnostic Prompt Compressorcited by 1
- 2026Reliability-Aware Determinantal Point Processes for Robust Informative Data Selection in Large Language Modelscited by 1
- 2024JPPO: Joint Power and Prompt Optimization for Accelerated Large Language Model Servicescited by 0
- 2026Reliability-Aware Determinantal Point Processes for Robust Informative Data Selection in Large Language Models31 Jan 2026
- 2025Cmprsr: Abstractive Token-Level Question-Agnostic Prompt Compressor15 Nov 2025
- 2025Dynamic Compressing Prompts for Efficient Inference of Large Language Models15 Apr 2025
- 2025EFPC: Towards Efficient and Flexible Prompt Compression11 Mar 2025
- 2024JPPO: Joint Power and Prompt Optimization for Accelerated Large Language Model Services27 Nov 2024
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression19 Mar 2024
- 2025Faithful, Unfaithful or Ambiguous? Multi-Agent Debate with Initial Stance for Summary Evaluationcited by 10
- 2025MAMM-Refine: A Recipe for Improving Faithfulness in Generation with Multi-Agent Collaborationcited by 9
- 2025You need to MIMIC to get FAME: Solving Meeting Transcript Scarcity with a Multi-Agent Conversationscited by 2
- 2025When Compression Becomes an Attack Surface: Black-Box Attacks on Prompt-Compressed LLM Agentscited by 0
- 2026Speak for Me: Giving LLMs the Situational Awareness to Participate in a Meetingcited by 0
- 2026Speak for Me: Giving LLMs the Situational Awareness to Participate in a Meeting3 Sep 2026
- 2025When Compression Becomes an Attack Surface: Black-Box Attacks on Prompt-Compressed LLM Agents27 Oct 2025
- 2025MAMM-Refine: A Recipe for Improving Faithfulness in Generation with Multi-Agent Collaboration19 Mar 2025
- 2025You need to MIMIC to get FAME: Solving Meeting Transcript Scarcity with a Multi-Agent Conversations18 Feb 2025
- 2025Faithful, Unfaithful or Ambiguous? Multi-Agent Debate with Initial Stance for Summary Evaluation12 Feb 2025
- 2023TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Modelscited by 66
- 2024Learning to Summarize from LLM-generated Feedbackcited by 24
- 2024Learning to Verify Summary Facts with Fine-Grained LLM Feedbackcited by 4
- 2026Understanding the Effects of Safety Unalignment on Large Language Modelscited by 0
- 2026Understanding the Effects of Safety Unalignment on Large Language Models2 Apr 2026
- 2024Learning to Verify Summary Facts with Fine-Grained LLM Feedback14 Dec 2024
- 2024Learning to Summarize from LLM-generated Feedback17 Oct 2024
- 2023TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models10 Oct 2023
- 2024TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement Learningcited by 22
- 2025Parameter Importance-Driven Continual Learning for Foundation Modelscited by 2
- 2026SoftmaxGRPO: Learning to Reason using Softmax Advantage Group Estimationcited by 1
- 2026What Do Claim Verification Datasets Actually Test? A Reasoning Trace Analysiscited by 0
- 2026SoftmaxGRPO: Learning to Reason using Softmax Advantage Group Estimation10 Aug 2026
- 2026What Do Claim Verification Datasets Actually Test? A Reasoning Trace Analysis2 Apr 2026
- 2025Parameter Importance-Driven Continual Learning for Foundation Models19 Nov 2025
- 2024TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement Learning19 Sep 2024
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 257
- 2025Benchmarking LLM Faithfulness in RAG with Evolving Leaderboardscited by 20
- 2025FaithLens: Detecting and Explaining Faithfulness Hallucinationcited by 3
- 2026Detecting Hallucinations in Retrieval-Augmented Generation through Grounding-Aware Sensitivity by Perturbation (GASP)cited by 1
- 2026Detecting Hallucinations in Retrieval-Augmented Generation through Grounding-Aware Sensitivity by Perturbation (GASP)5 Jul 2026
- 2025FaithLens: Detecting and Explaining Faithfulness Hallucination23 Dec 2025
- 2025Benchmarking LLM Faithfulness in RAG with Evolving Leaderboards7 May 2025
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents16 Apr 2024
- 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 102
- 2024TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarizationcited by 66
- 2023Data Contamination Quiz: A Tool to Detect and Estimate Contamination in Large Language Modelscited by 47
- 2024AdaCAD: Adaptively Decoding to Balance Conflicts between Contextual and Parametric Knowledgecited by 37
- 2023Building Real-World Meeting Summarization Systems using Large Language Models: A Practical Perspectivecited by 34
- 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
- 2024Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Coursecited by 19
- 2024CriSPO: Multi-Aspect Critique-Suggestion-guided Automatic Prompt Optimization for Text Generationcited by 18
- 2024SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generationcited by 12
- 2025Forget Forgetting: Continual Learning in a World of Abundant Memorycited by 11
- 2025Towards Multi-dimensional Evaluation of LLM Summarization across Domains and Languagescited by 11
12 most cited of 55 All 55 (JSON)
- 2026Zero-Shot Cue-Grounded Topic Segmentation of Spoken Documents28 Sep 2026
- 2026Muon Can Outperform Dedicated Continual Learning Methods21 Sep 2026
- 2026GLARE: Generative Learning via Adversarial Reward Estimation For Social Dynamics Forecasting10 Sep 2026
- 2026CAMFT: Conflict-Aware Mergeable Fine-Tuning for Large Language Models6 Sep 2026
- 2026Token Distribution versus Data Volume: Domain Balancing in Multi-Domain Meeting Summarisation16 Aug 2026
- 2026TIDES: A Longitudinal Bilingual Dataset for Modeling Multi-Party Social Dynamics3 Aug 2026
- 2026Dialogue Summarization with Emotion Dynamics Using Topic- and Participant-Centric Decomposition16 Jul 2026
- 2026Evaluation-as-Search: Adaptive Discovery of Grounding Failures in Meeting Assistants30 Jun 2026
- 2026Topic-to-Timestamp Alignment by Constrained Evidence Selection18 Jun 2026
- 2026Large Language Models Do Not Always Need Readable Language18 Jun 2026
- 2026A Large-Scale Multi-Dimensional Empirical Study of LLMs for Conversation Summarization14 Jun 2026
- 2026Sparse Subspace-to-Expert Sharing for Task-Agnostic Continual Learning5 Jun 2026
12 newest of 55 All 55 (JSON)