mlsanityData to 7 Oct 2026

QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization

arXiv 2104.05938 ↗First posted 13 Apr 2021cs.CLcited by 363

Not on the map. Why?

Cited by 42 in Efficient LLM inference and serving, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Meetings are a key component of human collaboration. As increasing numbers of meetings are recorded and transcribed, meeting summaries have become essential to remind those who may or may not have attended the meetings about the key decisions made and the tasks to be completed. However, it is hard to create a single short summary that covers all the content of a long meeting involving multiple people and topics. In order to satisfy the needs of different types of users, we define a new query-based multi-domain meeting summarization task, where models have to select and summarize relevant spans of meetings in response to a query, and we introduce QMSum, a new benchmark for this task. QMSum consists of 1,808 query-summary pairs over 232 meetings in multiple domains. Besides, we investigate a locate-then-summarize method and evaluate a set of strong summarization baselines on the task. Experimental results and manual analysis reveal that QMSum presents significant challenges in long meeting summarization for future research. Dataset is available at urlhttps://github.com/Yale-LILY/QMSum.

Key facts. Cited by 363 papers in the map (data through 7 Oct 2026). Builds on 35 of its 64 references that are in the map. First posted on arXiv 13 Apr 2021.

Builds on

35 of 64 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  3. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  4. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  5. 2015Teaching Machines to Read and Comprehendcited by 1,039
  6. 2015Pointer Networkscited by 882
  7. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
  8. 2019Text Summarization with Pretrained Encoderscited by 553
  9. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
  10. 2015A Neural Attention Model for Abstractive Sentence Summarizationcited by 394
  11. 2018Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategiescited by 292
  12. 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 245
23 more
  1. 2020Extractive Summarization as Text Matchingcited by 189
  2. 2018Fast Abstractive Summarization with Reinforce-Selected Sentence Rewritingcited by 158
  3. 2017Faithful to the Original: Fact Aware Neural Abstractive Summarizationcited by 141
  4. 2020Heterogeneous Graph Neural Networks for Extractive Document Summarizationcited by 90
  5. 2019ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networkscited by 73
  6. 2018Content Selection in Deep Learning Models of Summarizationcited by 64
  7. 2018Deep Communicating Agents for Abstractive Summarizationcited by 50
  8. 2016Machine Comprehension Using Match-LSTM and Answer Pointercited by 47
  9. 2018Unsupervised Abstractive Meeting Summarization with Multi-Sentence Compression and Budgeted Submodular Maximizationcited by 46
  10. 2017Diversity driven Attention Model for Query-based Abstractive Summarizationcited by 42
  11. 2020AQuaMuSe: Automatically Generating Datasets for Query-Based Multi-Document Summarizationcited by 42
  12. 2018Query Focused Abstractive Summarization: Incorporating Query Relevance, Multi-Document Coverage, and Summary Length Constraints into seq2seq Modelscited by 39
  13. 2019Searching for Effective Neural Extractive Summarization: What Works and What's Nextcited by 38
  14. 2019Neural Extractive Text Summarization with Syntactic Compressioncited by 36
  15. 2019Scoring Sentence Singletons and Pairs for Abstractive Summarizationcited by 34
  16. 2019Improving the Similarity Measure of Determinantal Point Processes for Extractive Multi-Document Summarizationcited by 22
  17. 2019A Closer Look at Data Bias in Neural Extractive Summarization Modelscited by 18
  18. 2020CDEvalSumm: An Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systemscited by 17
  19. 2019Exploring Domain Shift in Extractive Text Summarizationcited by 15
  20. 2020How Domain Terminology Affects Meeting Summarization Performancecited by 14
  21. 2021Enhancing Scientific Papers Summarization with Citation Graphcited by 14
  22. 2019Transforming Wikipedia into Augmented Data for Query-Focused Summarizationcited by 12
  23. 2016A Sentence Compression Based Framework to Query-Focused Multi-Document Summarizationcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 17; 2022: 44; 2023: 59; 2024: 93; 2025: 81; 2026: 69.

363 papers.

Sort:

By area:

  1. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  2. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  3. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,378
  4. 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 848
  5. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  6. 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 594
  7. 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 483
  8. 2024PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funnelingcited by 420
  9. 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
  10. 2023Effective Long-Context Scaling of Foundation Modelscited by 301
  11. 2022UL2: Unifying Language Learning Paradigmscited by 292
  12. 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Modelscited by 272
38 more
  1. 2023Prompt Cache: Modular Attention Reuse for Low-Latency Inferencecited by 255
  2. 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 242
  3. 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 235
  4. 2023L-Eval: Instituting Standardized Evaluation for Long Context Language Modelscited by 232
  5. 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 231
  6. 2024Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inferencecited by 230
  7. 2024Chain of Agents: Large Language Models Collaborating on Long-Context Taskscited by 201
  8. 2025Survey on Evaluation of LLM-based Agentscited by 190
  9. 2023ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understandingcited by 175
  10. 2022SCROLLS: Standardized CompaRison Over Long Language Sequencescited by 170
  11. 2022Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluationcited by 141
  12. 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contextscited by 140
  13. 2023Unlimiformer: Long-Range Transformers with Unlimited Length Inputcited by 127
  14. 2024A Survey on Large Language Model Acceleration based on KV Cache Managementcited by 125
  15. 2022A Length-Extrapolatable Transformercited by 123
  16. 2023A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasetscited by 123
  17. 2023Exploring the Limits of ChatGPT for Query or Aspect-based Text Summarizationcited by 122
  18. 2024Make Your LLM Fully Utilize the Contextcited by 118
  19. 2024Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approachcited by 117
  20. 2023Retrieval meets Long Context Large Language Modelscited by 114
  21. 2024Are self-explanations from Large Language Models faithful?cited by 101
  22. 2024Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systemscited by 87
  23. 2024Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuningcited by 85
  24. 2023CoLT5: Faster Long-Range Transformers with Conditional Computationcited by 84
  25. 2024Long-Context Language Modeling with Parallel Context Encodingcited by 84
  26. 2024A Simple and Effective L2 Norm-Based Strategy for KV Cache Compressioncited by 84
  27. 2023MeetingBank: A Benchmark Dataset for Meeting Summarizationcited by 81
  28. 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
  29. 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
  30. 2024Gated Slot Attention for Efficient Linear-Time Sequence Modelingcited by 73
  31. 2021DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarizationcited by 72
  32. 2022Efficient Long-Text Understanding with Short-Text Modelscited by 71
  33. 2023Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarizationcited by 69
  34. 2021Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documentscited by 64
  35. 2024Training-Free Long-Context Scaling of Large Language Modelscited by 61
  36. 2022OpenCQA: Open-ended Question Answering with Chartscited by 60
  37. 2024Palu: Compressing KV-Cache with Low-Rank Projectioncited by 59
  38. 2025ChunkKV: Semantic-Preserving KV Cache Compression for Efficient Long-Context LLM Inferencecited by 57

50 most cited of 363 All 363 (JSON)