mlsanityData to 7 Oct 2026

Summarizing Speech: A Comprehensive Survey

arXiv 2504.08024 ↗First posted 10 Apr 2025cs.CL cs.SD eess.AScited by 5

Not on the map. Why?

Abstract (arXiv)

Speech summarization has become an essential tool for efficiently managing and accessing the growing volume of spoken and audiovisual content. However, despite its increasing importance, speech summarization remains loosely defined. The field intersects with several research areas, including speech recognition, text summarization, and specific applications like meeting summarization. This survey not only examines existing datasets and evaluation protocols, which are crucial for assessing the quality of summarization approaches, but also synthesizes recent developments in the field, highlighting the shift from traditional systems to advanced models like fine-tuned cascaded architectures and end-to-end solutions. In doing so, we surface the ongoing challenges, such as the need for realistic evaluation benchmarks, multilingual datasets, and long-context handling.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 121 of its 245 references that are in the map. First posted on arXiv 10 Apr 2025.

Builds on

121 of 245 references.

References · 121

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  6. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  7. 2020Longformer: The Long-Document Transformercited by 3,362
  8. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  9. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  10. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  11. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  12. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
38 more
  1. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  2. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  3. 2023Large Language Models are not Fair Evaluatorscited by 1,050
  4. 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
  5. 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 738
  6. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  7. 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
  8. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 578
  9. 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 530
  10. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
  11. 2023Benchmarking Large Language Models for News Summarizationcited by 444
  12. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
  13. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
  14. 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 376
  15. 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
  16. 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 343
  17. 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
  18. 2020FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarizationcited by 292
  19. 2021All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Textcited by 287
  20. 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
  21. 2021QuestEval: Summarization Asks for Fact-based Evaluationcited by 241
  22. 2024Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judgescited by 197
  23. 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 181
  24. 2022Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluationcited by 141
  25. 2020With Little Power Comes Great Responsibilitycited by 138
  26. 2018How2: A Large-scale Dataset for Multimodal Language Understandingcited by 137
  27. 2021MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarizationcited by 104
  28. 2020Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summarycited by 87
  29. 2024FineSurE: Fine-grained Summarization Evaluation using LLMscited by 83
  30. 2023MeetingBank: A Benchmark Dataset for Meeting Summarizationcited by 81
  31. 2020Fill in the BLANC: Human-free quality estimation of document summariescited by 80
  32. 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
  33. 2024TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarizationcited by 66
  34. 2021Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documentscited by 64
  35. 2019Leveraging BERT for Extractive Text Summarization on Lecturescited by 63
  36. 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
  37. 2023AudioChatLlama: Towards General-Purpose Speech Abilities for LLMscited by 59
  38. 2022LENS: A Learnable Evaluation Metric for Text Simplificationcited by 54

50 most cited of 121 All 121 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.

  1. 2025Conversational Speech Reveals Structural Robustness Failures in SpeechLLM Backbonescited by 2
  2. 2025Z-Scores: A Metric for Linguistically Assessing Disfluency Removalcited by 1
  3. 2026Multilingual Long-Form Speech Instruction Following: KIT's Submission to IWSLT 2026cited by 1
  4. 2026Do What I Say: A Spoken Prompt Dataset for Instruction-Followingcited by 0
  5. 2026Speech-to-SOAP: End-to-End Summarization of Medical Dialogues: KIT@BeTraC 2026cited by 0