mlsanityData to 14 Oct 2026

The Spoken Wikipedia Presentation Corpus

arXiv 2609.21676 ↗First posted 18 Sep 2026eess.AS cs.CL cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

We present the Spoken Wikipedia Presentation Corpus, an extension of the Spoken Wikipedia Corpora featuring LLM-generated slide decks for multimodal ASR. Slides are created from LLM-segmented sections using a hybrid pipeline that combines LLM-based content planning with rule-based design decisions. For each section, an LLM generates a slide title, bullet points, a takeaway message, and a visual description that is used to create an illustration. Rule-based matching then selects layouts, themes, and styles to produce the final slides. A vision LLM extracts slide text as Markdown. We evaluate multiple ASR and spoken language models (SLMs). The best model achieves an average micro-WER of 10.23% and an average micro-CER of 6.48% on audio-only inputs. English yields the lowest error rates, followed by German and Dutch, while performance declines across lower-resource languages. Although audio-only baselines are strong, multimodal zero-shot prompting of omni models remains challenging. The aligned slide, text, and audio data show a strong potential to improve recognition through cross-modal context.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 16 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

11 of 16 references.

References · 11

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
  3. 2025On The Landscape of Spoken Language Models: A Comprehensive Surveycited by 118
  4. 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 86
  5. 2026LightOnOCR: A 1B End-to-End Multilingual Vision-Language Model for State-of-the-Art OCRcited by 23
  6. 2023SlideSpeech: A Large-Scale Slide-Enriched Audio-Visual Corpuscited by 19
  7. 2026DeepPresenter: Environment-Grounded Reflection for Agentic Presentation Generationcited by 18
  8. 2025Presenting a Paper is an Art: Self-Improvement Aesthetic Agents for Academic Presentationscited by 13
  9. 2024SlideAVSR: A Dataset of Paper Explanation Videos for Audio-Visual Speech Recognitioncited by 7
  10. 2025Do Slides Help? Multi-modal Context for Automatic Transcription of Conference Talkscited by 5
  11. 2024MaViLS, a Benchmark Dataset for Video-to-Slide Alignment, Assessing Baseline Accuracy with a Multimodal Alignment Algorithm Leveraging Speech, OCR, and Visual Featurescited by 2

Built on by

Not cited yet.