mlsanityData to 7 Oct 2026

Listen, Reason, and Segment: Aligning LALMs with Editorial Judgment for Media Chapterization

arXiv 2608.16539 ↗First posted 17 Aug 2026cs.SD cs.AI cs.CLcited by 0

On the map: LLM reasoning → Audio-language model reasoning

Abstract (arXiv)

Large Audio Language Models (LALMs) have made rapid progress on standardized benchmarks, yet their deployment in practical media workflows, curation, archival indexing, and content distribution remains largely unrealized. We identify automated audio chapterization, the task of segmenting continuous audio streams into thematically coherent chapters, as a demanding and commercially consequential setting that exposes this gap. Chapterization is challenging because boundaries are defined less by objective acoustic events than by subjective editorial judgment, requiring models to reason sequentially over long acoustic contexts and approximate creator-authored boundary decisions. We present AudioChaps, a post-training framework for aligning end-to-end LALMs for this task via Group Relative Policy Optimization (GRPO) guided by Chain-of-Thought (CoT) reasoning. To support training and evaluation, we curate three datasets: AudioChaps-Alignment, derived from creator-annotated chapter boundaries on YouTube; AudioChaps-CoT, which provides structured supervision for well-formatted, high-quality, and evidence-grounded boundary reasoning; and AudioChaps-Eval, a held-out benchmark for audio chapterization. Applying GRPO directly without a Supervised Fine-Tuning (SFT) cold start, AudioChaps-R1-Zero already improves average F1 by 33 points over the state-of-the-art LALM Audio-Flamingo-3-Think. The AudioChaps framework produces our final aligned LALM, AudioChaps-R1, which improves average F1 by 49 points. These results demonstrate that GRPO-trained LALMs can reliably transform unstructured auditory streams into navigable, structured media. Our code, models, and dataset resources will be released upon acceptance at https://github.com/ta012/AudioChaps.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 20 of its 26 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

20 of 26 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Step-Audio-R1 Technical Report19 Nov
  2. 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models10 Jul
  3. 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmark5 Jun
  4. 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix19 May
  5. 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities6 Mar
  6. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark24 Oct

Other references · 14

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  5. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  6. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  7. 2024Qwen2-Audio Technical Reportcited by 543
  8. 2025Qwen3-Omni Technical Reportcited by 451
  9. 2023XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Modelscited by 61
  10. 2024Isambard-AI: a leadership class supercomputer optimised specifically for Artificial Intelligencecited by 59
  11. 2023VidChapters-7M: Video Chapters at Scalecited by 39
  12. 2026MOSS-Audio Technical Reportcited by 9
2 more
  1. 2025ARC-Chapter: Structuring Hour-Long Videos into Navigable Chapters and Hierarchical Summariescited by 6
  2. 2025PAL: Probing Audio Encoders via LLMs -- Audio Information Transfer into LLMscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Transcripts: A Renewed Perspective on Audio Chaptering
  2. 2026ReasonAudio: A Benchmark for Evaluating Reasoning Beyond Matching in Text-Audio Retrieval
  3. 2026CORD: Bridging the Audio-Text Reasoning Gap via Weighted On-policy Cross-modal Distillation
  4. 2025Mellow: a small audio language model for reasoning
  5. 2026AudioDER: A Deduplication-Enhanced Reasoning Dataset for Post-Training Large Audio-Language Models
  6. 2026Can Structural Cues Save LLMs? Evaluating Language Models in Massive Document Streams
  7. 2026Multi-Source Evidence Fusion for Audio Question Answering
  8. 2026AQAScore: Evaluating Semantic Alignment in Text-to-Audio Generation via Audio Question Answering