SEAM: Shortcut-Aware Real-Time Detection of Scripted vs. Spontaneous Speech for Interview Guardrails
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
Scripted vs spontaneous speech detection is appealing for interview guardrails, but benchmark performance can be inflated by shortcuts tied to corpus identity, channel conditions, and recording artifacts rather than speaking style itself. We present SEAM, a shortcut-aware framework for real-time scriptedness detection that combines uniform preprocessing, seam-aware sampling, non-speech augmentation, and a compact DistilHuBERT backbone. With 8s windows, the model achieves 0.971 +- 0.004 ROC-AUC on an external interview-domain evaluation set. Removing the shortcut-prevention components improves internal held-out metrics but sharply reduces external performance, indicating shortcut learning. Post-training quantization reduces the model footprint to 41.8MB with little loss in external performance. The results demonstrate that robust real-time scriptedness detection depends not only on the backbone, but on shortcut-aware data design and evaluation. We release code and model checkpoints.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 16 of its 26 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
16 of 26 references.
References · 16
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
- 2021SUPERB: Speech processing Universal PERformance Benchmarkcited by 666
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 406
- 2021DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERTcited by 144
- 2021The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usagecited by 101
- 2022HEAR: Holistic Evaluation of Audio Representationscited by 78
- 2020A Differentiable Perceptual Audio Metric Learned from Just Noticeable Differencescited by 23
4 more
- 2022Filler Word Detection and Classification: A Dataset and Benchmarkcited by 7
- 2023How to Construct Perfect and Worse-than-Coin-Flip Spoofing Countermeasures: A Word of Warning on Shortcut Learningcited by 6
- 2017Content-based Representations of audio using Siamese neural networkscited by 4
- 2024Classification of Spontaneous and Scripted Speech for Multilingual Audiocited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025AU-Harness: An Open-Source Toolkit for Holistic Evaluation of Audio LLMs
- 2024A Flexible Large Language Models Guardrail Development Methodology Applied to Off-Topic Prompt Detection
- 2025BLAB: Brutally Long Audio Bench
- 2025Artificial Conversations, Real Results: Fostering Language Detection with Synthetic Data
- 2025ALMGuard: Safety Shortcuts and Where to Find Them as Guardrails for Audio-Language Models
- 2022Device-Directed Speech Detection: Regularization via Distillation for Weakly-Supervised Models
- 2026Do Audio LLMs Listen Before They Act? Diagnosing Acoustic-Context Gating in Voice Agents
- 2024Beyond Oversmoothing: Evaluating DDPM and MSE for Scalable Speech Synthesis in ASR