The tttAI System for the TSA-ASR Task of the SmartGlasses Challenge 2026
On the map: Speech and audio language models → Speaker recognition and diarization
Abstract (arXiv)
This paper presents the tttAI system submitted to the TSA-ASR task of the SmartGlasses Challenge 2026, evaluated on both two-person dialogues (Track 1) and multi-party meetings (Track 2). The task requires time-stamped speaker-attributed speech recognition from smart-glasses recordings. This is particularly challenging due to long-form audio, multiple speakers, and frequent overlapping speech. We proposed a cascaded architecture consisting of speaker diarization, overlap detection, target-speaker extraction, post-processing, and automatic speech recognition. The diarization module extracts features via WavLM-Large, performs frame-wise speaker classification with a Conformer encoder, and then generates global speaker segments through embedding clustering. For overlapped regions, we apply a WeSep-based target-speaker extraction model with ECAPA-TDNN speaker embeddings. When the extraction is unreliable, a dominant-speaker fallback strategy is used. The final system uses FireRedASR2-AED with the first microphone channel. The submitted system has a total parameter count of approximately 1.53B. On Track 1, our system achieves a tcpCER of 7.10%. On Track 2, it achieves a tcpCER of 34.04% and ranks second on the leaderboard.
Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speaker recognition and diarization, one of 11 directions in Speech and audio language models. Builds on 18 of its 21 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
18 of 21 references.
Closest ancestors · 5
Same direction, newest first
- 2025Summary on The Multilingual Conversational Speech Language Model Challenge: Datasets, Tasks, Baselines, and Methods17 Sep
- 2025Fine-tune Before Structured Pruning: Towards Compact and Accurate Self-Supervised Models for Speaker Diarization30 May
- 2024Leveraging Self-Supervised Learning for Speaker Diarization14 Sep
- 2024NOTSOFAR-1 Challenge: New Datasets, Baseline, and Tasks for Distant Meeting Transcription16 Jan
- 2021M2MeT: The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Challenge14 Oct
Other references · 13
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 2,293
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 2,135
- 2026Qwen3-ASR Technical Reportcited by 162
- 2019End-to-End Neural Speaker Diarization with Self-attentioncited by 139
- 2020Spot the conversation: speaker diarisation in the wildcited by 128
- 2021AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenariocited by 125
- 2020The Third DIHARD Diarization Challengecited by 89
- 2022Music Source Separation with Band-split RNNcited by 89
- 2022Open Source MagicData-RAMC: A Rich Annotated Mandarin Conversational(RAMC) Speech Datasetcited by 64
- 2021Encoder-Decoder Based Attractors for End-to-End Neural Diarizationcited by 49
- 2023MeetEval: A Toolkit for Computation of Word Error Rates for Meeting Transcription Systemscited by 49
- 2026FireRedASR2S: A State-of-the-Art Industrial-Grade All-in-One Automatic Speech Recognition Systemcited by 23
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026The SLT 2026 SmartGlasses Challenge: Benchmarking Egocentric Multi-Talker Speech Recognition and Understanding with Audio-Language Models
- 2025Lightweight Target-Speaker-Based Overlap Transcription for Practical Streaming ASR
- 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
- 2024Investigation of Speaker Representation for Target-Speaker Speech Processing
- 2026An Omnilingual-ASR-Based Speech-LLM System for the 2nd MLC-SLM Challenge
- 2024M-BEST-RQ: A Multi-Channel Speech Foundation Model for Smart Glasses
- 2022VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
- 2023Conformer-based Target-Speaker Automatic Speech Recognition for Single-Channel Audio