TARQ: Tail-Aware Reconstruction Quantization for Rare-Word Robust Automatic Speech Recognition
Not on the map. Why?
Abstract (arXiv)
Data-aware post-training quantization (PTQ) minimizes a per-token reconstruction loss on a small calibration corpus, implicitly weighting positions by their empirical frequency. For Automatic Speech Recognition (ASR), this misaligns with tail-sensitive risk: names, numerals, and domain-specific words receive proportionally little calibration mass. We propose Tail-Aware Reconstruction Quantization (TARQ), a label-free PTQ framework that shifts calibration toward the lexical tail via rareBAL, a closed-form per-Linear-layer rule equalizing common/tail mass, paired with a metric-consistent residual correction. TARQ requires no entity labels, no curated calibration set, no validation decoding, and no additional training. Across eight ASR backbones and six datasets at W4G128, TARQ improves mean rare-Word Error Rate (rare-WER) without an aggregate-WER regression, achieves the lowest cross-corpus rare-WER swing among compared methods, and transfers to entity-rich benchmarks (ProfASR, ContextASR-Speech-En) without entity supervision.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
16 of 26 references.
References · 16
- 2017Attention Is All You Needcited by 60,361
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 815
- 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 463
- 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 399
- 2024QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebookscited by 378
- 2023SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compressioncited by 367
- 2021Contextualized Streaming End-to-End Speech Recognition with Trie-Based Deep Biasing and Shallow Fusioncited by 101
- 2024QTIP: Quantization with Trellises and Incoherence Processingcited by 91
- 2021SPGISpeech: 5,000 hours of transcribed financial audio for fully formatted end-to-end speech recognitioncited by 78
- 2021Tree-constrained Pointer Generator for End-to-end Contextual Speech Recognitioncited by 32
- 2021Integer-only Zero-shot Quantization for Efficient Speech Recognitioncited by 19
4 more
- 2025ContextASR-Bench: A Massive Contextual Speech Recognition Benchmarkcited by 15
- 2022Minimising Biasing Word Errors for Contextual ASR with the Tree-Constrained Pointer Generatorcited by 11
- 2025Edge-ASR: Towards Low-Bit Quantization of Automatic Speech Recognition Modelscited by 5
- 2025StableQuant: Layer Adaptive Post-Training Quantization for Speech Foundation Modelscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FidelityQ: Preserving Predictive Fidelity in Ultra-Low-Bit Language Model Quantization
- 2026Robust Ultra Low-Bit Post-Training Quantization via Stable Diagonal Curvature Estimate
- 2025Rethinking Post-Training Quantization: Introducing a Statistical Pre-Calibration Approach
- 2026When Lower Reconstruction Loss Hurts: Distributionally Robust Refinement for Low-Bit LLM Quantization
- 2025StableToken: A Noise-Robust Semantic Speech Tokenizer for Resilient SpeechLLMs
- 2024Autoregressive Speech Synthesis without Vector Quantization
- 2024ResQ: Mixed-Precision Quantization of Large Language Models with Low-Rank Residuals
- 2023CBQ: Cross-Block Quantization for Large Language Models