mlsanityData to 19 Oct 2026

faster-enhancer.c: A Dependency-Free int8 Runtime for Streaming Speech Enhancement on Commodity CPUs

arXiv 2607.25350 ↗First posted 28 Jul 2026eess.AS cs.SDcited by 0

On the map: Speech and audio language models → Speech enhancement and noise suppression

Abstract (arXiv)

This is an implementation and measurement study of what it costs to run a streaming speech enhancer on a CPU. We port FastEnhancer-Medium at 48 kHz to faster-enhancer.c, a C runtime with six int8 GEMM tiers selected at initialization, leaving architecture and weights untouched. One Apple M2 core reaches 0.069 real-time factor, against 0.230 for the fp32 ONNX Runtime graph on the same machine, a 3.3x speedup. A Galaxy S23+ (Snapdragon 8 Gen 2) reaches 0.096. The speedup comes from specializing every layer of the runtime around one fixed model. Activation ranges are recomputed per frame, so no calibration set is needed; the k=3 convolutions use Winograd F(2,3); cross-stage state is fp16; the GRU and the dequantization epilogues are fused; and nothing is allocated after startup. Over 824 VoiceBank-DEMAND utterances the engine tracks fp32 to within -0.006 PESQ and -0.08 dB SNR. Speed alone does not settle deployment cost. The enhancer holds a fraction of a core for as long as the microphone is open, so its real-time factor is a duty cycle. A benchmark races through a file; an audio callback does not. Pacing to the 6.67 ms deadline costs 4.2x per frame, saves 49% of the energy, and leaves the cheapest core placement missing 96% of its deadlines. All SIMD tiers within an architecture family emit byte-identical output. The runtime is released as a dependency-free library.

Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 13 of its 24 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

13 of 24 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025FastEnhancer: Speed-Optimized Streaming Neural Speech Enhancement26 Sep
  2. 2024EARS: An Anechoic Fullband Speech Dataset Benchmarked for Speech Enhancement and Dereverberation10 Jun
  3. 2022Accelerating RNN-based Speech Enhancement on a Multi-Core MCU with Mixed FP16-INT8 Post-Training Quantization14 Oct
  4. 2022DeepFilterNet2: Towards Real-Time Speech Enhancement on Embedded Devices for Full-Band Audio11 May
  5. 2021DeepFilterNet: A Low Complexity Speech Enhancement Framework for Full-Band Audio based on Deep Filtering11 Oct

Other references · 8

  1. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,620
  2. 2018SDR - half-baked or well done?cited by 626
  3. 2021DNSMOS P.835: A Non-Intrusive Perceptual Objective Speech Quality Metric to Evaluate Noise Suppressorscited by 292
  4. 2015Fast Algorithms for Convolutional Neural Networkscited by 104
  5. 2017A Hybrid DSP/Deep Learning Approach to Real-Time Full-Band Speech Enhancementcited by 67
  6. 2020TinyLSTMs: Efficient Neural Speech Enhancement for Hearing Aidscited by 60
  7. 2024ICASSP 2024 Speech Signal Improvement Challengecited by 30
  8. 2025Navigating PESQ: Up-to-Date Versions and Open Implementationscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Does per-frame early exit pay? A compute-matched study of dynamic depth for on-device speech enhancement
  2. 2025A Low-Power Streaming Speech Enhancement Accelerator For Edge Devices
  3. 2024Modulating State Space Model with SlowFast Framework for Compute-Efficient Ultra Low-Latency Speech Enhancement
  4. 2026Beyond Model Size: Redesigning LiSenNet for embedded speech enhancement
  5. 2026Pushing the Limits of On-Device Streaming ASR: A Compact, High-Accuracy English Model for Low-Latency Inference
  6. 2021Weight, Block or Unit? Exploring Sparsity Tradeoffs for Speech Enhancement on Tiny Neural Accelerators
  7. 2026One Model, Many Latencies: Universal Speech Enhancement for Diverse Real-Time Applications
  8. 2025HiFi-Stream: Streaming Speech Enhancement with Generative Adversarial Networks