mlsanityData to 19 Oct 2026

HALO: Half-Frame-Rate Adaptive Learnable Operator for Lightweight STFT-Based Speech Enhancement

arXiv 2606.12328 ↗First posted 10 Jun 2026eess.AScited by 0

On the map: Speech and audio language models → Speech enhancement and noise suppression

Abstract (arXiv)

STFT-based speech enhancement typically adopts overlapping analysis frames. While overlap is essential for stable STFT processing, it makes adjacent frames highly correlated, causing redundant computation in lightweight models. We propose Half-frame-rate Adaptive Learnable Operator (HALO), a causal plug-in module that halves the internal frame rate without altering the STFT procedure. Broadly applicable to many lightweight models, HALO applies adaptive rate reduction before the backbone and restoration afterward, reconstructing the full-rate spectrum on the original STFT grid. Both reduction and restoration are implemented with lightweight dynamic convolutions. By halving the processed frame rate, HALO reduces backbone compute cost with no added algorithmic latency, freeing budget for channel widening. Experiments on the DNS3 dataset show consistent gains across diverse lightweight models under matched complexity, demonstrating the effectiveness of reducing overlap-induced redundancy.

Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 22 of its 30 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

22 of 30 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025UL-UNAS: Ultra-Lightweight U-Nets for Real-Time Speech Enhancement via Network Architecture Search1 Mar
  2. 2025Adaptive Convolution for CNN-based Speech Enhancement Models20 Feb
  3. 2024LiSenNet: Lightweight Sub-band and Dual-Path Modeling for Real-Time Speech Enhancement20 Sep
  4. 2024Beyond Performance Plateaus: A Comprehensive Study on Scalability in Speech Enhancement6 Jun
  5. 2023Causal Signal-Based DCCRN with Overlapped-Frame Prediction for Online Speech Enhancement7 Sep
  6. 2022DeepFilterNet2: Towards Real-Time Speech Enhancement on Embedded Devices for Full-Band Audio11 May
  7. 2022STFT-Domain Neural Speech Enhancement with Very Low Algorithmic Latency21 Apr
  8. 2022Improving Frame-Online Neural Speech Enhancement with Overlapped-Frame Prediction15 Apr
  9. 2021DPCRN: Dual-Path Convolution Recurrent Network for Single Channel Speech Enhancement12 Jul
  10. 2021TSTNN: Two-stage Transformer based Neural Network for Speech Enhancement in the Time Domain18 Mar

Other references · 12

  1. 2014Adam: A Method for Stochastic Optimizationcited by 38,210
  2. 2018SDR - half-baked or well done?cited by 626
  3. 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 596
  4. 2019Dynamic Convolution: Attention over Convolution Kernelscited by 361
  5. 2021DNSMOS P.835: A Non-Intrusive Perceptual Objective Speech Quality Metric to Evaluate Noise Suppressorscited by 292
  6. 2020DCCRN: Deep Complex Convolution Recurrent Network for Phase-Aware Speech Enhancementcited by 284
  7. 2019CondConv: Conditionally Parameterized Convolutions for Efficient Inferencecited by 275
  8. 2019Dual-path RNN: efficient long sequence modeling for time-domain single-channel speech separationcited by 275
  9. 2022TF-GridNet: Integrating Full- and Sub-Band Modeling for Speech Separationcited by 121
  10. 2021Interspeech 2021 Deep Noise Suppression Challengecited by 96
  11. 2020DiDiSpeech: A Large Scale Mandarin Speech Corpuscited by 51
  12. 2021Adaptive Convolutions with Per-pixel Dynamic Filter Atomcited by 12

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Efficient Transformer-based Speech Enhancement Using Long Frames and STFT Magnitudes
  2. 2026Towards Lightweight Adaptation of Speech Enhancement Models in Real-World Environments
  3. 2026Configurable-Bandwidth Time-Frequency Modeling for Efficient Full-Band Speech Enhancement Across Sampling Rates
  4. 2024Modulating State Space Model with SlowFast Framework for Compute-Efficient Ultra Low-Latency Speech Enhancement
  5. 2026Towards Balanced Spectral Reconstruction: Spectrally Adaptive Loss for Streaming Speech Enhancement ↗
  6. 2025Lightweight Front-end Enhancement for Robust ASR via Frame Resampling and Sub-Band Pruning
  7. 2024Hold Me Tight: Stable Encoder-Decoder Design for Speech Enhancement
  8. 2026A Hybrid Classical-Learning Framework for Adaptive Decision Directed Speech Enhancement