mlsanityData to 19 Oct 2026

Configurable-Bandwidth Time-Frequency Modeling for Efficient Full-Band Speech Enhancement Across Sampling Rates

arXiv 2609.29463 ↗First posted 24 Sep 2026eess.AScited by 0

On the map: Speech and audio language models → Speech enhancement and noise suppression

Abstract (arXiv)

Speech enhancement systems are often developed for a fixed sampling rate, while time-frequency models become more expensive as the number of frequency bins increases. We propose TF-Refiner, a sampling-frequency-independent model that decouples the deep analysis bandwidth from the full-band input and output. A deep encoder processes the band below a configurable cutoff, while a shallow decoder combines the encoded features with input-dependent high-band queries and predicts local complex filters applied to the original noisy STFT. A single parameter set trained at 16 and 48 kHz is evaluated at various sampling rates. On VoiceBank+DEMAND, the universal model outperforms the rate-specific counterparts in PESQ, STOI, and log-spectral distance across the evaluated rates, including rates unseen in training. Random-cutoff training enables inference-time selection of cost-quality operating points without retraining or changing the output bandwidth. These results support configurable analysis bandwidth as a practical design choice for multi-rate full-band enhancement.

Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Speech enhancement and noise suppression, one of 11 directions in Speech and audio language models. Builds on 25 of its 35 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

25 of 35 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026One Model, Many Latencies: Universal Speech Enhancement for Diverse Real-Time Applications24 Jun
  2. 2025FastEnhancer: Speed-Optimized Streaming Neural Speech Enhancement26 Sep
  3. 2025UL-UNAS: Ultra-Lightweight U-Nets for Real-Time Speech Enhancement via Network Architecture Search1 Mar
  4. 2024Improving Design of Input Condition Invariant Speech Enhancement25 Jan
  5. 2023Toward Universal Speech Enhancement for Diverse Input Conditions29 Sep
  6. 2022DeepFilterNet2: Towards Real-Time Speech Enhancement on Embedded Devices for Full-Band Audio11 May
  7. 2022DMF-Net: A decoupling-style multi-band fusion model for full-band speech enhancement1 Mar
  8. 2021DeepFilterNet: A Low Complexity Speech Enhancement Framework for Full-Band Audio based on Deep Filtering11 Oct

Other references · 17

  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,450
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,812
  3. 2018SDR - half-baked or well done?cited by 626
  4. 2020FullSubNet: A Full-Band and Sub-Band Fusion Model for Real-Time Single-Channel Speech Enhancementcited by 121
  5. 2022TF-GridNet: Integrating Full- and Sub-Band Modeling for Speech Separationcited by 121
  6. 2022ICASSP 2022 Deep Noise Suppression Challengecited by 107
  7. 2023Siamese Masked Autoencoderscited by 78
  8. 2017A Hybrid DSP/Deep Learning Approach to Real-Time Full-Band Speech Enhancementcited by 67
  9. 2021DPT-FSNet: Dual-path Transformer Based Full-band and Sub-band Fusion Network for Speech Enhancementcited by 57
  10. 2020A Perceptually-Motivated Approach for Low-Complexity, Real-Time Enhancement of Fullband Speechcited by 53
  11. 2019Deep Filtering: Signal Extraction and Reconstruction Using Complex Time-Frequency Filterscited by 24
  12. 2024TF-Locoformer: Transformer with Local Modeling by Convolution for Speech Separation and Enhancementcited by 20
5 more
  1. 2024Separate and Reconstruct: Asymmetric Encoder-Decoder for Speech Separationcited by 17
  2. 2022Sampling Frequency Independent Dialogue Separationcited by 6
  3. 2025Query-Based Asymmetric Modeling with Decoupled Input-Output Rates for Speech Restorationcited by 1
  4. 2026Deep Filter Estimation from Inter-Frame Correlations for Monaural Speech Dereverberationcited by 1
  5. 2026Asymmetric Encoder-Decoder Based on Time-Frequency Correlation for Speech Separationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Optimizing Shoulder to Shoulder: A Coordinated Sub-Band Fusion Model for Real-Time Full-Band Speech Enhancement
  2. 2026BASENet: Band-Adapted Speech Enhancement Network with Cross-Band Attention
  3. 2024Hold Me Tight: Stable Encoder-Decoder Design for Speech Enhancement
  4. 2022A two-stage full-band speech enhancement model with effective spectral compression mapping
  5. 2025A Two-Stage Hierarchical Deep Filtering Framework for Real-Time Speech Enhancement
  6. 2022Fast FullSubNet: Accelerate Full-band and Sub-band Fusion Model for Single-channel Speech Enhancement
  7. 2026HALO: Half-Frame-Rate Adaptive Learnable Operator for Lightweight STFT-Based Speech Enhancement
  8. 2021Towards efficient models for real-time deep noise suppression