VoiceFixer: A Unified Framework for High-Fidelity Speech Restoration
Not on the map. Why?
Abstract (arXiv)
Speech restoration aims to remove distortions in speech signals. Prior methods mainly focus on a single type of distortion, such as speech denoising or dereverberation. However, speech signals can be degraded by several different distortions simultaneously in the real world. It is thus important to extend speech restoration models to deal with multiple distortions. In this paper, we introduce VoiceFixer, a unified framework for high-fidelity speech restoration. VoiceFixer restores speech from multiple distortions (e.g., noise, reverberation, and clipping) and can expand degraded speech (e.g., noisy speech) with a low bandwidth to 44.1 kHz full-bandwidth high-fidelity speech. We design VoiceFixer based on (1) an analysis stage that predicts intermediate-level features from the degraded speech, and (2) a synthesis stage that generates waveform using a neural vocoder. Both objective and subjective evaluations show that VoiceFixer is effective on severely degraded speech, such as real-world historical speech recordings. Samples of VoiceFixer are available at https://haoheliu.github.io/voicefixer.
Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Apr 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 2; 2023: 8; 2024: 8; 2025: 15; 2026: 4.
37 papers.
Sort:
By area:
- 2023WavJourney: Compositional Audio Creation with Large Language Modelscited by 27
- 2024MaskSR: Masked Language Model for Full-band Speech Restorationcited by 24
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancementcited by 23
- 2023AV-RIR: Audio-Visual Room Impulse Response Estimationcited by 20
- 2025LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancementcited by 19
- 2023AdVerb: Visually Guided Audio Dereverberationcited by 15
- 2022Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancementcited by 14
- 2024High-Resolution Speech Restoration with Latent Diffusion Modelcited by 8
- 2024Self-Supervised Speech Quality Estimation and Enhancement Using Only Clean Speechcited by 7
- 2024FINALLY: fast and universal speech enhancement with studio-like qualitycited by 7
- 2025Universal Speech Enhancement with Regression and Generative Mambacited by 7
- 2025Multi-Metric Preference Alignment for Generative Speech Restorationcited by 7
25 more
- 2023The IMS Toucan System for the Blizzard Challenge 2023cited by 6
- 2025UniFlow-Audio: Unified Flow Matching for Audio Generation from Omni-Modalitiescited by 6
- 2023Voice Conversion for Stuttered Speech, Instruments, Unseen Languages and Textually Described Voicescited by 4
- 2024Vector Quantized Diffusion Model Based Speech Bandwidth Extensioncited by 4
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Modelscited by 4
- 2022Deep neural network techniques for monaural speech enhancement: state of the art analysiscited by 3
- 2023Diffusion-based Signal Refiner for Speech Enhancement and Separationcited by 3
- 2024DIFFRENT: A Diffusion Model for Recording Environment Transfer of Speechcited by 3
- 2024SPA-SVC: Self-supervised Pitch Augmentation for Singing Voice Conversioncited by 3
- 2025EDNet: A Versatile Speech Enhancement Framework with Gating Mamba Mechanism and Phase Shift-Invariant Trainingcited by 3
- 2025SenSE: Semantic-Aware High-Fidelity Universal Speech Enhancementcited by 3
- 2025CleanMel: Mel-Spectrogram Enhancement for Improving Both Speech Quality and ASRcited by 2
- 2025TS-URGENet: A Three-stage Universal Robust and Generalizable Speech Enhancement Networkcited by 2
- 2023Guided Speech Enhancement Networkcited by 1
- 2025Miipher-2: A Universal Speech Restoration Model for Million-Hour Scale Data Restorationcited by 1
- 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Spacecited by 1
- 2026Post-Training Speech Enhancement Language Models with Perceptual Rewardscited by 1
- 2023Speech Separation based on Contrastive Learning and Deep Modularizationcited by 0
- 2024A Dual-Branch Parallel Network for Speech Enhancement and Restorationcited by 0
- 2025How much to Dereverberate? Low-Latency Single-Channel Speech Enhancement in Distant Microphone Scenarioscited by 0
- 2025Active Speech Enhancement: Active Speech Denoising Decliping and Deveraberationcited by 0
- 2025Kinship in Speech: Leveraging Linguistic Relatedness for Zero-Shot TTS in Indian Languagescited by 0
- 2025CogSR: Semantic-Aware Speech Super-Resolution via Chain-of-Thought Guided Flow Matchingcited by 0
- 2026Joint Enhancement and Classification using Coupled Diffusion Models of Signals and Logitscited by 0
- 2026UniPASE: A Generative Model for Universal Speech Enhancement with High Fidelity and Low Hallucinationscited by 0
- 2026Post-Training Speech Enhancement Language Models with Perceptual Rewards19 Jun 2026
- 2026UniPASE: A Generative Model for Universal Speech Enhancement with High Fidelity and Low Hallucinations16 Apr 2026
- 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Space2 Mar 2026
- 2026Joint Enhancement and Classification using Coupled Diffusion Models of Signals and Logits17 Feb 2026
- 2025CogSR: Semantic-Aware Speech Super-Resolution via Chain-of-Thought Guided Flow Matching18 Dec 2025
- 2025SenSE: Semantic-Aware High-Fidelity Universal Speech Enhancement29 Sep 2025
- 2025UniFlow-Audio: Unified Flow Matching for Audio Generation from Omni-Modalities29 Sep 2025
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Models28 Sep 2025
- 2025Multi-Metric Preference Alignment for Generative Speech Restoration24 Aug 2025
- 2025EDNet: A Versatile Speech Enhancement Framework with Gating Mamba Mechanism and Phase Shift-Invariant Training19 Jun 2025
- 2025Kinship in Speech: Leveraging Linguistic Relatedness for Zero-Shot TTS in Indian Languages4 Jun 2025
- 2025Universal Speech Enhancement with Regression and Generative Mamba27 May 2025
25 more
- 2025TS-URGENet: A Three-stage Universal Robust and Generalizable Speech Enhancement Network24 May 2025
- 2025Active Speech Enhancement: Active Speech Denoising Decliping and Deveraberation22 May 2025
- 2025Miipher-2: A Universal Speech Restoration Model for Million-Hour Scale Data Restoration7 May 2025
- 2025How much to Dereverberate? Low-Latency Single-Channel Speech Enhancement in Distant Microphone Scenarios2 May 2025
- 2025LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement1 Mar 2025
- 2025CleanMel: Mel-Spectrogram Enhancement for Improving Both Speech Quality and ASR27 Feb 2025
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancement26 Jan 2025
- 2024FINALLY: fast and universal speech enhancement with studio-like quality8 Oct 2024
- 2024High-Resolution Speech Restoration with Latent Diffusion Model17 Sep 2024
- 2024A Dual-Branch Parallel Network for Speech Enhancement and Restoration13 Sep 2024
- 2024Vector Quantized Diffusion Model Based Speech Bandwidth Extension9 Sep 2024
- 2024SPA-SVC: Self-supervised Pitch Augmentation for Singing Voice Conversion9 Jun 2024
- 2024MaskSR: Masked Language Model for Full-band Speech Restoration4 Jun 2024
- 2024Self-Supervised Speech Quality Estimation and Enhancement Using Only Clean Speech26 Feb 2024
- 2024DIFFRENT: A Diffusion Model for Recording Environment Transfer of Speech16 Jan 2024
- 2023AV-RIR: Audio-Visual Room Impulse Response Estimation30 Nov 2023
- 2023The IMS Toucan System for the Blizzard Challenge 202326 Oct 2023
- 2023Voice Conversion for Stuttered Speech, Instruments, Unseen Languages and Textually Described Voices12 Oct 2023
- 2023AdVerb: Visually Guided Audio Dereverberation23 Aug 2023
- 2023WavJourney: Compositional Audio Creation with Large Language Models26 Jul 2023
- 2023Speech Separation based on Contrastive Learning and Deep Modularization18 May 2023
- 2023Diffusion-based Signal Refiner for Speech Enhancement and Separation10 May 2023
- 2023Guided Speech Enhancement Network13 Mar 2023
- 2022Deep neural network techniques for monaural speech enhancement: state of the art analysis1 Dec 2022
- 2022Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancement27 Oct 2022
- 2022Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancementcited by 14
- 2024High-Resolution Speech Restoration with Latent Diffusion Modelcited by 8
- 2025UniFlow-Audio: Unified Flow Matching for Audio Generation from Omni-Modalitiescited by 6
- 2024Vector Quantized Diffusion Model Based Speech Bandwidth Extensioncited by 4
- 2023Diffusion-based Signal Refiner for Speech Enhancement and Separationcited by 3
- 2024DIFFRENT: A Diffusion Model for Recording Environment Transfer of Speechcited by 3
- 2025SenSE: Semantic-Aware High-Fidelity Universal Speech Enhancementcited by 3
- 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Spacecited by 1
- 2025CogSR: Semantic-Aware Speech Super-Resolution via Chain-of-Thought Guided Flow Matchingcited by 0
- 2026Joint Enhancement and Classification using Coupled Diffusion Models of Signals and Logitscited by 0
- 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Space2 Mar 2026
- 2026Joint Enhancement and Classification using Coupled Diffusion Models of Signals and Logits17 Feb 2026
- 2025CogSR: Semantic-Aware Speech Super-Resolution via Chain-of-Thought Guided Flow Matching18 Dec 2025
- 2025SenSE: Semantic-Aware High-Fidelity Universal Speech Enhancement29 Sep 2025
- 2025UniFlow-Audio: Unified Flow Matching for Audio Generation from Omni-Modalities29 Sep 2025
- 2024High-Resolution Speech Restoration with Latent Diffusion Model17 Sep 2024
- 2024Vector Quantized Diffusion Model Based Speech Bandwidth Extension9 Sep 2024
- 2024DIFFRENT: A Diffusion Model for Recording Environment Transfer of Speech16 Jan 2024
- 2023Diffusion-based Signal Refiner for Speech Enhancement and Separation10 May 2023
- 2022Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancement27 Oct 2022
- 2023WavJourney: Compositional Audio Creation with Large Language Modelscited by 27
- 2024MaskSR: Masked Language Model for Full-band Speech Restorationcited by 24
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancementcited by 23
- 2023AV-RIR: Audio-Visual Room Impulse Response Estimationcited by 20
- 2025LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancementcited by 19
- 2023AdVerb: Visually Guided Audio Dereverberationcited by 15
- 2024Self-Supervised Speech Quality Estimation and Enhancement Using Only Clean Speechcited by 7
- 2024FINALLY: fast and universal speech enhancement with studio-like qualitycited by 7
- 2023The IMS Toucan System for the Blizzard Challenge 2023cited by 6
- 2023Voice Conversion for Stuttered Speech, Instruments, Unseen Languages and Textually Described Voicescited by 4
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Modelscited by 4
- 2022Deep neural network techniques for monaural speech enhancement: state of the art analysiscited by 3
12 most cited of 23 All 23 (JSON)
- 2026UniPASE: A Generative Model for Universal Speech Enhancement with High Fidelity and Low Hallucinations16 Apr 2026
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Models28 Sep 2025
- 2025Kinship in Speech: Leveraging Linguistic Relatedness for Zero-Shot TTS in Indian Languages4 Jun 2025
- 2025TS-URGENet: A Three-stage Universal Robust and Generalizable Speech Enhancement Network24 May 2025
- 2025Active Speech Enhancement: Active Speech Denoising Decliping and Deveraberation22 May 2025
- 2025Miipher-2: A Universal Speech Restoration Model for Million-Hour Scale Data Restoration7 May 2025
- 2025How much to Dereverberate? Low-Latency Single-Channel Speech Enhancement in Distant Microphone Scenarios2 May 2025
- 2025LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement1 Mar 2025
- 2025CleanMel: Mel-Spectrogram Enhancement for Improving Both Speech Quality and ASR27 Feb 2025
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancement26 Jan 2025
- 2024FINALLY: fast and universal speech enhancement with studio-like quality8 Oct 2024
- 2024A Dual-Branch Parallel Network for Speech Enhancement and Restoration13 Sep 2024
12 newest of 23 All 23 (JSON)