Fr'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithms
Not on the map. Why?
Cited by 74 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We propose the Fr'echet Audio Distance (FAD), a novel, reference-free evaluation metric for music enhancement algorithms. We demonstrate how typical evaluation metrics for speech enhancement and blind source separation can fail to accurately measure the perceived effect of a wide variety of distortions. As an alternative, we propose adapting the Fr'echet Inception Distance (FID) metric used to evaluate generative image models to the audio domain. FAD is validated using a wide variety of artificial distortions and is compared to the signal based metrics signal to distortion ratio (SDR), cosine distance and magnitude L2 distance. We show that, with a correlation coefficient of 0.52, FAD correlates more closely with human perception than either SDR, cosine distance or magnitude L2 distance, with correlation coefficients of 0.39, -0.15 and -0.01 respectively.
Key facts. Cited by 221 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 3; 2023: 25; 2024: 73; 2025: 66; 2026: 48.
221 papers.
Sort:
By area:
- 2023Simple and Controllable Music Generationcited by 480
- 2024Stable Audio Opencited by 192
- 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
- 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
- 2021Taming Visually Guided Sound Generationcited by 136
- 2024MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesiscited by 134
- 2024D-Flow: Differentiating through Flows for Controlled Generationcited by 115
- 2024TFG: Unified Training-Free Guidance for Diffusion Modelscited by 103
- 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Modelscited by 96
- 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 79
- 2024DITTO: Diffusion Inference-Time T-Optimization for Music Generationcited by 73
38 more
- 2023V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Modelscited by 65
- 2024LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insightscited by 65
- 2023GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restorationcited by 58
- 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 58
- 2024Masked Audio Generation using a Single Non-Autoregressive Transformercited by 50
- 2024Video-Guided Foley Sound Generation with Multimodal Controlscited by 49
- 2024OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flowscited by 45
- 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generationcited by 42
- 2024VidMuse: A Simple Video-to-Music Generation Framework with Long-Short-Term Modelingcited by 39
- 2021CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesiscited by 37
- 2024Tell What You Hear From What You See -- Video to Audio Generation Through Textcited by 34
- 2025ThinkSound: Chain-of-Thought Reasoning in Multimodal Large Language Models for Audio Generation and Editingcited by 33
- 2023E3 TTS: Easy End-to-End Diffusion-based Text to Speechcited by 30
- 2023Controllable Music Production with Diffusion Models and Guidance Gradientscited by 29
- 2025SongGen: A Single Stage Auto-regressive Transformer for Text-to-Song Generationcited by 29
- 2024Taming Data and Transformers for Audio Generationcited by 28
- 2024Masked Generative Video-to-Audio Transformers with Enhanced Synchronicitycited by 28
- 2024Both Ears Wide Open: Towards Language-Driven Spatial Audio Generationcited by 25
- 2026Self-Supervised Flow Matching for Scalable Multi-Modal Synthesiscited by 25
- 2023SyncFusion: Multimodal Onset-synchronized Video-to-Audio Foley Synthesiscited by 24
- 2025KAD: No More FAD! An Effective and Efficient Evaluation Metric for Audio Generationcited by 24
- 2024From Vision to Audio and Beyond: A Unified Model for Audio-Visual Representation and Generationcited by 23
- 2024AudioLCM: Text-to-Audio Generation with Latent Consistency Modelscited by 21
- 2024Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videoscited by 21
- 2024FlowSep: Language-Queried Sound Separation with Rectified Flow Matchingcited by 21
- 2023CLIPSonic: Text-to-Audio Synthesis with Unlabeled Videos and Pretrained Language-Vision Modelscited by 20
- 2025Challenges and Trends in Egocentric Vision: A Surveycited by 20
- 2023Content-based Controls For Music Large Language Modelingcited by 19
- 2024UniMuMo: Unified Text, Music and Motion Generationcited by 19
- 2024FlashAudio: Rectified Flows for Fast and High-Fidelity Text-to-Audio Generationcited by 19
- 2022Unsupervised vocal dereverberation with diffusion-based generative modelscited by 18
- 2024FLUX that Plays Musiccited by 18
- 2024Images that Sound: Composing Images and Sounds on a Single Canvascited by 17
- 2024A Versatile Diffusion Transformer with Mixture of Noise Levels for Audiovisual Generationcited by 17
- 2025OmniAudio: Generating Spatial Audio from 360-Degree Videocited by 17
- 2024Video-Foley: Two-Stage Video-To-Sound Generation via Temporal Event Condition For Foley Soundcited by 16
- 2024Presto! Distilling Steps and Layers for Accelerating Music Generationcited by 16
- 2024VinTAGe: Joint Video and Text Conditioning for Holistic Audio Generationcited by 16
50 most cited of 221 All 221 (JSON)
- 2026Harmonizing Spectral Evolution in Conditional Flow Matching for TTS28 Sep 2026
- 2026Video-to-Music Generation for Gameplay Videos25 Sep 2026
- 2026Spot, Separate, and Enhance: Fully Generative Approach for Audio Mixing24 Sep 2026
- 2026SE-MSB: End-to-End Unpaired Speech Enhancement using Mamba Schr"odinger Bridges22 Sep 2026
- 2026CPR: Combining global composing, local performing and full-sequence refining in piano rendering with continuous autoregressive modelling16 Sep 2026
- 2026AURA: Unified Multimodal Framework for Conversational Music Editing13 Sep 2026
- 2026HarmoniDPO: Video-guided Audio Generation via Preference-Optimized Diffusion12 Aug 2026
- 2026Dialogue-Aware Video-to-Music Generation Using Public Domain Film Collections12 Aug 2026
- 2026InvFlowFD: Reference-Free and Background-Set-Free Perceptual Music Quality Metric with Flow Matching Inversion4 Aug 2026
- 2026Exploring Efficient Waveform Diffusion Models for Foley Sound Generation31 Jul 2026
- 2026MusicMark: A Robust Generative Watermarking Framework for Music Generation13 Jul 2026
- 2026AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation29 Jun 2026
38 more
- 2026MAVIN: Multi-Shot Audio-Visual Generation with Customized Narrative Control28 Jun 2026
- 2026What Do Deepfake Benchmarks Measure? An Audit Using Frozen Self-Supervised Representations24 Jun 2026
- 2026STAR-VAE: Structured Topology-Aware Regularization for Audio Reconstruction and Generation22 Jun 2026
- 2026MUNI: Multimodal Unified Latent Diffusion for Coherent Any-to-Any Generation15 Jun 2026
- 2026Towards Unified Song Generation and Singing Voice Conversion with Accompaniment Co-Generation5 Jun 2026
- 2026UAT: Unified Audio-Text Diffusion for Audio Generation, Editing, and Captioning3 Jun 2026
- 2026SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modeling2 Jun 2026
- 2026Diffusion Domain Expansion: Learning to Coordinate Pre-trained Diffusion Models22 May 2026
- 2026InstructAV2AV: Instruction-Guided Audio-Video Joint Editing18 May 2026
- 2026Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems10 May 2026
- 2026Stage-adaptive audio diffusion modeling6 May 2026
- 2026APEX: Large-scale Multi-task Aesthetic-Informed Popularity Prediction for AI-Generated Music5 May 2026
- 2026Latent Fourier Transform20 Apr 2026
- 2026Efficient Video Diffusion Models: Advancements and Challenges17 Apr 2026
- 2026FoleyDesigner: Immersive Stereo Foley Generation with Precise Spatio-Temporal Alignment for Film Clips7 Apr 2026
- 2026OmniSonic: Towards Universal and Holistic Audio Generation from Video and Text6 Apr 2026
- 2026MuQ-Eval: An Open-Source Per-Sample Quality Metric for AI Music Generation Evaluation24 Mar 2026
- 2026NV-Bench: Benchmark of Nonverbal Vocalization Synthesis for Expressive Text-to-Speech Generation16 Mar 2026
- 2026Music Source Restoration with Ensemble Separation and Targeted Reconstruction13 Mar 2026
- 2026OmniForcing: Unleashing Real-time Joint Audio-Visual Generation12 Mar 2026
- 2026V2M-Zero: Zero-Pair Time-Aligned Video-to-Music Generation11 Mar 2026
- 2026Foley-Flow: Coordinated Video-to-Audio Generation with Masked Audio-Visual Alignment and Dynamic Conditional Flows9 Mar 2026
- 2026Self-Supervised Flow Matching for Scalable Multi-Modal Synthesis6 Mar 2026
- 2026SyncTrack: Rhythmic Stability and Synchronization in Multi-Track Music Generation1 Mar 2026
- 2026SongSong: A Time Phonograph for Chinese SongCi Music from Thousand of Years Away27 Feb 2026
- 2026Art2Mus: Artwork-to-Music Generation via Visual Conditioning and Large-Scale Cross-Modal Alignment19 Feb 2026
- 2026OmniCustom: Sync Audio-Video Customization Via Joint Audio-Video Generation Model12 Feb 2026
- 2026Stemphonic: All-at-once Flexible Multi-stem Music Generation10 Feb 2026
- 2026Bagpiper: Solving Open-Ended Audio Tasks via Rich Captions5 Feb 2026
- 2026Omni-Judge: Can Omni-LLMs Serve as Human-Aligned Judges for Text-Conditioned Audio-Video Generation?2 Feb 2026
- 2026VoxMorph: Scalable Zero-shot Voice Identity Morphing via Disentangled Embeddings27 Jan 2026
- 2026SAM Audio Judge: A Unified Multimodal Framework for Perceptual Evaluation of Audio Separation27 Jan 2026
- 2026GMS-CAVP: Improving Audio-Video Correspondence with Multi-Scale Contrastive and Generative Pretraining27 Jan 2026
- 2026ImmersiveFlow: Stereo-to-7.1.4 spatial audio generation with flow matching19 Jan 2026
- 2026Guided by the Plan: Enhancing Faithful Autoregressive Text-to-Audio Generation with Guided Decoding18 Jan 2026
- 2026Discriminating real and synthetic super-resolved audio samples using embedding-based classifiers6 Jan 2026
- 2025Do Foundational Audio Encoders Understand Music Structure?19 Dec 2025
- 2025MR-FlowDPO: Multi-Reward Direct Preference Optimization for Flow-Matching Text-to-Music Generation11 Dec 2025
50 newest of 221 All 221 (JSON)
- 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
- 2024D-Flow: Differentiating through Flows for Controlled Generationcited by 115
- 2024TFG: Unified Training-Free Guidance for Diffusion Modelscited by 103
- 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Modelscited by 96
- 2024DITTO: Diffusion Inference-Time T-Optimization for Music Generationcited by 73
- 2024LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insightscited by 65
- 2023GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restorationcited by 58
- 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 58
- 2024OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flowscited by 45
- 2021CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesiscited by 37
- 2023E3 TTS: Easy End-to-End Diffusion-based Text to Speechcited by 30
- 2023Controllable Music Production with Diffusion Models and Guidance Gradientscited by 29
12 most cited of 74 All 74 (JSON)
- 2026Harmonizing Spectral Evolution in Conditional Flow Matching for TTS28 Sep 2026
- 2026CPR: Combining global composing, local performing and full-sequence refining in piano rendering with continuous autoregressive modelling16 Sep 2026
- 2026Exploring Efficient Waveform Diffusion Models for Foley Sound Generation31 Jul 2026
- 2026STAR-VAE: Structured Topology-Aware Regularization for Audio Reconstruction and Generation22 Jun 2026
- 2026MUNI: Multimodal Unified Latent Diffusion for Coherent Any-to-Any Generation15 Jun 2026
- 2026UAT: Unified Audio-Text Diffusion for Audio Generation, Editing, and Captioning3 Jun 2026
- 2026Diffusion Domain Expansion: Learning to Coordinate Pre-trained Diffusion Models22 May 2026
- 2026Stage-adaptive audio diffusion modeling6 May 2026
- 2026Efficient Video Diffusion Models: Advancements and Challenges17 Apr 2026
- 2026OmniForcing: Unleashing Real-time Joint Audio-Visual Generation12 Mar 2026
- 2026Self-Supervised Flow Matching for Scalable Multi-Modal Synthesis6 Mar 2026
- 2026ImmersiveFlow: Stereo-to-7.1.4 spatial audio generation with flow matching19 Jan 2026
12 newest of 74 All 74 (JSON)
- 2024SonicVisionLM: Playing Sound with Vision Language Modelscited by 3
- 2024SonicVisionLM: Playing Sound with Vision Language Models9 Jan 2024
- 2023Simple and Controllable Music Generationcited by 480
- 2024Stable Audio Opencited by 192
- 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
- 2021Taming Visually Guided Sound Generationcited by 136
- 2024MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesiscited by 134
- 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 79
- 2023V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Modelscited by 65
- 2024Masked Audio Generation using a Single Non-Autoregressive Transformercited by 50
- 2024Video-Guided Foley Sound Generation with Multimodal Controlscited by 49
- 2024VidMuse: A Simple Video-to-Music Generation Framework with Long-Short-Term Modelingcited by 39
- 2024Tell What You Hear From What You See -- Video to Audio Generation Through Textcited by 34
12 most cited of 134 All 134 (JSON)
- 2026Video-to-Music Generation for Gameplay Videos25 Sep 2026
- 2026Spot, Separate, and Enhance: Fully Generative Approach for Audio Mixing24 Sep 2026
- 2026AURA: Unified Multimodal Framework for Conversational Music Editing13 Sep 2026
- 2026Dialogue-Aware Video-to-Music Generation Using Public Domain Film Collections12 Aug 2026
- 2026InvFlowFD: Reference-Free and Background-Set-Free Perceptual Music Quality Metric with Flow Matching Inversion4 Aug 2026
- 2026AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation29 Jun 2026
- 2026MAVIN: Multi-Shot Audio-Visual Generation with Customized Narrative Control28 Jun 2026
- 2026What Do Deepfake Benchmarks Measure? An Audit Using Frozen Self-Supervised Representations24 Jun 2026
- 2026Towards Unified Song Generation and Singing Voice Conversion with Accompaniment Co-Generation5 Jun 2026
- 2026SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modeling2 Jun 2026
- 2026InstructAV2AV: Instruction-Guided Audio-Video Joint Editing18 May 2026
- 2026Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems10 May 2026
12 newest of 134 All 134 (JSON)