Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Sound
Not on the map. Why?
Cited by 29 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
The quantification of audio aesthetics remains a complex challenge in audio processing, primarily due to its subjective nature, which is influenced by human perception and cultural context. Traditional methods often depend on human listeners for evaluation, leading to inconsistencies and high resource demands. This paper addresses the growing need for automated systems capable of predicting audio aesthetics without human intervention. Such systems are crucial for applications like data filtering, pseudo-labeling large datasets, and evaluating generative audio models, especially as these models become more sophisticated. In this work, we introduce a novel approach to audio aesthetic evaluation by proposing new annotation guidelines that decompose human listening perspectives into four distinct axes. We develop and train no-reference, per-item prediction models that offer a more nuanced assessment of audio quality. Our models are evaluated against human mean opinion scores (MOS) and existing methods, demonstrating comparable or superior performance. This research not only advances the field of audio aesthetics but also provides open-source models and datasets to facilitate future work and benchmarking. We release our code and pre-trained model at: https://github.com/facebookresearch/audiobox-aesthetics
Key facts. Cited by 137 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Feb 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2025: 47; 2026: 90.
137 papers.
Sort:
By area:
- 2025UniVerse-1: Unified Audio-Video Generation via Stitching of Expertscited by 61
- 2025ACE-Step: A Step Towards Music Generation Foundation Modelcited by 56
- 2026MOVA: Towards Scalable and Synchronized Video-Audio Generationcited by 43
- 2025UniAVGen: Unified Audio and Video Generation with Asymmetric Cross-Modal Interactionscited by 38
- 2025VABench: A Comprehensive Benchmark for Audio-Video Generationcited by 30
- 2025SongGen: A Single Stage Auto-regressive Transformer for Text-to-Song Generationcited by 29
- 2025AudioX: A Unified Framework for Anything-to-Audio Generationcited by 27
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignmentcited by 25
- 2026JavisDiT++: Unified Modeling and Optimization for Joint Audio-Video Generationcited by 25
- 2025SongBloom: Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinementcited by 23
- 2026AVGen-Bench: A Task-Driven Benchmark for Multi-Granular Evaluation of Text-to-Audio-Video Generationcited by 21
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 20
38 more
- 2025Audio-Sync Video Generation with Multi-Stream Temporal Controlcited by 15
- 2025DiffRhythm 2: Efficient and High Fidelity Song Generation via Block Flow Matchingcited by 15
- 2025SpeechJudge: Towards Human-Level Judgment for Speech Naturalnesscited by 15
- 2025Analyzable Chain-of-Musical-Thought Prompting for High-Fidelity Music Generationcited by 14
- 2026MOSS-TTS Technical Reportcited by 14
- 2026Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillationcited by 13
- 2026Omni2Sound: Towards Unified Video-Text-to-Audio Generationcited by 11
- 2025UALM: Unified Audio Language Model for Understanding, Generation and Reasoningcited by 10
- 2025Towards Interactive Intelligence for Digital Humanscited by 10
- 2026MSAVBench: Towards Comprehensive and Reliable Evaluation of Multi-Shot Audio-Video Generationcited by 10
- 2025PrismAudio: Decomposed Chain-of-Thoughts and Multi-dimensional Rewards for Video-to-Audio Generationcited by 9
- 2025AVI-Edit: Audio-sync Video Instance Editing with Granularity-Aware Mask Refinercited by 9
- 2025Analysis and Evaluation of Synthetic Data Generation in Speech Dysfluency Detectioncited by 8
- 2025TTSDS2: Resources and Benchmark for Evaluating Human-Quality Text to Speech Systemscited by 8
- 2026Muse: Towards Reproducible Long-Form Song Generation with Fine-Grained Style Controlcited by 8
- 2026SongBench: A Fine-Grained Multi-Aspect Benchmark for Song Quality Assessmentcited by 7
- 2026OmniNFT: Modality-wise Omni Diffusion Reinforcement for Joint Audio-Video Generationcited by 7
- 2026Native Audio-Visual Alignment for Generationcited by 7
- 2025SonicMaster: Towards Controllable All-in-One Music Restoration and Masteringcited by 6
- 2025EchoFoley: Event-Centric Hierarchical Control for Video Grounded Creative Sound Generationcited by 6
- 2026The Design Space of Tri-Modal Masked Diffusion Modelscited by 6
- 2026MuQ-Eval: An Open-Source Per-Sample Quality Metric for AI Music Generation Evaluationcited by 6
- 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generationcited by 6
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gatingcited by 6
- 2026MultiRef-Compass: Towards Comprehensive Evaluation of Multi-Reference-to-Audio-Video Generationcited by 6
- 2025MR-FlowDPO: Multi-Reward Direct Preference Optimization for Flow-Matching Text-to-Music Generationcited by 5
- 2026InstructAV2AV: Instruction-Guided Audio-Video Joint Editingcited by 5
- 2026VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generationcited by 5
- 2025A Unified Multi-Agent Framework for Universal Multimodal Understanding and Generationcited by 4
- 2025UniMoE-Audio: Unified Speech and Music Generation with Dynamic-Capacity MoEcited by 4
- 2025Foley Control: Aligning a Frozen Latent Text-to-Audio Model to Videocited by 4
- 2025SAO-Instruct: Free-form Audio Editing using Natural Language Instructionscited by 4
- 2025MAViD: A Multimodal Framework for Audio-Visual Dialogue Understanding and Generationcited by 4
- 2026Bagpiper: Solving Open-Ended Audio Tasks via Rich Captionscited by 4
- 2026TADA! Tuning Audio Diffusion Models through Activation Steeringcited by 4
- 2026GSRM: Generative Speech Reward Model for Speech RLHFcited by 4
- 2026Improving Joint Audio-Video Generation with Cross-Modal Context Learningcited by 4
- 2026Baton: Explicit Semantic Blueprints for Joint Video-Audio Generationcited by 4
50 most cited of 137 All 137 (JSON)
- 2026Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generation11 Oct 2026
- 2026A Comprehensive Objective Evaluation of Modern Text-to-Speech for Turkish Using Speech Quality Assessment Models5 Oct 2026
- 2026Kandinsky 6.0 Video: Foundation Models for Synchronized Video and Audio Generation4 Oct 2026
- 2026Prism: Dynamic Sparse Attention for Native 2K Joint Video-Audio Generation Model Training4 Oct 2026
- 2026LatticeSMC: Where to Spend Inference-Time Compute in Chunked Sequence Generators2 Oct 2026
- 2026End-to-End Historical Music Restoration in Latent Space30 Sep 2026
- 2026Hear the World in Stereo: Learning Dynamic Spatial Correspondence for Immersive Joint Video-Audio Generation30 Sep 2026
- 2026PDMD: Projected Distribution Matching Distillation for Video Diffusion Models28 Sep 2026
- 2026YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality27 Sep 2026
- 2026Audio LLMs Know When They Can't Hear You24 Sep 2026
- 2026AV-GRPO: Modality-Anchored Decoupling Diffusion Reinforcement Learning for Joint Audio-Video Generation24 Sep 2026
- 2026TV-AudioRemover: Joint Text-Visual Guided Sound Removal with Multi-Task Hard-Mixture Curriculum22 Sep 2026
38 more
- 2026Learnable Classifier-Free Guidance Null Embeddings for Enhanced Controllable Speech Synthesis21 Sep 2026
- 2026StepAudio 3 Music Technical Report11 Sep 2026
- 2026CMA-OT: Hierarchical Expert Supervision for Dance-to-Music Generation11 Sep 2026
- 2026DiffSynth-Music: Audio-Conditioned KV-Cache Adapters for Controllable Music Generation11 Sep 2026
- 2026Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis3 Sep 2026
- 2026TimeSteer: Inference-Time Speech Scheduling in Joint Audio-Visual Diffusion Models1 Sep 2026
- 2026DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution31 Aug 2026
- 2026FlowSep 2: Self-Supervised Flow Matching for Language-Queried Audio Source Separation22 Aug 2026
- 2026DAMOS: Learning Distortion-Aware Speech Quality Assessment through Explicit Distortion Localization21 Aug 2026
- 2026VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation19 Aug 2026
- 2026VoxAudio: Vocalized Audio Synthesis via Multi-Reward Autoregressive Flow Matching13 Aug 2026
- 2026VoiceDesigner: Text-to-Voice Generation and Editing via Unified Diffusion Modeling and Data Augmentation12 Aug 2026
- 2026HarmoniDPO: Video-guided Audio Generation via Preference-Optimized Diffusion12 Aug 2026
- 2026MuseCritic: Learning Multi-Aspect Song Rewards through Natural-Language Aesthetic Critiques12 Aug 2026
- 2026Ex-Omni-2D: Expressive Omni-Modal Dialogue Models with Native Visual Presence11 Aug 2026
- 2026KVAE: Family of Tokenizers for Multimodal Generative Models6 Aug 2026
- 2026InvFlowFD: Reference-Free and Background-Set-Free Perceptual Music Quality Metric with Flow Matching Inversion4 Aug 2026
- 2026MPEcho: A Melody and Phoneme-Aware Generative Framework for Controllable Cover Song Generation29 Jul 2026
- 2026OmniVAE: An Audio-Video VAE with Cross-Modal Alignment for Joint Generation26 Jul 2026
- 2026Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Rendering22 Jul 2026
- 2026WanSong v1.0 Technical Report16 Jul 2026
- 2026MultiRef-Compass: Towards Comprehensive Evaluation of Multi-Reference-to-Audio-Video Generation15 Jul 2026
- 2026Anysynth:Zero-Shot Instrument Cloning via In-Context Learning and Asymmetric Hierarchical Guidance13 Jul 2026
- 2026MusicMark: A Robust Generative Watermarking Framework for Music Generation13 Jul 2026
- 2026TriA Pipeline: A Large-Scale Automatic Audio Annotation Pipeline For Audio Classification In Specific Scenarios7 Jul 2026
- 2026The Limits of Reference-Free Speech Quality Metrics as Evaluators and Rewards on Modern Text-to-Speech2 Jul 2026
- 2026MAVIN: Multi-Shot Audio-Visual Generation with Customized Narrative Control28 Jun 2026
- 2026Libretto: Giving LLM Agents a Sense of Musical Structure21 Jun 2026
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gating19 Jun 2026
- 2026TuneJury: An Open Metric for Improving Music Generation Preference Alignment15 Jun 2026
- 2026AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation10 Jun 2026
- 2026ANCHOR: Autoregressive Non-intrusive Chunk-Ordered Refinement for Joint Multi-Resolution Speech Quality Modeling8 Jun 2026
- 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generation8 Jun 2026
- 2026SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modeling2 Jun 2026
- 2026EntangleCodec: A Unified Discrete Audio Tokenizer via Semantic-Acoustic Entanglement1 Jun 2026
- 2026JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitions1 Jun 2026
- 2026SegTune: Structured and Fine-Grained Control for Song Generation31 May 2026
- 2026Native Audio-Visual Alignment for Generation28 May 2026
50 newest of 137 All 137 (JSON)
- 2025ACE-Step: A Step Towards Music Generation Foundation Modelcited by 56
- 2025SongBloom: Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinementcited by 23
- 2025DiffRhythm 2: Efficient and High Fidelity Song Generation via Block Flow Matchingcited by 15
- 2026Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillationcited by 13
- 2026The Design Space of Tri-Modal Masked Diffusion Modelscited by 6
- 2025MR-FlowDPO: Multi-Reward Direct Preference Optimization for Flow-Matching Text-to-Music Generationcited by 5
- 2025A Unified Multi-Agent Framework for Universal Multimodal Understanding and Generationcited by 4
- 2025MAViD: A Multimodal Framework for Audio-Visual Dialogue Understanding and Generationcited by 4
- 2026TADA! Tuning Audio Diffusion Models through Activation Steeringcited by 4
- 2026Improving Joint Audio-Video Generation with Cross-Modal Context Learningcited by 4
- 2026Baton: Explicit Semantic Blueprints for Joint Video-Audio Generationcited by 4
- 2025Inference-time Scaling for Diffusion-based Audio Super-resolutioncited by 3
12 most cited of 29 All 29 (JSON)
- 2026Kandinsky 6.0 Video: Foundation Models for Synchronized Video and Audio Generation4 Oct 2026
- 2026PDMD: Projected Distribution Matching Distillation for Video Diffusion Models28 Sep 2026
- 2026StepAudio 3 Music Technical Report11 Sep 2026
- 2026DiffSynth-Music: Audio-Conditioned KV-Cache Adapters for Controllable Music Generation11 Sep 2026
- 2026Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis3 Sep 2026
- 2026TimeSteer: Inference-Time Speech Scheduling in Joint Audio-Visual Diffusion Models1 Sep 2026
- 2026FlowSep 2: Self-Supervised Flow Matching for Language-Queried Audio Source Separation22 Aug 2026
- 2026VoxAudio: Vocalized Audio Synthesis via Multi-Reward Autoregressive Flow Matching13 Aug 2026
- 2026VoiceDesigner: Text-to-Voice Generation and Editing via Unified Diffusion Modeling and Data Augmentation12 Aug 2026
- 2026KVAE: Family of Tokenizers for Multimodal Generative Models6 Aug 2026
- 2026Anysynth:Zero-Shot Instrument Cloning via In-Context Learning and Asymmetric Hierarchical Guidance13 Jul 2026
- 2026AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation10 Jun 2026
12 newest of 29 All 29 (JSON)
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignmentcited by 25
- 2025SpeechJudge: Towards Human-Level Judgment for Speech Naturalnesscited by 15
- 2026VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generationcited by 5
- 2026GSRM: Generative Speech Reward Model for Speech RLHFcited by 4
- 2026TuneJury: An Open Metric for Improving Music Generation Preference Alignmentcited by 4
- 2026The Limits of Reference-Free Speech Quality Metrics as Evaluators and Rewards on Modern Text-to-Speechcited by 2
- 2025Towards Hallucination-Free Music: A Reinforcement Learning Preference Optimization Framework for Reliable Song Generationcited by 1
- 2025Aligning Generative Music AI with Human Preferences: Methods and Challengescited by 0
- 2026MuseCritic: Learning Multi-Aspect Song Rewards through Natural-Language Aesthetic Critiquescited by 0
- 2026HarmoniDPO: Video-guided Audio Generation via Preference-Optimized Diffusioncited by 0
- 2026VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation19 Aug 2026
- 2026HarmoniDPO: Video-guided Audio Generation via Preference-Optimized Diffusion12 Aug 2026
- 2026MuseCritic: Learning Multi-Aspect Song Rewards through Natural-Language Aesthetic Critiques12 Aug 2026
- 2026The Limits of Reference-Free Speech Quality Metrics as Evaluators and Rewards on Modern Text-to-Speech2 Jul 2026
- 2026TuneJury: An Open Metric for Improving Music Generation Preference Alignment15 Jun 2026
- 2026GSRM: Generative Speech Reward Model for Speech RLHF14 Feb 2026
- 2025Aligning Generative Music AI with Human Preferences: Methods and Challenges19 Nov 2025
- 2025SpeechJudge: Towards Human-Level Judgment for Speech Naturalness11 Nov 2025
- 2025Towards Hallucination-Free Music: A Reinforcement Learning Preference Optimization Framework for Reliable Song Generation7 Aug 2025
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignment9 Jun 2025
- 2025UALM: Unified Audio Language Model for Understanding, Generation and Reasoningcited by 10
- 2025PrismAudio: Decomposed Chain-of-Thoughts and Multi-dimensional Rewards for Video-to-Audio Generationcited by 9
- 2026Bridging What the Model Thinks and How It Speaks: Expressive Speech Generation via Self-Aware Intent-Realization Alignmentcited by 0
- 2026LatticeSMC: Where to Spend Inference-Time Compute in Chunked Sequence Generatorscited by 0
- 2026LatticeSMC: Where to Spend Inference-Time Compute in Chunked Sequence Generators2 Oct 2026
- 2026Bridging What the Model Thinks and How It Speaks: Expressive Speech Generation via Self-Aware Intent-Realization Alignment13 Apr 2026
- 2025PrismAudio: Decomposed Chain-of-Thoughts and Multi-dimensional Rewards for Video-to-Audio Generation24 Nov 2025
- 2025UALM: Unified Audio Language Model for Understanding, Generation and Reasoning13 Oct 2025
- 2026Libretto: Giving LLM Agents a Sense of Musical Structure21 Jun 2026
- 2025CoComposer: LLM Multi-agent Collaborative Music Composition29 Aug 2025
- 2025UniVerse-1: Unified Audio-Video Generation via Stitching of Expertscited by 61
- 2026MOVA: Towards Scalable and Synchronized Video-Audio Generationcited by 43
- 2025UniAVGen: Unified Audio and Video Generation with Asymmetric Cross-Modal Interactionscited by 38
- 2025VABench: A Comprehensive Benchmark for Audio-Video Generationcited by 30
- 2025SongGen: A Single Stage Auto-regressive Transformer for Text-to-Song Generationcited by 29
- 2025AudioX: A Unified Framework for Anything-to-Audio Generationcited by 27
- 2026JavisDiT++: Unified Modeling and Optimization for Joint Audio-Video Generationcited by 25
- 2026AVGen-Bench: A Task-Driven Benchmark for Multi-Granular Evaluation of Text-to-Audio-Video Generationcited by 21
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 20
- 2025Audio-Sync Video Generation with Multi-Stream Temporal Controlcited by 15
- 2025Analyzable Chain-of-Musical-Thought Prompting for High-Fidelity Music Generationcited by 14
- 2026MOSS-TTS Technical Reportcited by 14
12 most cited of 88 All 88 (JSON)
- 2026Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generation11 Oct 2026
- 2026A Comprehensive Objective Evaluation of Modern Text-to-Speech for Turkish Using Speech Quality Assessment Models5 Oct 2026
- 2026Prism: Dynamic Sparse Attention for Native 2K Joint Video-Audio Generation Model Training4 Oct 2026
- 2026End-to-End Historical Music Restoration in Latent Space30 Sep 2026
- 2026Hear the World in Stereo: Learning Dynamic Spatial Correspondence for Immersive Joint Video-Audio Generation30 Sep 2026
- 2026YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality27 Sep 2026
- 2026Audio LLMs Know When They Can't Hear You24 Sep 2026
- 2026AV-GRPO: Modality-Anchored Decoupling Diffusion Reinforcement Learning for Joint Audio-Video Generation24 Sep 2026
- 2026TV-AudioRemover: Joint Text-Visual Guided Sound Removal with Multi-Task Hard-Mixture Curriculum22 Sep 2026
- 2026Learnable Classifier-Free Guidance Null Embeddings for Enhanced Controllable Speech Synthesis21 Sep 2026
- 2026CMA-OT: Hierarchical Expert Supervision for Dance-to-Music Generation11 Sep 2026
- 2026DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution31 Aug 2026
12 newest of 88 All 88 (JSON)