mlsanityData to 7 Oct 2026

MIMII-Gen: Generative Modeling Approach for Simulated Evaluation of Anomalous Sound Detection System

arXiv 2409.18542 ↗First posted 27 Sep 2024eess.AS cs.AI cs.SDcited by 1

Not on the map. Why?

Abstract (arXiv)

Insufficient recordings and the scarcity of anomalies present significant challenges in developing and validating robust anomaly detection systems for machine sounds. To address these limitations, we propose a novel approach for generating diverse anomalies in machine sound using a latent diffusion-based model that integrates an encoder-decoder framework. Our method utilizes the Flan-T5 model to encode captions derived from audio file metadata, enabling conditional generation through a carefully designed U-Net architecture. This approach aids our model in generating audio signals within the EnCodec latent space, ensuring high contextual relevance and quality. We objectively evaluated the quality of our generated sounds using the Fr'echet Audio Distance (FAD) score and other metrics, demonstrating that our approach surpasses existing models in generating reliable machine audio that closely resembles actual abnormal conditions. The evaluation of the anomaly detection system using our generated data revealed a strong correlation, with the area under the curve (AUC) score differing by 4.8% from the original, validating the effectiveness of our generated data. These results demonstrate the potential of our approach to enhance the evaluation and robustness of anomaly detection systems across varied and previously unseen conditions. Audio samples can be found at urlhttps://hpworkhub.github.io/MIMII-Gen.github.io/.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 31 references that are in the map. First posted on arXiv 27 Sep 2024.

Builds on

26 of 31 references.

References · 26

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  4. 2016Improved Techniques for Training GANscited by 2,938
  5. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  6. 2022High Fidelity Neural Audio Compressioncited by 673
  7. 2020VGGSound: A Large-scale Audio-Visual Datasetcited by 641
  8. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
  9. 2023MusicLM: Generating Music From Textcited by 442
  10. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
  11. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 323
  12. 2022AudioGen: Textually Guided Audio Generationcited by 292
14 more
  1. 2022Diffsound: Discrete Diffusion Model for Text-to-sound Generationcited by 256
  2. 2021Efficient Training of Audio Transformers with Patchoutcited by 222
  3. 2018Fr'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithmscited by 221
  4. 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Modelcited by 145
  5. 2023Adapting Frechet Audio Distance for Generative Music Evaluationcited by 92
  6. 2023Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generationcited by 90
  7. 2020Anomalous sound detection based on interpolation deep neural networkcited by 33
  8. 2022MIMII DG: Sound Dataset for Malfunctioning Industrial Machine Investigation and Inspection for Domain Generalization Taskcited by 23
  9. 2022ResGrad: Residual Denoising Diffusion Probabilistic Models for Text to Speechcited by 21
  10. 2023Description and Discussion on DCASE 2023 Challenge Task 2: First-Shot Unsupervised Anomalous Sound Detection for Machine Condition Monitoringcited by 18
  11. 2021Description and Discussion on DCASE 2021 Challenge Task 2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring under Domain Shifted Conditionscited by 16
  12. 2020Deep Autoencoding GMM-based Unsupervised Anomaly Detection in Acoustic Signals and its Hyper-parameter Optimizationcited by 12
  13. 2023First-Shot Unsupervised Anomalous Sound Detection With Unknown Anomalies Estimated by Metadata-Assisted Audio Generationcited by 3
  14. 2022Hierarchical Conditional Variational Autoencoder Based Acoustic Anomaly Detectioncited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Did You Hear That? Introducing AADG: A Framework for Generating Benchmark Data in Audio Anomaly Detection
  2. 2026UD-ASD: A Unified Diffusion Model for Anomalous Sound Detection
  3. 2026Relative Mismatch: Local-Reference Calibration of Feature-Space Flows for Anomalous Sound Detection ↗
  4. 2026TLDiffGAN: A Latent Diffusion-GAN Framework with Temporal Information Fusion for Anomalous Sound Detection
  5. 2025ESTM: An Enhanced Dual-Branch Spectral-Temporal Mamba for Anomalous Sound Detection
  6. 2023DiffSED: Sound Event Detection with Denoising Diffusion
  7. 2025SynSonic: Augmenting Sound Event Detection through Text-to-Audio Diffusion ControlNet and Effective Sample Filtering
  8. 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation