mlsanityData to 7 Oct 2026

PromptReverb: Multimodal Room Impulse Response Generation Through Latent Rectified Flow Matching

arXiv 2510.22439 ↗First posted 25 Oct 2025cs.SD cs.AIcited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Room impulse response (RIR) generation remains a critical challenge for creating immersive virtual acoustic environments. Current methods suffer from two fundamental limitations: the scarcity of full-band RIR datasets and the inability of existing models to generate acoustically accurate responses from diverse input modalities. We present PromptReverb, a two-stage generative framework that addresses these challenges. Our approach combines a variational autoencoder that upsamples band-limited RIRs to full-band quality (48 kHz), and a conditional diffusion transformer model based on rectified flow matching that generates RIRs from descriptions in natural language. Empirical evaluation demonstrates that PromptReverb produces RIRs with superior perceptual quality and acoustic accuracy compared to existing methods, achieving 8.8% mean RT60 error compared to -37% for widely used baselines and yielding more realistic room-acoustic parameters. Our method enables practical applications in virtual reality, architectural acoustics, and audio production where flexible, high-quality RIR synthesis is essential.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 25 of its 38 references that are in the map. First posted on arXiv 25 Oct 2025.

Builds on

25 of 38 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Score Distillation Sampling for Audio: Source Separation, Synthesis, and Beyond7 May
  2. 2025DiffusionRIR: Room Impulse Response Interpolation using Diffusion Models29 Apr
  3. 2024Language-Guided Joint Audio-Visual Editing via One-Shot Adaptation9 Oct

Other references · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  7. 2022A ConvNet for the 2020scited by 3,545
  8. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  9. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  10. 2024Phi-4 Technical Reportcited by 675
  11. 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 277
  12. 2017Pyroomacoustics: A Python package for audio room simulations and array processing algorithmscited by 131
10 more
  1. 2024WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modelingcited by 124
  2. 2022SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learningcited by 93
  3. 2021FAST-RIR: Fast neural diffuse room impulse response generatorcited by 35
  4. 2021Image2Reverb: Cross-Modal Reverb Impulse Response Synthesiscited by 34
  5. 2022MESH2IR: Neural Acoustic Impulse Response Generator for Complex 3D Scenescited by 23
  6. 2023AV-RIR: Audio-Visual Room Impulse Response Estimationcited by 20
  7. 2025Hearing Anywhere in Any Environmentcited by 8
  8. 2024Deep Room Impulse Response Completioncited by 4
  9. 2025Room Impulse Response Generation Conditioned on Acoustic Parameterscited by 3
  10. 2025MEAN-RIR: Multi-Modal Environment-Aware Network for Robust Room Impulse Response Estimationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Few-shot Acoustic Synthesis with Multimodal Flow Matching
  2. 2026Gencho: Room Impulse Response Generation from Reverberant Speech and Text via Diffusion Transformers
  3. 2025DARAS: Dynamic Audio-Room Acoustic Synthesis for Blind Room Impulse Response Estimation ↗
  4. 2026Room Impulse Response Completion Using Signal-Prediction Diffusion Models Conditioned on Simulated Early Reflections
  5. 2026EigeNet: Geometry-Informed Multi-Modal Learning for Few-shot Novel View RIR Prediction
  6. 2026Ambisonics Encoding of Room Impulse Responses using a Device-Agnostic Diffusion Model
  7. 2024Diff-SAGe: End-to-End Spatial Audio Generation Using Diffusion Models
  8. 2024Mutual Learning for Acoustic Matching and Dereverberation via Visual Scene-driven Diffusion