mlsanityData to 7 Oct 2026

Image2Reverb: Cross-Modal Reverb Impulse Response Synthesis

arXiv 2103.14201 ↗First posted 26 Mar 2021cs.SD cs.CV cs.LGcited by 34

Not on the map. Why?

Abstract (arXiv)

Measuring the acoustic characteristics of a space is often done by capturing its impulse response (IR), a representation of how a full-range stimulus sound excites it. This work generates an IR from a single image, which can then be applied to other signals using convolution, simulating the reverberant characteristics of the space shown in the image. Recording these IRs is both time-intensive and expensive, and often infeasible for inaccessible locations. We use an end-to-end neural network architecture to generate plausible audio impulse responses from single images of acoustic environments. We evaluate our method both by comparisons to ground truth data and by human expert evaluation. We demonstrate our approach by generating plausible impulse responses from diverse settings and formats including well known places, musical halls, rooms in paintings, images from animations and computer games, synthetic environments generated from text, panoramic images, and video conference backgrounds.

Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 14 of its 45 references that are in the map. First posted on arXiv 26 Mar 2021.

Builds on

14 of 45 references.

References · 14

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  3. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  4. 2014Conditional Generative Adversarial Netscited by 2,152
  5. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  6. 2016Least Squares Generative Adversarial Networkscited by 1,000
  7. 2020High-Fidelity Generative Image Compressioncited by 331
  8. 2018Adversarial Audio Synthesiscited by 222
  9. 2020A Review on Generative Adversarial Networks: Algorithms, Theory, and Applicationscited by 209
  10. 2019GANSynth: Adversarial Neural Audio Synthesiscited by 114
  11. 2017Deep Cross-Modal Audio-Visual Generationcited by 63
  12. 20182.5D Visual Soundcited by 63
2 more
  1. 2018Scene-Aware Audio for 360textdegree Videoscited by 25
  2. 2020IR-GAN: Room Impulse Response Generator for Far-field Speech Recognitioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 6; 2023: 9; 2024: 7; 2025: 7; 2026: 3.

34 papers.

Sort:

By area:

  1. 2022SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learningcited by 93
  2. 2022Learning Neural Acoustic Fieldscited by 65
  3. 2023AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesiscited by 49
  4. 2022Few-Shot Audio-Visual Learning of Environment Acousticscited by 48
  5. 2022Visual Acoustic Matchingcited by 45
  6. 2021FAST-RIR: Fast neural diffuse room impulse response generatorcited by 35
  7. 2023Novel-View Acoustic Synthesiscited by 33
  8. 2021Learning Audio-Visual Dereverberationcited by 26
  9. 2022MESH2IR: Neural Acoustic Impulse Response Generator for Complex 3D Scenescited by 23
  10. 2023Measuring Acoustics with Collaborative Multiple Agentscited by 21
  11. 2023AV-RIR: Audio-Visual Room Impulse Response Estimationcited by 20
  12. 2024Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmarkcited by 20
22 more
  1. 2023Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotationcited by 18
  2. 2023AdVerb: Visually Guided Audio Dereverberationcited by 15
  3. 2023Self-Supervised Visual Acoustic Matchingcited by 14
  4. 2024SoundingActions: Learning How Actions Sound from Narrated Egocentric Videoscited by 11
  5. 2023Listen2Scene: Interactive material-aware binaural sound propagation for reconstructed 3D scenescited by 10
  6. 2024NeRAF: 3D Scene Infused Neural Radiance and Acoustic Fieldscited by 8
  7. 2024Self-Supervised Audio-Visual Soundscape Stylizationcited by 8
  8. 2025Hearing Anywhere in Any Environmentcited by 8
  9. 2025Differentiable Room Acoustic Rendering with Multi-View Vision Priorscited by 5
  10. 2025How Would It Sound? Material-Controlled Multimodal Acoustic Profile Generation for Indoor Scenescited by 4
  11. 2023Looking Similar, Sounding Different: Leveraging Counterfactual Cross-Modal Pairs for Audiovisual Representation Learningcited by 3
  12. 2024DIFFRENT: A Diffusion Model for Recording Environment Transfer of Speechcited by 3
  13. 2025SoundVista: Novel-View Ambient Sound Synthesis via Visual-Acoustic Bindingcited by 3
  14. 2024ActiveRIR: Active Audio-Visual Exploration for Acoustic Environment Modelingcited by 2
  15. 2025Enhancing XR Auditory Realism via Multimodal Scene-Aware Acoustic Renderingcited by 2
  16. 2026Few-shot Acoustic Synthesis with Multimodal Flow Matchingcited by 2
  17. 2022One-Shot Acoustic Matching Of Audio Signals -- Learning to Hear Music In Any Room/ Concert Hallcited by 0
  18. 2024Mutual Learning for Acoustic Matching and Dereverberation via Visual Scene-driven Diffusioncited by 0
  19. 2025Explicit Context-Driven Neural Acoustic Modeling for High-Fidelity RIR Generationcited by 0
  20. 2025PromptReverb: Multimodal Room Impulse Response Generation Through Latent Rectified Flow Matchingcited by 0
  21. 2026Materialistic RIR: Material Conditioned Realistic RIR Generationcited by 0
  22. 2026MMAudioReverbs: Video-Guided Acoustic Modeling for Dereverberation and Room Impulse Response Estimationcited by 0