3DAE: Binaural Quality Assessment for Audio Novel View Synthesis with Spatial Maps and Benchmark
Not on the map. Why?
Abstract (arXiv)
3D audio and novel-view acoustic synthesis models are usually evaluated with global metrics.However, global metrics often hide where and why binaural prediction fails. We propose a full-reference diagnostic framework that uses time-frequency audio error maps for magnitude, ILD, IPD, temporal alignment, loudness, and high-frequency failures, forming a 3D Audio Error Map (3DAE Map) for visual inspection. We frame these diagnostics into a model-agnostic benchmark, Spatial Audio Error Bench (3DAE Bench), which takes arbitrary ground-truth and predicted binaural pairs and reports the prediction quality of audio novel-view synthesis models. Experiments on ViGAS outputs over Replay-NVAS and SoundSpaces show different dominant failure modes: temporal misalignment on Replay-NVAS and ILD mismatch on SoundSpaces. Overall, the framework provides interpretable failure-mode summaries and intuitive visual maps for audio Novel-view-synthesis model development optimization.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 17 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
9 of 17 references.
References · 9
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learningcited by 95
- 20182.5D Visual Soundcited by 63
- 2023TorchAudio-Squim: Reference-less Speech Quality and Intelligibility measures in TorchAudiocited by 59
- 2023AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesiscited by 49
- 2023Novel-View Acoustic Synthesiscited by 33
- 2024AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesiscited by 14
- 2024NeRAF: 3D Scene Infused Neural Radiance and Acoustic Fieldscited by 9
- 2023Replay: Multi-modal Multi-view Acted Videos for Casual Holographycited by 7
Built on by
Not cited yet.