mlsanityData to 14 Oct 2026

3DAE: Binaural Quality Assessment for Audio Novel View Synthesis with Spatial Maps and Benchmark

arXiv 2605.30469 ↗First posted 28 May 2026cs.SD cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D audio and novel-view acoustic synthesis models are usually evaluated with global metrics.However, global metrics often hide where and why binaural prediction fails. We propose a full-reference diagnostic framework that uses time-frequency audio error maps for magnitude, ILD, IPD, temporal alignment, loudness, and high-frequency failures, forming a 3D Audio Error Map (3DAE Map) for visual inspection. We frame these diagnostics into a model-agnostic benchmark, Spatial Audio Error Bench (3DAE Bench), which takes arbitrary ground-truth and predicted binaural pairs and reports the prediction quality of audio novel-view synthesis models. Experiments on ViGAS outputs over Replay-NVAS and SoundSpaces show different dominant failure modes: temporal misalignment on Replay-NVAS and ILD mismatch on SoundSpaces. Overall, the framework provides interpretable failure-mode summaries and intuitive visual maps for audio Novel-view-synthesis model development optimization.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 17 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

9 of 17 references.

References · 9

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2022SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learningcited by 95
  3. 20182.5D Visual Soundcited by 63
  4. 2023TorchAudio-Squim: Reference-less Speech Quality and Intelligibility measures in TorchAudiocited by 59
  5. 2023AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesiscited by 49
  6. 2023Novel-View Acoustic Synthesiscited by 33
  7. 2024AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesiscited by 14
  8. 2024NeRAF: 3D Scene Infused Neural Radiance and Acoustic Fieldscited by 9
  9. 2023Replay: Multi-modal Multi-view Acted Videos for Casual Holographycited by 7

Built on by

Not cited yet.