One Model, Two Worlds: Bidirectional Sonar-Optical Translation
Not on the map. Why?
Abstract (arXiv)
Translating between imaging sonar and optical cameras is valuable for underwater perception, but supporting both directions with separate models duplicates storage and computation. A unified bidirectional model is therefore attractive, yet existing approaches largely treat the two directions symmetrically despite their fundamentally different image-formation physics. We argue that sharing a generative model does not require sharing the physics. We introduce the Direction-Asymmetric Realism Bridge (DARB), which retains a shared diffusion-bridge trunk while routing direction-specific physical priors through asymmetric pathways: range-aware modulation for sonar-to-optical translation and polar ray-dependent processing for optical-to-sonar translation. We further show that symmetry in training is also costly: applying a common realism schedule reduces sonar-to-optical PSNR by 2.60 dB. Our Adaptive Realism Supervision (ARS) instead determines when, where, and how strongly perceptual supervision is applied from reconstruction quality and gradient balance. Together, DARB and ARS enable one bidirectional model to match the sonar-to-optical specialist within 0.11 dB PSNR, outperform the optical-to-sonar specialist by 0.70 FID, and surpass two independently trained BBDMs on seven of eight metrics.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 47 references that are in the map. First posted on arXiv 5 Sep 2026.
Builds on
33 of 47 references.
References · 33
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
21 more
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2017The Perception-Distortion Tradeoffcited by 582
- 2022Perception Prioritized Training of Diffusion Modelscited by 301
- 2023Efficient Diffusion Training via Min-SNR Weighting Strategycited by 242
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
- 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 212
- 2023Denoising Diffusion Bridge Modelscited by 171
- 2023Unpaired Image-to-Image Translation via Neural Schr"odinger Bridgecited by 96
- 2024PID: Physics-Informed Diffusion Model for Infrared Image Generationcited by 17
- 2024AONeuS: A Neural Rendering Framework for Acoustic-Optical Sensor Fusioncited by 13
- 2022OysterNet: Enhanced Oyster Detection Using Simulationcited by 11
- 2024Diffusion as Sound Propagation: Physics-inspired Model for Ultrasound Image Generationcited by 9
- 2025Bidirectional Diffusion Bridge Modelscited by 8
- 2024ODYSSEE: Oyster Detection Yielded by Sensor Systems on Edge Electronicscited by 5
- 2024Sonar-based Deep Learning in Underwater Robotics: Overview, Robustness and Challengescited by 5
- 20232D Forward Looking Sonar Simulation with Ground Echo Modelingcited by 4
- 2025CM-Diff: A Single Generative Network for Bidirectional Cross-Modality Translation Diffusion Model Between Infrared and Visible Imagescited by 2
Built on by
Not cited yet.