mlsanityData to 7 Oct 2026

On a Hidden Property in Computational Imaging

arXiv 2410.08498 ↗First posted 11 Oct 2024cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Computational imaging plays a vital role in various scientific and medical applications, such as Full Waveform Inversion (FWI), Computed Tomography (CT), and Electromagnetic (EM) inversion. These methods address inverse problems by reconstructing physical properties (e.g., the acoustic velocity map in FWI) from measurement data (e.g., seismic waveform data in FWI), where both modalities are governed by complex mathematical equations. In this paper, we empirically demonstrate that despite their differing governing equations, three inverse problems (FWI, CT, and EM inversion) share a hidden property within their latent spaces. Specifically, using FWI as an example, we show that both modalities (the velocity map and seismic waveform data) follow the same set of one-way wave equations in the latent space, yet have distinct initial conditions that are linearly correlated. This suggests that after projection into the latent embedding space, the two modalities correspond to different solutions of the same equation, connected through their initial conditions. Our experiments confirm that this hidden property is consistent across all three imaging problems, providing a novel perspective for understanding these computational imaging tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 11 Oct 2024.

Builds on

16 of 26 references.

References · 16

  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  2. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  3. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  4. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  5. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  6. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
  7. 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
  8. 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
  9. 2017A Review of Convolutional Neural Networks for Inverse Problems in Imagingcited by 81
  10. 2018InversionNet: A Real-Time and Accurate Full Waveform Inversion with CNNs and continuous CRFscited by 60
  11. 2021Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loopcited by 29
  12. 2023An Empirical Study of Large-Scale Data-Driven Full Waveform Inversioncited by 9
4 more
  1. 2022An Intriguing Property of Geophysics Inversioncited by 8
  2. 2023Auto-Linear Phenomenon in Subsurface Imagingcited by 6
  3. 2023Image as First-Order Norm+Linear Autoregression: Unveiling Mathematical Invariancecited by 2
  4. 2023Exploring Invariance in Images through One-way Wave Equationscited by 1

Built on by

Not cited yet.