mlsanityData to 14 Oct 2026

Parameter-Efficient Adaptation of Pre-Trained Vision Foundation Models for Active and Passive Seismic Data Denoising

arXiv 2605.10953 ↗First posted 30 Apr 2026physics.geo-ph cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The demand for high-resolution subsurface imaging and continuous Earth monitoring has driven rapid growth in active and passive seismic data from dense geophone deployments, distributed acoustic sensing (DAS) arrays, and large-scale 2D and 3D surveys. This expansion makes complex noise suppression increasingly challenging, especially when signal fidelity must be preserved. Conventional supervised deep learning methods are often task-specific, require large paired datasets, and can suffer from domain shift under new acquisition conditions. Foundation models offer a promising alternative, but pre-training seismic foundation models from scratch requires massive domain-specific data and substantial computation. We propose an efficient framework that repurposes general-purpose Vision Foundation Models (VFMs) for geophysical tasks through Parameter-Efficient Fine-Tuning. The architecture uses a pre-trained VFM, a DINOv3 encoder, adapted with Low-Rank Adaptation (LoRA) to enable effective feature adaptation with few additional parameters. To improve robustness under unseen field conditions without ground truth, we introduce a kurtosis-guided unsupervised test-time adaptation module that updates only LoRA parameters during inference. This module self-calibrates the model to site-specific noise by identifying information-rich regions via kurtosis and performing self-training without labeled data. Experiments on public exploration seismic images and DAS vertical seismic profiling data from the Utah FORGE site show that the framework matches or outperforms domain-specific models. Tests on unseen cross-site data from a land survey in China and the Gross Sch"onebeck geothermal site in Germany further demonstrate strong generalization and effective signal-noise separation. These results highlight the potential of adapting pre-trained VFMs to data-intensive problems in exploration seismology.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 43 references that are in the map. First posted on arXiv 30 Apr 2026.

Builds on

11 of 43 references.

References · 11

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  4. 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
  5. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  6. 2018Seismic Signal Denoising and Decomposition Using Deep Neural Networkscited by 21
  7. 2021The potential of self-supervised networks for random noise suppression in seismic datacited by 10
  8. 2023DAS-N2N: Machine learning Distributed Acoustic Sensing (DAS) signal denoising without clean datacited by 4
  9. 2024Cross-Domain Foundation Model Adaptation: Pioneering Computer Vision Models for Geophysical Data Analysiscited by 4
  10. 2022Transfer learning for self-supervised, blind-spot seismic denoisingcited by 3
  11. 2025Foundation Models For Seismic Data Processing: An Extensive Reviewcited by 1

Built on by

Not cited yet.