mlsanityData to 7 Oct 2026

Scale-Translation Equivariant Network for Oceanic Internal Solitary Wave Localization

arXiv 2406.13060 ↗First posted 18 Jun 2024cs.LG cs.AI stat.APcited by 0

Not on the map. Why?

Abstract (arXiv)

Internal solitary waves (ISWs) are gravity waves that are often observed in the interior ocean rather than the surface. They hold significant importance due to their capacity to carry substantial energy, thus influence pollutant transport, oil platform operations, submarine navigation, etc. Researchers have studied ISWs through optical images, synthetic aperture radar (SAR) images, and altimeter data from remote sensing instruments. However, cloud cover in optical remote sensing images variably obscures ground information, leading to blurred or missing surface observations. As such, this paper aims at altimeter-based machine learning solutions to automatically locate ISWs. The challenges, however, lie in the following two aspects: 1) the altimeter data has low resolution, which requires a strong machine learner; 2) labeling data is extremely labor-intensive, leading to very limited data for training. In recent years, the grand progress of deep learning demonstrates strong learning capacity given abundant data. Besides, more recent studies on efficient learning and self-supervised learning laid solid foundations to tackle the aforementioned challenges. In this paper, we propose to inject prior knowledge to achieve a strong and efficient learner. Specifically, intrinsic patterns in altimetry data are efficiently captured using a scale-translation equivariant convolutional neural network (ST-ECNN). By considering inherent symmetries in neural network design, ST-ECNN achieves higher efficiency and better performance than baseline models. Furthermore, we also introduce prior knowledge from massive unsupervised data to enhance our solution using the SimCLR framework for pre-training. Our final solution achieves an overall better performance than baselines on our handcrafted altimetry dataset. Data and codes are available at https://github.com/ZhangWan-byte/Internal_Solitary_Wave_Localization .

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 67 references that are in the map. First posted on arXiv 18 Jun 2024.

Builds on

30 of 67 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  7. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  8. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  9. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  10. 2014Going Deeper with Convolutionscited by 4,231
  11. 2022A ConvNet for the 2020scited by 3,545
  12. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
18 more
  1. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
  2. 2016Group Equivariant Convolutional Networkscited by 1,154
  3. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
  4. 2021E(n) Equivariant Graph Neural Networkscited by 951
  5. 2020Contrastive Learning with Hard Negative Samplescited by 619
  6. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  7. 2019General E(2)-Equivariant Steerable CNNscited by 441
  8. 2021Bottleneck Transformers for Visual Recognitioncited by 364
  9. 2021The Principles of Deep Learning Theorycited by 169
  10. 2014A Convolutional Neural Network for Modelling Sentencescited by 163
  11. 2021Self-supervised Learning is More Robust to Dataset Imbalancecited by 122
  12. 2019Deep Learning in Video Multi-Object Tracking: A Surveycited by 107
  13. 2019B-Spline CNNs on Lie Groupscited by 97
  14. 2018Roto-Translation Covariant Convolutional Networks for Medical Image Analysiscited by 91
  15. 2016Sequential Short-Text Classification with Recurrent and Convolutional Neural Networkscited by 28
  16. 2021Convolutional Neural Networks Are Not Invariant to Translation, but They Can Learn to Becited by 19
  17. 2018Sample Efficient Semantic Segmentation using Rotation Equivariant Convolutional Networkscited by 11
  18. 2021Contrastive Pre-training for Imbalanced Corporate Credit Ratingscited by 4

Built on by

Not cited yet.