Scale-Translation Equivariant Network for Oceanic Internal Solitary Wave Localization
Not on the map. Why?
Abstract (arXiv)
Internal solitary waves (ISWs) are gravity waves that are often observed in the interior ocean rather than the surface. They hold significant importance due to their capacity to carry substantial energy, thus influence pollutant transport, oil platform operations, submarine navigation, etc. Researchers have studied ISWs through optical images, synthetic aperture radar (SAR) images, and altimeter data from remote sensing instruments. However, cloud cover in optical remote sensing images variably obscures ground information, leading to blurred or missing surface observations. As such, this paper aims at altimeter-based machine learning solutions to automatically locate ISWs. The challenges, however, lie in the following two aspects: 1) the altimeter data has low resolution, which requires a strong machine learner; 2) labeling data is extremely labor-intensive, leading to very limited data for training. In recent years, the grand progress of deep learning demonstrates strong learning capacity given abundant data. Besides, more recent studies on efficient learning and self-supervised learning laid solid foundations to tackle the aforementioned challenges. In this paper, we propose to inject prior knowledge to achieve a strong and efficient learner. Specifically, intrinsic patterns in altimetry data are efficiently captured using a scale-translation equivariant convolutional neural network (ST-ECNN). By considering inherent symmetries in neural network design, ST-ECNN achieves higher efficiency and better performance than baseline models. Furthermore, we also introduce prior knowledge from massive unsupervised data to enhance our solution using the SimCLR framework for pre-training. Our final solution achieves an overall better performance than baselines on our handcrafted altimetry dataset. Data and codes are available at https://github.com/ZhangWan-byte/Internal_Solitary_Wave_Localization .
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 67 references that are in the map. First posted on arXiv 18 Jun 2024.
Builds on
30 of 67 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2014Going Deeper with Convolutionscited by 4,231
- 2022A ConvNet for the 2020scited by 3,545
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
18 more
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2021E(n) Equivariant Graph Neural Networkscited by 951
- 2020Contrastive Learning with Hard Negative Samplescited by 619
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2019General E(2)-Equivariant Steerable CNNscited by 441
- 2021Bottleneck Transformers for Visual Recognitioncited by 364
- 2021The Principles of Deep Learning Theorycited by 169
- 2014A Convolutional Neural Network for Modelling Sentencescited by 163
- 2021Self-supervised Learning is More Robust to Dataset Imbalancecited by 122
- 2019Deep Learning in Video Multi-Object Tracking: A Surveycited by 107
- 2019B-Spline CNNs on Lie Groupscited by 97
- 2018Roto-Translation Covariant Convolutional Networks for Medical Image Analysiscited by 91
- 2016Sequential Short-Text Classification with Recurrent and Convolutional Neural Networkscited by 28
- 2021Convolutional Neural Networks Are Not Invariant to Translation, but They Can Learn to Becited by 19
- 2018Sample Efficient Semantic Segmentation using Rotation Equivariant Convolutional Networkscited by 11
- 2021Contrastive Pre-training for Imbalanced Corporate Credit Ratingscited by 4
Built on by
Not cited yet.