Astronomical image time series classification using CONVolutional attENTION (ConvEntion)
Not on the map. Why?
Abstract (arXiv)
Aims. The treatment of astronomical image time series has won increasing attention in recent years. Indeed, numerous surveys following up on transient objects are in progress or under construction, such as the Vera Rubin Observatory Legacy Survey for Space and Time (LSST), which is poised to produce huge amounts of these time series. The associated scientific topics are extensive, ranging from the study of objects in our galaxy to the observation of the most distant supernovae for measuring the expansion of the universe. With such a large amount of data available, the need for robust automatic tools to detect and classify celestial objects is growing steadily. Methods. This study is based on the assumption that astronomical images contain more information than light curves. In this paper, we propose a novel approach based on deep learning for classifying different types of space objects directly using images. We named our approach ConvEntion, which stands for CONVolutional attENTION. It is based on convolutions and transformers, which are new approaches for the treatment of astronomical image time series. Our solution integrates spatio-temporal features and can be applied to various types of image datasets with any number of bands. Results. In this work, we solved various problems the datasets tend to suffer from and we present new results for classifications using astronomical image time series with an increase in accuracy of 13%, compared to state-of-the-art approaches that use image time series, and a 12% increase, compared to approaches that use light curves.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 29 references that are in the map. First posted on arXiv 3 Apr 2023.
Builds on
17 of 29 references.
References · 17
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2022Multiview Transformers for Video Recognitioncited by 148
5 more
- 2021An Image is Worth 16x16 Words, What is a Video Worth?cited by 87
- 2019Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attentioncited by 71
- 2021DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Datacited by 62
- 2021Crop mapping from image time series: deep learning with multi-scale label hierarchiescited by 42
- 2020ConvTransformer: A Convolutional Transformer Network for Video Frame Synthesiscited by 34
Built on by
Not cited yet.