Context-Aware Neural Video Compression on Solar Dynamics Observatory
Not on the map. Why?
Abstract (arXiv)
NASA's Solar Dynamics Observatory (SDO) mission collects large data volumes of the Sun's daily activity. Data compression is crucial for space missions to reduce data storage and video bandwidth requirements by eliminating redundancies in the data. In this paper, we present a novel neural Transformer-based video compression approach specifically designed for the SDO images. Our primary objective is to efficiently exploit the temporal and spatial redundancies inherent in solar images to obtain a high compression ratio. Our proposed architecture benefits from a novel Transformer block called Fused Local-aware Window (FLaWin), which incorporates window-based self-attention modules and an efficient fused local-aware feed-forward (FLaFF) network. This architectural design allows us to simultaneously capture short-range and long-range information while facilitating the extraction of rich and diverse contextual representations. Moreover, this design choice results in reduced computational complexity. Experimental results demonstrate the significant contribution of the FLaWin Transformer block to the compression performance, outperforming conventional hand-engineered video codecs such as H.264 and H.265 in terms of rate-distortion trade-off.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 19 Sep 2023.
Builds on
30 of 49 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2022Generative Adversarial Networkscited by 5,603
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2018Variational image compression with a scale hyperpriorcited by 910
- 2016End-to-end Optimized Image Compressioncited by 673
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
18 more
- 2020End-to-End Video Instance Segmentation with Transformerscited by 443
- 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 421
- 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 324
- 2017Soft-to-Hard Vector Quantization for End-to-End Learning Compressible Representationscited by 149
- 2021FVC: A New Framework towards Deep Video Compression in Feature Spacecited by 149
- 2021HRFormer: High-Resolution Transformer for Dense Predictioncited by 149
- 2020Nonlinear Transform Codingcited by 132
- 2020M-LVC: Multiple Frames Prediction for Learned Video Compressioncited by 106
- 2019Video Compression With Rate-Distortion Autoencoderscited by 97
- 2018Learned Video Compressioncited by 89
- 2019Image and Video Compression with Neural Networks: A Reviewcited by 82
- 2022An Introduction to Neural Data Compressioncited by 78
- 2022VCT: A Video Compression Transformercited by 74
- 2021Neural Video Compression using GANs for Detail Synthesis and Propagationcited by 35
- 2019A Machine Learning Dataset Prepared From the NASA Solar Dynamics Observatory Missioncited by 26
- 2023Frequency Disentangled Features in Neural Image Compressioncited by 14
- 2022Attention-Based Generative Neural Image Compression on Solar Dynamics Observatorycited by 8
- 2023Diversity Maximized Scheduling in RoadSide Units for Traffic Monitoring Applicationscited by 7
Built on by
Not cited yet.