mlsanityData to 7 Oct 2026

Onboard deep lossless and near-lossless predictive coding of hyperspectral images with line-based attention

arXiv 2403.17677 ↗First posted 26 Mar 2024eess.IV cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Deep learning methods have traditionally been difficult to apply to compression of hyperspectral images onboard of spacecrafts, due to the large computational complexity needed to achieve adequate representational power, as well as the lack of suitable datasets for training and testing. In this paper, we depart from the traditional autoencoder approach and we design a predictive neural network, called LineRWKV, that works recursively line-by-line to limit memory consumption. In order to achieve that, we adopt a novel hybrid attentive-recursive operation that combines the representational advantages of Transformers with the linear complexity and recursive implementation of recurrent neural networks. The compression algorithm performs prediction of each pixel using LineRWKV, followed by entropy coding of the residual. Experiments on the HySpecNet-11k dataset and PRISMA images show that LineRWKV is the first deep-learning method to outperform CCSDS-123.0-B-2 at lossless and near-lossless compression. Promising throughput results are also evaluated on a 7W embedded system.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 15 of its 50 references that are in the map. First posted on arXiv 26 Mar 2024.

Builds on

15 of 50 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Layer Normalizationcited by 5,579
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  4. 2018Variational image compression with a scale hyperpriorcited by 910
  5. 2016Conditional Image Generation with PixelCNN Decoderscited by 859
  6. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 814
  7. 2016End-to-end Optimized Image Compressioncited by 673
  8. 2015Variable Rate Image Compression with Recurrent Neural Networkscited by 168
  9. 2017Breaking the Softmax Bottleneck: A High-Rank RNN Language Modelcited by 147
  10. 2020Nonlinear Transform Codingcited by 132
  11. 2018Practical Full Resolution Learned Lossless Image Compressioncited by 93
  12. 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 80
3 more
  1. 2023HySpecNet-11k: A Large-Scale Hyperspectral Dataset for Benchmarking Learning-Based Hyperspectral Image Compression Methodscited by 26
  2. 2021Image Compression with Recurrent Neural Network and Generalized Divisive Normalizationcited by 9
  3. 2019High-throughput Onboard Hyperspectral Image Compression with Ground-based CNN Reconstructioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.