Enhancing Lossy Compression Through Cross-Field Information for Scientific Applications
Not on the map. Why?
Abstract (arXiv)
Lossy compression is one of the most effective methods for reducing the size of scientific data containing multiple data fields. It reduces information density through prediction or transformation techniques to compress the data. Previous approaches use local information from a single target field when predicting target data points, limiting their potential to achieve higher compression ratios. In this paper, we identified significant cross-field correlations within scientific datasets. We propose a novel hybrid prediction model that utilizes CNN to extract cross-field information and combine it with existing local field information. Our solution enhances the prediction accuracy of lossy compressors, leading to improved compression ratios without compromising data quality. We evaluate our solution on three scientific datasets, demonstrating its ability to improve compression ratios by up to 25% under specific error bounds. Additionally, our solution preserves more data details and reduces artifacts compared to baseline approaches.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 26 references that are in the map. First posted on arXiv 26 Sep 2024.
Builds on
12 of 26 references.
References · 12
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 324
- 2021SZ3: A Modular Framework for Composing Prediction-Based Error-Bounded Lossy Compressorscited by 29
- 2021Exploring Autoencoder-based Error-bounded Compression for Scientific Datacited by 19
- 2021SDRBench: Scientific Data Reduction Benchmark for Lossy Compressorscited by 16
- 2020cuSZ: An Efficient GPU-Based Error-Bounded Lossy Compression Framework for Scientific Datacited by 13
- 2019DeepSZ: A Novel Framework to Compress Deep Neural Networks by Using Error-Bounded Lossy Compressioncited by 11
- 2021COMET: A Novel Memory-Efficient Deep Learning Training Framework by Using Error-Bounded Lossy Compressioncited by 8
- 2015CRF Learning with CNN Features for Image Segmentationcited by 6
- 2024GWLZ: A Group-wise Learning-based Lossy Compression Framework for Scientific Datacited by 3
- 2023AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement Applicationscited by 1
Built on by
Not cited yet.