Spatiotemporally adaptive compression for scientific dataset with feature preservation -- a case study on simulation data with extreme climate events analysis
Not on the map. Why?
Abstract (arXiv)
Scientific discoveries are increasingly constrained by limited storage space and I/O capacities. For time-series simulations and experiments, their data often need to be decimated over timesteps to accommodate storage and I/O limitations. In this paper, we propose a technique that addresses storage costs while improving post-analysis accuracy through spatiotemporal adaptive, error-controlled lossy compression. We investigate the trade-off between data precision and temporal output rates, revealing that reducing data precision and increasing timestep frequency lead to more accurate analysis outcomes. Additionally, we integrate spatiotemporal feature detection with data compression and demonstrate that performing adaptive error-bounded compression in higher dimensional space enables greater compression ratios, leveraging the error propagation theory of a transformation-based compressor. To evaluate our approach, we conduct experiments using the well-known E3SM climate simulation code and apply our method to compress variables used for cyclone tracking. Our results show a significant reduction in storage size while enhancing the quality of cyclone tracking analysis, both quantitatively and qualitatively, in comparison to the prevalent timestep decimation approach. Compared to three state-of-the-art lossy compressors lacking feature preservation capabilities, our adaptive compression framework improves perfectly matched cases in TC tracking by 26.4-51.3% at medium compression ratios and by 77.3-571.1% at large compression ratios, with a merely 5-11% computational overhead.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 0 of its 40 references that are in the map. First posted on arXiv 6 Jan 2024.
Builds on
0 of 40 references.
No references here yet.
Built on by
Citing papers per year: 2024: 3; 2025: 1; 2026: 1.
5 papers.
- 2024MGARD: A multigrid framework for high-performance, error-controlled data compression and refactoringcited by 8
- 2024Machine Learning Techniques for Data Reduction of Climate Applicationscited by 3
- 2026ANTIC: Adaptive Neural Temporal In-situ Compressorcited by 2
- 2024A framework for compressing unstructured scientific data via serializationcited by 0
- 2025Summary Statistics of Large-scale Model Outputs for Observation-corrected Outputscited by 0
- 2026ANTIC: Adaptive Neural Temporal In-situ Compressor10 Apr 2026
- 2025Summary Statistics of Large-scale Model Outputs for Observation-corrected Outputs18 Jun 2025
- 2024A framework for compressing unstructured scientific data via serialization10 Oct 2024
- 2024Machine Learning Techniques for Data Reduction of Climate Applications1 May 2024
- 2024MGARD: A multigrid framework for high-performance, error-controlled data compression and refactoring11 Jan 2024