# Machine Learning Techniques for Data Reduction of Climate Applications

arXiv: https://arxiv.org/abs/2405.00879 · HTML: https://mlsanity.com/paper/2405.00879/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 6 of its 27 references that are in the map.
- First posted on arXiv 1 May 2024.

## Builds on (most cited first, 6 of 6)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [cuSZ: An Efficient GPU-Based Error-Bounded Lossy Compression Framework for Scientific Data](https://mlsanity.com/paper/2007.09625/) (2020)
- [MGARD+: Optimizing Multilevel Methods for Error-bounded Scientific Data Reduction](https://mlsanity.com/paper/2010.05872/) (2020)
- [Spatiotemporally adaptive compression for scientific dataset with feature preservation -- a case study on simulation data with extreme climate events analysis](https://mlsanity.com/paper/2401.03317/) (2024)
- [Scalable Multigrid-based Hierarchical Scientific Data Refactoring on GPUs](https://mlsanity.com/paper/2105.12764/) (2021)
- [Image Segmentation For Improved Lossless Screen Content Compression](https://mlsanity.com/paper/2305.05996/) (2023)

## Built on by (most cited first, 3 of 3)

- [Foundation Model for Lossy Compression of Spatiotemporal Scientific Data](https://mlsanity.com/paper/2412.17184/) (2024)
- [Generative Latent Diffusion for Efficient Spatiotemporal Data Reduction](https://mlsanity.com/paper/2507.02129/) (2025)
- [Neural Residual Modeling for Scientific Data Compression under Guaranteed Error Bounds](https://mlsanity.com/paper/2609.23185/) (2026)

## Abstract (arXiv)

Scientists conduct large-scale simulations to compute derived quantities-of-interest (QoI) from primary data. Often, QoI are linked to specific features, regions, or time intervals, such that data can be adaptively reduced without compromising the integrity of QoI. For many spatiotemporal applications, these QoI are binary in nature and represent presence or absence of a physical phenomenon. We present a pipelined compression approach that first uses neural-network-based techniques to derive regions where QoI are highly likely to be present. Then, we employ a Guaranteed Autoencoder (GAE) to compress data with differential error bounds. GAE uses QoI information to apply low-error compression to only these regions. This results in overall high compression ratios while still achieving downstream goals of simulation or data collections. Experimental results are presented for climate data generated from the E3SM Simulation model for downstream quantities such as tropical cyclone and atmospheric river detection and tracking. These results show that our approach is superior to comparable methods in the literature.