mlsanityData to 7 Oct 2026

A framework for compressing unstructured scientific data via serialization

arXiv 2410.08059 ↗First posted 10 Oct 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a general framework for compressing unstructured scientific data with known local connectivity. A common application is simulation data defined on arbitrary finite element meshes. The framework employs a greedy topology preserving reordering of original nodes which allows for seamless integration into existing data processing pipelines. This reordering process depends solely on mesh connectivity and can be performed offline for optimal efficiency. However, the algorithm's greedy nature also supports on-the-fly implementation. The proposed method is compatible with any compression algorithm that leverages spatial correlations within the data. The effectiveness of this approach is demonstrated on a large-scale real dataset using several compression methods, including MGARD, SZ, and ZFP.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 36 references that are in the map. First posted on arXiv 10 Oct 2024.

Builds on

5 of 36 references.

References · 5

  1. 2018TTHRESH: Tensor Compression for Multidimensional Visual Datacited by 41
  2. 2021SDRBench: Scientific Data Reduction Benchmark for Lossy Compressorscited by 16
  3. 2024MGARD: A multigrid framework for high-performance, error-controlled data compression and refactoringcited by 8
  4. 2024Spatiotemporally adaptive compression for scientific dataset with feature preservation -- a case study on simulation data with extreme climate events analysiscited by 5
  5. 2023A Prediction-Traversal Approach for Compressing Scientific Data on Unstructured Meshes with Bounded Errorcited by 1

Built on by

Not cited yet.