mlsanityData to 14 Oct 2026

Preserving Clusters in Error-Bounded Lossy Compression of Scientific Particle Data

arXiv 2604.18801 ↗First posted 20 Apr 2026cs.LG cs.DCcited by 0

Not on the map. Why?

Abstract (arXiv)

Scientific particle simulations in cosmology, molecular dynamics, and fluid dynamics produce large-scale datasets whose storage, movement, and analysis increasingly rely on lossy compression. However, existing compressors typically bound only pointwise position errors, providing no guarantee on the fidelity of structures derived from particle coordinates, such as single-linkage clustering (also known as Friends-of-Friends algorithm), where clusters are connected components of a proximity graph formed by linking particle pairs within a distance threshold. Even small coordinate perturbations near this threshold can break true links or create false links, thereby splitting or merging entire clusters. We propose a compressor-independent correction technique for preserving single-linkage cluster membership under lossy compression. Our method operates on reconstructed outputs from off-the-shelf compressors such as SZ3, ZFP, Draco, and LCP, and stores a compact corrective edit stream. Our key observation is that cluster-membership queries depend on connected components rather than the complete set of proximity links. Based on this observation, we introduce three constraint-selection modes, vulnerable-pair, safe-component, and halo-forest, that progressively reduce the constraints enforced during correction. Projected gradient descent then corrects the reconstructed coordinates to eliminate the selected violations while respecting the original pointwise error bound. Experiments on cosmology, molecular dynamics, and fluid dynamics datasets with single-GPU and distributed-memory implementations show that our method preserves cluster membership while improving compression ratio by up to 4× and maintains competitive end-to-end throughput compared to the same base compressors configured with sufficiently tight error bounds to preserve clustering.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 59 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

7 of 59 references.

References · 7

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2024A Survey on Error-Bounded Lossy Compression for Scientific Datasetscited by 11
  3. 2022Accelerating Parallel Write via Deeply Integrating Predictive Lossy Compression with HDF5cited by 3
  4. 2024LCP: Enhancing Scientific Data Management with Lossy Compression for Particlescited by 3
  5. 2024QPET: A Versatile and Portable Quantity-of-Interest-Preservation Framework for Error-Bounded Lossy Compressioncited by 2
  6. 2025A General Framework for Augmenting Lossy Compressors with Topological Guaranteescited by 1
  7. 2025Cosmological Hydrodynamics at Exascale: A Trillion-Particle Leap in Capabilitycited by 1

Built on by

Not cited yet.