Multivariate Scientific Data Compression with Learned Cross-Variable Latent Decorrelation and Autoregressive Entropy Modeling
Not on the map. Why?
Abstract (arXiv)
Scientific simulations generate collections of physical fields with heterogeneous statistics and dependencies, yet learned compressors often encode those fields independently or rely on a shared encoder without explicitly modeling the structure that remains in latent space. We present CAESAR-LDAR, an error-controlled multivariate learned compressor that augments a shared CAESAR-V backbone with two complementary mechanisms: a trainable orthogonal transform that reorganizes dependence across aligned latent channels, and a causal autoregressive hierarchical prior that captures local spatial structure left after transformation. Orthogonality is maintained through a matrix-exponential parameterization, making the transform exactly invertible without an additional penalty. A common residual-correction stage is applied uniformly to all variants to enforce the requested reconstruction tolerance. Experiments across combustion, climate, and turbulence data show that the two mechanisms are useful in different regimes. Latent decorrelation helps most when substantial linear cross-channel dependence survives the nonlinear encoder, whereas autoregressive modeling remains effective when the remaining structure is primarily local or spatial. Their combination provides the strongest or near-strongest rate-distortion performance across the evaluated datasets. The global transform adds little computational overhead, while autoregressive coding introduces a larger throughput tradeoff. More broadly, the results suggest a practical design principle for multivariate scientific compression: exploit global cross-channel dependence when it is measurably present in latent space, and use local probabilistic context as a complementary mechanism across a wider range of data regimes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 26 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
10 of 26 references.
References · 10
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2018Context-adaptive Entropy Model for End-to-end Optimized Image Compressioncited by 138
- 2018TTHRESH: Tensor Compression for Multidimensional Visual Datacited by 41
- 2022Compressing multidimensional weather and climate data into neural networkscited by 31
- 2025StelLA: Subspace Learning in Low-rank Adaptation using Stiefel Manifoldcited by 13
- 2024A Survey on Error-Bounded Lossy Compression for Scientific Datasetscited by 11
- 2024MGARD: A multigrid framework for high-performance, error-controlled data compression and refactoringcited by 8
- 2015Parallel Tensor Compression for Large-Scale Scientific Datacited by 4
- 2025Generative Latent Diffusion for Efficient Spatiotemporal Data Reductioncited by 2
- 2026Residual Modeling for High-Fidelity Learned Compression of Scientific Datacited by 2
Built on by
Not cited yet.