Efficient Data Compression for 3D Sparse TPC via Bicephalous Convolutional Autoencoder
Not on the map. Why?
Abstract (arXiv)
Real-time data collection and analysis in large experimental facilities present a great challenge across multiple domains, including high energy physics, nuclear physics, and cosmology. To address this, machine learning (ML)-based methods for real-time data compression have drawn significant attention. However, unlike natural image data, such as CIFAR and ImageNet that are relatively small-sized and continuous, scientific data often come in as three-dimensional data volumes at high rates with high sparsity (many zeros) and non-Gaussian value distribution. This makes direct application of popular ML compression methods, as well as conventional data compression methods, suboptimal. To address these obstacles, this work introduces a dual-head autoencoder to resolve sparsity and regression simultaneously, called textitBicephalous Convolutional AutoEncoder (BCAE). This method shows advantages both in compression fidelity and ratio compared to traditional data compression methods, such as MGARD, SZ, and ZFP. To achieve similar fidelity, the best performer among the traditional methods can reach only half the compression ratio of BCAE. Moreover, a thorough ablation study of the BCAE method shows that a dedicated segmentation decoder improves the reconstruction.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 10 of its 34 references that are in the map. First posted on arXiv 9 Nov 2021.
Builds on
10 of 34 references.
References · 10
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
- 2019LHC analysis-specific datasets with Generative Adversarial Networkscited by 26
- 2020Simulation of electron-proton scattering events by a Feature-Augmented and Transformed Generative Adversarial Network (FAT-GAN)cited by 20
- 2021Empirical comparison between autoencoders and traditional dimensionality reduction methodscited by 13
- 2020Accelerating Multigrid-based Hierarchical Scientific Data Refactoring on GPUscited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 2.
6 papers.
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Reviewcited by 18
- 2023Artificial Intelligence for the Electron Ion Collider (AI4EIC)cited by 3
- 2023Fast 2D Bicephalous Convolutional Autoencoder for Compressing 3D Time Projection Chamber Datacited by 3
- 2022Data-driven detector signal characterization with constrained bottleneck autoencoderscited by 0
- 2024Variable Rate Neural Compression for Sparse Detector Datacited by 0
- 2024Efficient Compression of Sparse Accelerator Data Using Implicit Neural Representations and Importance Samplingcited by 0
- 2024Efficient Compression of Sparse Accelerator Data Using Implicit Neural Representations and Importance Sampling2 Dec 2024
- 2024Variable Rate Neural Compression for Sparse Detector Data18 Nov 2024
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Review15 Dec 2023
- 2023Fast 2D Bicephalous Convolutional Autoencoder for Compressing 3D Time Projection Chamber Data23 Oct 2023
- 2023Artificial Intelligence for the Electron Ion Collider (AI4EIC)17 Jul 2023
- 2022Data-driven detector signal characterization with constrained bottleneck autoencoders9 Mar 2022