mlsanityData to 7 Oct 2026

Efficient Learned Data Compression via Dual-Stream Feature Decoupling

arXiv 2604.07239 ↗First posted 8 Apr 2026cs.CL cs.IT cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

While Learned Data Compression (LDC) has achieved superior compression ratios, balancing precise probability modeling with system efficiency remains challenging. Crucially, uniform single-stream architectures struggle to simultaneously capture micro-syntactic and macro-semantic features, necessitating deep serial stacking that exacerbates latency. Compounding this, heterogeneous systems are constrained by device speed mismatches, where throughput is capped by Amdahl's Law due to serial processing. To this end, we propose a Dual-Stream Multi-Scale Decoupler that disentangles local and global contexts to replace deep serial processing with shallow parallel streams, and incorporate a Hierarchical Gated Refiner for adaptive feature refinement and precise probability modeling. Furthermore, we design a Concurrent Stream-Parallel Pipeline, which overcomes systemic bottlenecks to achieve full-pipeline parallelism. Extensive experiments demonstrate that our method achieves state-of-the-art performance in both compression ratio and throughput, while maintaining the lowest latency and memory usage. The code is available at https://github.com/huidong-ma/FADE.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 47 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

12 of 47 references.

References · 12

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Layer Normalizationcited by 5,579
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  4. 2020GLU Variants Improve Transformercited by 1,724
  5. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  6. 2016Language Modeling with Gated Convolutional Networkscited by 688
  7. 2018DeepZip: Lossless Data Compression using Recurrent Neural Networkscited by 32
  8. 2022A Fast Transformer-based General-Purpose Lossless Compressorcited by 26
  9. 2020Sub-Linear Memory: How to Make Performers SLiMcited by 18
  10. 2021SDRBench: Scientific Data Reduction Benchmark for Lossy Compressorscited by 16
  11. 2025PMKLC: Parallel Multi-Knowledge Learning-based Lossless Compression for Large-Scale Genomics Databasecited by 2
  12. 2025EDPC: Accelerating Lossless Compression via Lightweight Probability Models and Decoupled Parallel Dataflowcited by 2

Built on by

Not cited yet.