Cross-architecture universal feature coding via distribution alignment
Not on the map. Why?
Abstract (arXiv)
Feature coding has become increasingly important in scenarios where semantic representations rather than raw pixels are transmitted and stored. However, most existing methods are architecture-specific, targeting either CNNs or Transformers. This design limits their applicability in real-world scenarios where features from both architectures coexist. To address this gap, we introduce a new research problem: cross-architecture universal feature coding (CAUFC), which seeks to build a unified codec that can effectively compress features from heterogeneous architectures. To tackle this challenge, we propose a two-step distribution alignment method. First, we design the format alignment method that unifies CNN and Transformer features into a consistent 2D token format. Second, we propose the feature value alignment method that harmonizes statistical distributions via truncation and normalization. As a first attempt to study CAUFC, we evaluate our method on the image classification task. Experimental results demonstrate that our method achieves superior rate-accuracy trade-offs compared to the architecture-specific baseline. This work marks an initial step toward universal feature compression across heterogeneous model architectures.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 11 of its 26 references that are in the map. First posted on arXiv 15 Jun 2025.
Builds on
11 of 26 references.
References · 11
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2018Variational image compression with a scale hyperpriorcited by 935
- 2021Scalable Image Coding for Humans and Machinescited by 66
- 2018Deep feature compression for collaborative object detectioncited by 48
- 2019Multi-task learning with compressible features for Collaborative Intelligencecited by 20
- 2020Bit Allocation for Multi-Task Collaborative Intelligencecited by 13
- 2023End-to-End Learnable Multi-Scale Feature Compression for VCMcited by 13
- 2024Feature Coding in the Era of Large Models: Dataset, Test Conditions, and Benchmarkcited by 12
- 2024DMOFC: Discrimination Metric-Optimized Feature Compressioncited by 7
- 2024Toward Scalable Image Feature Compression: A Content-Adaptive and Diffusion-Based Approachcited by 6
- 2025Compressed Feature Quality Assessment: Dataset and Baselinescited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Towards Large Model Feature Codingcited by 1
- 2026Visual Token Codec: Unleashing Spatial Redundancy for ViT Feature Codingcited by 0
- 2026Visual Token Codec: Unleashing Spatial Redundancy for ViT Feature Coding9 Aug 2026
- 2026Towards Large Model Feature Coding20 May 2026