mlsanityData to 14 Oct 2026

Leveraging Kernel Symmetry for Joint Compression and Error Mitigation in Edge Model Transfer

arXiv 2604.17371 ↗First posted 19 Apr 2026eess.SP cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper investigates communication-efficient neural network transmission by exploiting structured symmetry constraints in convolutional kernels. Instead of transmitting all model parameters, we propose a degrees-of-freedom (DoF) based codec that sends only the unique coefficients implied by a chosen symmetry group, enabling deterministic reconstruction of the full weight tensor at the receiver. The proposed framework is evaluated under quantization and noisy channel conditions across multiple symmetry patterns, signal-to-noise ratios, and bit-widths. To improve robustness against transmission impairments, a projection step is further applied at the receiver to enforce consistency with the symmetry-invariant subspace, effectively denoising corrupted parameters. Experimental results on MNIST and CIFAR-10 using a DeepCNN architecture demonstrate that DoF-based transmission achieves substantial bandwidth reduction while preserving significantly higher accuracy than pruning-based baselines, which often suffer catastrophic degradation. Among the tested symmetries, textitcentral-skew symmetry consistently provides the best accuracy-compression tradeoff, confirming that structured redundancy can be leveraged for reliable and efficient neural model delivery over constrained links.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 13 references that are in the map. First posted on arXiv 19 Apr 2026.

Builds on

12 of 13 references.

References · 12

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  2. 2016Group Equivariant Convolutional Networkscited by 1,165
  3. 2017Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Trainingcited by 478
  4. 2019General E(2)-Equivariant Steerable CNNscited by 446
  5. 2016Steerable CNNscited by 305
  6. 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 295
  7. 2018Federated Learning via Over-the-Air Computationcited by 219
  8. 2022Approximately Equivariant Networks for Imperfectly Symmetric Dynamicscited by 97
  9. 2022FedAvg with Fine Tuning: Local Updates Lead to Representation Learningcited by 56
  10. 2015Structured Transforms for Small-Footprint Deep Learningcited by 42
  11. 2019SymNet: Symmetrical Filters in Convolutional Neural Networkscited by 3
  12. 2022Symmetry Structured Convolutional Neural Networkscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Getting Free Bits Back from Rotational Symmetries in LLMs
  2. 2026Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers
  3. 2025Constrained Edge AI Deployment: Fine-Tuning vs Distillation for LLM Compression
  4. 2024"Lossless" Compression of Deep Neural Networks: A High-dimensional Neural Tangent Kernel Approach
  5. 2026CHASE: Channel-Aligned Structure Exploitation for Geometry-Aware Model Engineering
  6. 2026CubicQuant: Parametric Non-Uniform Codebooks for High-Throughput LLM Inference with 1-8-Bit Weights
  7. 2025Range Asymmetric Numeral Systems-Based Lightweight Intermediate Feature Compression for Split Computing of Deep Neural Networks
  8. 2022Hardening DNNs against Transfer Attacks during Network Compression using Greedy Adversarial Pruning