Quantitative Error Feedback for Quantization Noise Reduction of Filtering over Graphs
Not on the map. Why?
Abstract (arXiv)
This paper introduces an innovative error feedback framework designed to mitigate quantization noise in distributed graph filtering, where communications are constrained to quantized messages. It comes from error spectrum shaping techniques from state-space digital filters, and therefore establishes connections between quantized filtering processes over different domains. In contrast to existing error compensation methods, our framework quantitatively feeds back the quantization noise for exact compensation. We examine the framework under three key scenarios: (i) deterministic graph filtering, (ii) graph filtering over random graphs, and (iii) graph filtering with random node-asynchronous updates. Rigorous theoretical analysis demonstrates that the proposed framework significantly reduces the effect of quantization noise, and we provide closed-form solutions for the optimal error feedback coefficients. Moreover, this quantitative error feedback mechanism can be seamlessly integrated into communication-efficient decentralized optimization frameworks, enabling lower error floors. Numerical experiments validate the theoretical results, consistently showing that our method outperforms conventional quantization strategies in terms of both accuracy and robustness.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 71 references that are in the map. First posted on arXiv 2 Jun 2025.
Builds on
34 of 71 references.
References · 34
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
- 2017Graph Signal Processing: Overview, Challenges and Applicationscited by 413
- 2018Sparsified SGD with Memorycited by 376
- 2019Error Feedback Fixes SignSGD and other Gradient Compression Schemescited by 310
- 2020On Biased Compression for Distributed Learningcited by 140
- 2021EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedbackcited by 133
- 2018Connecting the Dots: Identifying Network Structure via Graph Signal Processingcited by 111
22 more
- 2021Graph Neural Networks in Network Neurosciencecited by 92
- 2024Classic GNNs are Strong Baselines: Reassessing GNNs for Node Classificationcited by 85
- 2020Graphs, Convolutions, and Neural Networks: From Graph Filters to Graph Neural Networkscited by 75
- 2022Graph Filters for Signal Processing and Machine Learning on Graphscited by 53
- 2025On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph Learningcited by 43
- 2016Autoregressive Moving Average Graph Filteringcited by 35
- 2023Momentum Provably Improves Error Feedback!cited by 31
- 2020Multitask learning over graphs: An Approach for Distributed, Streaming Machine Learningcited by 26
- 2021Finite-Bit Quantization For Distributed Algorithms With Linear Convergencecited by 15
- 2018Advances in Distributed Graph Filteringcited by 13
- 2020Localized Spectral Graph Filter Frames: A Unifying Framework, Survey of Design Considerations, and Numerical Comparison (Extended Cut)cited by 13
- 2016Compressive Spectral Clusteringcited by 12
- 2018Learning over Multitask Graphs -- Part I: Stability Analysiscited by 12
- 2022Networked Signal and Information Processingcited by 10
- 2017Filtering Random Graph Processes Over Random Time-Varying Graphscited by 8
- 2022Quantization for decentralized learning under subspace constraintscited by 7
- 2018Learning over Multitask Graphs -- Part II: Performance Analysiscited by 6
- 2024Log-Scale Quantization in Distributed First-Order Methods: Gradient-based Learning from Distributed Datacited by 4
- 2020Quantization Analysis and Robust Design for Distributed Graph Filterscited by 3
- 2024Differential error feedback for communication-efficient decentralized learningcited by 3
- 2024Logarithmically Quantized Distributed Optimization over Dynamic Multi-Agent Networkscited by 1
- 2024Error Feedback Approach for Quantization Noise Reduction of Distributed Graph Filterscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Low-Bit Quantization of Bandlimited Graph Signals via Iterative Methods
- 2021Task-Based Graph Signal Compression
- 2022Correlated quantization for distributed mean estimation and optimization
- 2024Rejection-Sampled Universal Quantization for Smaller Quantization Errors
- 2025Is Noise Conditioning Necessary? A Unified Theory of Unconditional Graph Diffusion Models
- 2026Nonlinear Bipolar Compensation: Handling Outliers in Post-Training Quantization
- 2024Correlated Quantization for Faster Nonconvex Distributed Optimization
- 2021Theoretically Better and Numerically Faster Distributed Optimization with Smoothness-Aware Quantization Techniques