Accelerating Regularized Attention Kernel Regression for Spectrum Cartography
Not on the map. Why?
Abstract (arXiv)
Spectrum cartography reconstructs spatial radio fields from sparse and heterogeneous wireless measurements, underpinning many sensing and optimization tasks in wireless networks. Attention mechanisms have recently enabled adaptive measurement aggregation via attention kernel-based formulations. However, the resulting exponential kernels exhibit severe spectral imbalance, inducing large condition numbers that render standard iterative solvers ineffective for regularized attention kernel regression. This paper proposes a Learning-based Attention Kernel Regression (LAKER) algorithm for accelerating regularized attention kernel regression in spectrum cartography. The key idea is to learn a data-dependent preconditioner that captures the inverse spectral structure of the attention kernel system, directly reducing the condition number bottleneck. The preconditioner is obtained by solving a regularized maximum-likelihood estimation problem via a shrinkage-regularized convex--concave procedure, and is integrated with a preconditioned conjugate gradient solver for efficient optimization, whose solution is used for radio map reconstruction. Extensive experiments demonstrate that LAKER significantly reduces condition numbers by up to three orders of magnitude, accelerates convergence by over twenty-fold compared to baselines, and maintains high reconstruction accuracy, establishing learning-based preconditioning as an effective approach for attention kernel regression in spectrum cartography.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 50 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
22 of 50 references.
References · 22
- 2017Attention Is All You Needcited by 60,361
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2016Optimization Methods for Large-Scale Machine Learningcited by 1,150
- 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 641
- 2020Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networkscited by 200
- 2019RadioUNet: Fast Radio Map Estimation with Convolutional Neural Networkscited by 127
- 2016Faster Kernel Ridge Regression Using Sketching and Preconditioningcited by 44
- 2022Radio Map Estimation: A Data-Driven Approach to Spectrum Cartographycited by 31
- 2016Disciplined Convex-Concave Programmingcited by 29
- 2023Solving Attention Kernel Regression Problem via Pre-conditionercited by 20
- 2021RadioNet: Transformer based Radio Map Prediction Model For Dense Urban Environmentscited by 15
- 2016Learning Power Spectrum Maps from Quantized Power Measurementscited by 14
10 more
- 2014Regularized Tyler's Scatter Estimator: Existence, Uniqueness, and Algorithmscited by 12
- 2022Spectrum Surveying: Active Radio Map Estimation with Autonomous UAVscited by 12
- 2024Radio Map Prediction from Aerial Images and Application to Coverage Optimizationcited by 10
- 2023Robust, randomized preconditioning for kernel ridge regressioncited by 9
- 2018Location-free Spectrum Cartographycited by 7
- 2024A Comprehensive Analysis on the Learning Curve in Kernel Ridge Regressioncited by 7
- 2019Fast and Accurate Gaussian Kernel Ridge Regression Using Matrix Decompositions for Preconditioningcited by 6
- 2024Spatial Transformers for Radio Map Estimationcited by 5
- 2025RMTransformer: Accurate Radio Map Construction and Coverage Predictioncited by 5
- 2026Radio Map Prediction from Noisy Environment Information and Sparse Observationscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.