Lightweight Adaptive Feature Composition for Heterogeneous Downstream Adaptation of Wireless Foundation Models
Not on the map. Why?
Abstract (arXiv)
Mobile systems increasingly rely on heterogeneous learning-enabled wireless functions, for which separate taskspecific models incur redundant training and model-management overhead. Wireless foundation models (WFMs) enable these functions to share a pretrained backbone, but existing adaptation either updates the backbone per task or relies on an inflexible final-layer representation. We observe that intermediate WFM layers exhibit distinct depth-dependent correlation structures. Based on this observation, we propose a Routing Adapter for Feature Composition (RAFC), which summarizes selected hidden states into compact descriptors, generates task- and sampledependent routing weights, and combines the original fullresolution features without updating the pretrained backbone. Its gains arise from giving each task adaptive access to complementary representations across multiple depths rather than restricting it to the final layer. Experiments across four task categories and three WFM backbones show improvements in every evaluated backbone-task pair, with mean relative gains across the four task categories ranging from 2.9% to 35.9%, while RAFC adds only 0.003M-0.049M trainable parameters across the evaluated backbones. Experiments on a portable softwaredefined radio testbed further demonstrate improved end-to-end receiver robustness, particularly under partial-band co-channel interference. These results establish RAFC as a lightweight, model-agnostic, and interpretable adaptation interface for WFMs in mobile systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 42 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
29 of 42 references.
References · 29
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2018Deep contextualized word representationscited by 2,290
- 2020A Primer in BERTology: What we know about how BERT workscited by 815
- 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
- 2022Vision Transformer Adapter for Dense Predictionscited by 565
- 2022Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practicecited by 136
- 2024ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense Predictionscited by 66
- 2024Task-Customized Mixture of Adapters for General Image Fusioncited by 59
- 2023Large Language Models Empowered Autonomous Edge AI for Connected Intelligencecited by 56
- 2022MIMO Channel Estimation using Score-Based Generative Modelscited by 50
- 2024LLM4CP: Adapting Large Language Models for Channel Predictioncited by 42
17 more
- 2025WirelessGPT: A Generative Pre-trained Multi-task Learning Framework for Wireless Communicationcited by 40
- 2023Big AI Models for 6G Wireless Networks: Opportunities, Challenges, and Research Directionscited by 32
- 2023Mitigating Over-smoothing in Transformers via Regularized Nonlocal Functionalscited by 32
- 2024WiFo: Wireless Foundation Model for Channel Predictioncited by 29
- 2020Understanding and Improving Encoder Layer Fusion in Sequence-to-Sequence Learningcited by 26
- 2018Exploiting Deep Representations for Neural Machine Translationcited by 23
- 2025A Multi-Task Foundation Model for Wireless Channel Representation Using Contrastive and Masked Autoencoder Learningcited by 17
- 2025LLM4WM: Adapting LLM for Wireless Multi-Taskingcited by 15
- 2023Channelformer: Attention based Neural Solution for Wireless Channel Estimation and Effective Online Trainingcited by 14
- 2025A Wireless Foundation Model for Multi-Task Predictioncited by 12
- 2024CSI-BERT2: A BERT-inspired Framework for Efficient CSI Prediction and Classification in Wireless Communication and Sensingcited by 11
- 2025Large Language Models for Wireless Communications: From Adaptation to Autonomycited by 11
- 2022Depth-Wise Attention (DWAtt): A Layer Fusion Method for Data-Efficient Classificationcited by 10
- 2025Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Frameworkcited by 5
- 2026WiFo-MiSAC: A Wireless Foundation Model for Multimodal Sensing and Communication Integration via Synesthesia of Machines (SoM)cited by 4
- 2025Foundation Model Empowered Synesthesia of Machines (SoM): AI-native Intelligent Multi-Modal Sensing-Communication Integrationcited by 3
- 2022Model-Driven Deep Learning-Based MIMO-OFDM Detector: Design, Simulation, and Experimental Resultscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.