mlsanityData to 7 Oct 2026

Hierarchical Wireless Foundation Model for Multi-Task Optimization

arXiv 2607.16877 ↗First posted 18 Jul 2026eess.SP cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

The increasing complexity of next-generation wireless networks has driven the integration of artificial intelligence (AI) into wireless communications. However, most existing studies focus on developing task-specific deep learning techniques for single scenarios, which limits their ability to generalize across diverse tasks, channel conditions, and system configurations. To address this generalization bottleneck, we propose a hierarchical wireless foundation model (WFM) for multi-task optimization. The proposed WFM couples an upstream foundation channel encoder (FCE) with a downstream foundation optimization decoder (FOD) via geometry-aware cross-attention. Specifically, the FCE extracts task-agnostic channel representations via self-supervised masked reconstruction while the FOD generates multi-task optimization decisions through differentiable output heads. Moreover, a hybrid supervised-to-unsupervised training strategy is employed to overcome the performance ceiling of purely supervised learning, and the modular architecture of the WFM enables efficient adaptation to unseen communication tasks with minimal parameter overhead. Simulation results show that the proposed WFM learns high-fidelity channel representations and achieves competitive multi-task optimization performance while substantially reducing optimization inference latency relative to numerical baselines. Furthermore, it exhibits robust generalization to unseen propagation environments, varying constraint parameters, and heterogeneous system configurations.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 18 Jul 2026.

Builds on

24 of 38 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  6. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  7. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  8. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  9. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  10. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
  11. 2019A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problemscited by 157
  12. 2019DeepMIMO: A Generic Deep Learning Dataset for Millimeter Wave and Massive MIMO Applicationscited by 121
12 more
  1. 2024LLM4CP: Adapting Large Language Models for Channel Predictioncited by 42
  2. 2024Large Wireless Model (LWM): A Foundation Model for Wireless Channelscited by 39
  3. 2025WirelessGPT: A Generative Pre-trained Multi-task Learning Framework for Wireless Communicationcited by 39
  4. 2024WiFo: Wireless Foundation Model for Channel Predictioncited by 26
  5. 2020Deep Learning for Wireless Communications: An Emerging Interdisciplinary Paradigmcited by 20
  6. 2024Beam Prediction based on Large Language Modelscited by 20
  7. 2024Large Language Model Enabled Multi-Task Physical Layer Networkcited by 13
  8. 2025Large Language Models for Wireless Communications: From Adaptation to Autonomycited by 11
  9. 2025A Wireless Foundation Model for Multi-Task Predictioncited by 10
  10. 2025Large AI Models for Wireless Physical Layercited by 6
  11. 2025WiFo-CF: Wireless Foundation Model for CSI Feedbackcited by 5
  12. 2024Fast Adaptation for Deep Learning-based Wireless Communicationscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.