Wireless Foundation Models: State-of-the-Art and Open Challenges
Not on the map. Why?
Abstract (arXiv)
Wireless foundation models (WFMs) have emerged as a promising approach for learning reusable representations from large-scale wireless data and adapting them to downstream tasks. However, the rapidly growing literature remains fragmented across modalities, pretraining objectives, architectures, adaptation strategies, and evaluation protocols, making it difficult to assess progress toward broadly transferable models. This survey provides a systematic analysis of WFMs for physical-layer applications. We first introduce the main WFM design components, including pretraining, backbone architectures, and downstream adaptation. We then organize the literature into five physical-layer task families: signal recognition and demodulation, channel representation learning, RF sensing and localization, beam management, and spectrum sensing and monitoring, while separately examining multi-task PHY models. Across these categories, we analyze how existing models are pretrained, adapted, and evaluated, with particular attention to downstream task diversity and the distinction between in-distribution, partial-shift, and out-of-distribution transfer. Our analysis shows that current WFMs provide increasing evidence of reusable wireless representations, but this evidence varies considerably across task families and evaluation settings. Differences in datasets, modalities, architectures, pretraining objectives, adaptation protocols, and distribution shifts make it difficult to determine which design choices drive transfer and generalization. We conclude by identifying open directions for improving data availability, evaluation rigor, generalization, efficient adaptation, and real-world deployment, providing a unified framework for understanding the current WFM landscape and the requirements for developing more reusable foundation models for future physical-layer wireless systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 107 of its 143 references that are in the map. First posted on arXiv 4 Sep 2026.
Builds on
107 of 143 references.
References · 107
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017Graph Attention Networkscited by 8,923
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
38 more
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
- 2024Chronos: Learning the Language of Time Seriescited by 759
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 669
- 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 569
- 2023A Cookbook of Self-Supervised Learningcited by 250
- 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 164
- 2022Sionna: An Open-Source Library for Next-Generation Physical Layer Researchcited by 145
- 2022Contrastive Masked Autoencoders are Stronger Vision Learnerscited by 133
- 2019DeepMIMO: A Generic Deep Learning Dataset for Millimeter Wave and Massive MIMO Applicationscited by 123
- 2023On the Road to 6G: Visions, Requirements, Key Technologies and Testbedscited by 77
- 2023To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Reviewcited by 72
- 2023A Tutorial on Environment-Aware Communications via Channel Knowledge Map for 6Gcited by 61
- 2022DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Datasetcited by 53
- 2024Large Wireless Model (LWM): A Foundation Model for Wireless Channelscited by 40
- 2025WirelessGPT: A Generative Pre-trained Multi-task Learning Framework for Wireless Communicationcited by 40
- 2022Overview of Deep Learning-based CSI Feedback in Massive MIMO Systemscited by 37
- 2022EfficientFi: Towards Large-Scale Lightweight WiFi Sensing via CSI Compressioncited by 35
- 2023Big AI Models for 6G Wireless Networks: Opportunities, Challenges, and Research Directionscited by 32
- 2019Deep Learning for Physical-Layer 5G Wireless Techniques: Opportunities, Challenges and Solutionscited by 29
- 2024WiFo: Wireless Foundation Model for Channel Predictioncited by 29
- 2024Large Multi-Modal Models (LMMs) as Universal Foundation Models for AI-Native Wireless Systemscited by 27
- 2019CSI-based Positioning in Massive MIMO systems using Convolutional Neural Networkscited by 22
- 2019ViWi: A Deep Learning Dataset Framework for Vision-Aided Wireless Communicationscited by 21
- 2023A Survey of Beam Management for mmWave and THz Communications Towards 6Gcited by 21
- 20215G MIMO Data for Machine Learning: Application to Beam-Selection using Deep Learningcited by 20
- 2023Generative AI for Physical Layer Communications: A Surveycited by 17
- 2025A Multi-Task Foundation Model for Wireless Channel Representation Using Contrastive and Masked Autoencoder Learningcited by 17
50 most cited of 107 All 107 (JSON)
Built on by
Not cited yet.