mlsanityData to 14 Oct 2026

Wireless Foundation Models: State-of-the-Art and Open Challenges

arXiv 2609.04707 ↗First posted 4 Sep 2026eess.SP cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Wireless foundation models (WFMs) have emerged as a promising approach for learning reusable representations from large-scale wireless data and adapting them to downstream tasks. However, the rapidly growing literature remains fragmented across modalities, pretraining objectives, architectures, adaptation strategies, and evaluation protocols, making it difficult to assess progress toward broadly transferable models. This survey provides a systematic analysis of WFMs for physical-layer applications. We first introduce the main WFM design components, including pretraining, backbone architectures, and downstream adaptation. We then organize the literature into five physical-layer task families: signal recognition and demodulation, channel representation learning, RF sensing and localization, beam management, and spectrum sensing and monitoring, while separately examining multi-task PHY models. Across these categories, we analyze how existing models are pretrained, adapted, and evaluated, with particular attention to downstream task diversity and the distinction between in-distribution, partial-shift, and out-of-distribution transfer. Our analysis shows that current WFMs provide increasing evidence of reusable wireless representations, but this evidence varies considerably across task families and evaluation settings. Differences in datasets, modalities, architectures, pretraining objectives, adaptation protocols, and distribution shifts make it difficult to determine which design choices drive transfer and generalization. We conclude by identifying open directions for improving data availability, evaluation rigor, generalization, efficient adaptation, and real-world deployment, providing a unified framework for understanding the current WFM landscape and the requirements for developing more reusable foundation models for future physical-layer wireless systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 107 of its 143 references that are in the map. First posted on arXiv 4 Sep 2026.

Builds on

107 of 143 references.

References · 107

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  7. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  8. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  9. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  10. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  11. 2017Graph Attention Networkscited by 8,923
  12. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
38 more
  1. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  8. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  9. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  10. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  11. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  12. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
  13. 2024Chronos: Learning the Language of Time Seriescited by 759
  14. 2013Speech Recognition with Deep Recurrent Neural Networkscited by 669
  15. 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 569
  16. 2023A Cookbook of Self-Supervised Learningcited by 250
  17. 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 164
  18. 2022Sionna: An Open-Source Library for Next-Generation Physical Layer Researchcited by 145
  19. 2022Contrastive Masked Autoencoders are Stronger Vision Learnerscited by 133
  20. 2019DeepMIMO: A Generic Deep Learning Dataset for Millimeter Wave and Massive MIMO Applicationscited by 123
  21. 2023On the Road to 6G: Visions, Requirements, Key Technologies and Testbedscited by 77
  22. 2023To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Reviewcited by 72
  23. 2023A Tutorial on Environment-Aware Communications via Channel Knowledge Map for 6Gcited by 61
  24. 2022DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Datasetcited by 53
  25. 2024Large Wireless Model (LWM): A Foundation Model for Wireless Channelscited by 40
  26. 2025WirelessGPT: A Generative Pre-trained Multi-task Learning Framework for Wireless Communicationcited by 40
  27. 2022Overview of Deep Learning-based CSI Feedback in Massive MIMO Systemscited by 37
  28. 2022EfficientFi: Towards Large-Scale Lightweight WiFi Sensing via CSI Compressioncited by 35
  29. 2023Big AI Models for 6G Wireless Networks: Opportunities, Challenges, and Research Directionscited by 32
  30. 2019Deep Learning for Physical-Layer 5G Wireless Techniques: Opportunities, Challenges and Solutionscited by 29
  31. 2024WiFo: Wireless Foundation Model for Channel Predictioncited by 29
  32. 2024Large Multi-Modal Models (LMMs) as Universal Foundation Models for AI-Native Wireless Systemscited by 27
  33. 2019CSI-based Positioning in Massive MIMO systems using Convolutional Neural Networkscited by 22
  34. 2019ViWi: A Deep Learning Dataset Framework for Vision-Aided Wireless Communicationscited by 21
  35. 2023A Survey of Beam Management for mmWave and THz Communications Towards 6Gcited by 21
  36. 20215G MIMO Data for Machine Learning: Application to Beam-Selection using Deep Learningcited by 20
  37. 2023Generative AI for Physical Layer Communications: A Surveycited by 17
  38. 2025A Multi-Task Foundation Model for Wireless Channel Representation Using Contrastive and Masked Autoencoder Learningcited by 17

50 most cited of 107 All 107 (JSON)

Built on by

Not cited yet.