A Wireless Foundation Model for Multi-Task Prediction
Not on the map. Why?
Abstract (arXiv)
With the growing complexity and dynamics of the mobile communication networks, accurately predicting key system parameters, such as channel state information (CSI), user location, and network traffic, has become essential for a wide range of physical (PHY)-layer and medium access control (MAC)-layer tasks. Although traditional deep learning (DL)-based methods have been widely applied to such prediction tasks, they often struggle to generalize across different scenarios and tasks. In response, we propose a unified foundation model for multi-task prediction in wireless networks that supports diverse prediction intervals. The proposed model enforces univariate decomposition to unify heterogeneous tasks, encodes granularity for interval awareness, and uses a causal Transformer backbone for accurate predictions. Additionally, we introduce a patch masking strategy during training to support arbitrary input lengths. After trained on large-scale datasets, the proposed foundation model demonstrates strong generalization to unseen scenarios and achieves zero-shot performance on new tasks that surpass traditional full-shot baselines.
Key facts. Cited by 11 papers in the map (data through 13 Oct 2026). Builds on 21 of its 35 references that are in the map. First posted on arXiv 8 Jul 2025.
Builds on
21 of 35 references.
References · 21
- 2017Attention Is All You Needcited by 60,106
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,979
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,999
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,157
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,016
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,413
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,193
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,130
- 2023A decoder-only foundation model for time-series forecastingcited by 674
- 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 416
- 2020Toward a 6G AI-Native Air Interfacecited by 55
9 more
- 2024LLM4CP: Adapting Large Language Models for Channel Predictioncited by 42
- 2024Beam Prediction based on Large Language Modelscited by 20
- 2021Cram'er-Rao Bound Optimization for Joint Radar-Communication Designcited by 13
- 2024Large Language Model Enabled Multi-Task Physical Layer Networkcited by 13
- 2020Radar-assisted Predictive Beamforming for Vehicular Links: Communication Served by Sensingcited by 11
- 2020Bayesian Predictive Beamforming for Vehicular Networks: A Low-overhead Joint Radar-Communication Approachcited by 11
- 2019Addressing the curse of mobility in massive MIMO with Prony-based angular-delay domain channel predictionscited by 10
- 2022Deep CLSTM for Predictive Beamforming in Integrated Sensing and Communication-enabled Vehicular Networkscited by 3
- 2019Performance Analysis of Channel Extrapolation in FDD Massive MIMO Systemscited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 9.
11 papers.
- 2025Large Language Models for Wireless Communications: From Adaptation to Autonomycited by 11
- 2025EMind: A Foundation Model for Multi-task Electromagnetic Signals Understandingcited by 3
- 2026Lightweight Adaptive Feature Composition for Heterogeneous Downstream Adaptation of Wireless Foundation Modelscited by 1
- 2026Hierarchical Wireless Foundation Model for Multi-Task Optimizationcited by 1
- 2026PilotWiMAE: Pilot-Native Representation Learning for Wireless Channelscited by 0
- 2026CFM-Bench: A Unified Multi-Domain, Multi-Task Benchmark for Channel Foundation Modelscited by 0
- 2026MultiPathFormer: Towards a Foundation Model for Multipath Wireless Propagationcited by 0
- 2026A Comprehensive Survey of Wireless Foundation Models for AI-Native 6G Networkscited by 0
- 2026Wireless Foundation Models: State-of-the-Art and Open Challengescited by 0
- 2026From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivitycited by 0
- 2026Foundation Model-Aided Multi-Agent Reinforcement Learning for Wireless Random Access Network Optimizationcited by 0
- 2026Foundation Model-Aided Multi-Agent Reinforcement Learning for Wireless Random Access Network Optimization6 Oct 2026
- 2026From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity9 Sep 2026
- 2026Wireless Foundation Models: State-of-the-Art and Open Challenges4 Sep 2026
- 2026A Comprehensive Survey of Wireless Foundation Models for AI-Native 6G Networks9 Aug 2026
- 2026MultiPathFormer: Towards a Foundation Model for Multipath Wireless Propagation5 Aug 2026
- 2026Hierarchical Wireless Foundation Model for Multi-Task Optimization18 Jul 2026
- 2026CFM-Bench: A Unified Multi-Domain, Multi-Task Benchmark for Channel Foundation Models16 Jul 2026
- 2026Lightweight Adaptive Feature Composition for Heterogeneous Downstream Adaptation of Wireless Foundation Models9 Jun 2026
- 2026PilotWiMAE: Pilot-Native Representation Learning for Wireless Channels19 May 2026
- 2025EMind: A Foundation Model for Multi-task Electromagnetic Signals Understanding26 Aug 2025
- 2025Large Language Models for Wireless Communications: From Adaptation to Autonomy29 Jul 2025