mlsanityData to 13 Oct 2026

A Wireless Foundation Model for Multi-Task Prediction

arXiv 2507.05938 ↗First posted 8 Jul 2025cs.AI cs.IT cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

With the growing complexity and dynamics of the mobile communication networks, accurately predicting key system parameters, such as channel state information (CSI), user location, and network traffic, has become essential for a wide range of physical (PHY)-layer and medium access control (MAC)-layer tasks. Although traditional deep learning (DL)-based methods have been widely applied to such prediction tasks, they often struggle to generalize across different scenarios and tasks. In response, we propose a unified foundation model for multi-task prediction in wireless networks that supports diverse prediction intervals. The proposed model enforces univariate decomposition to unify heterogeneous tasks, encodes granularity for interval awareness, and uses a causal Transformer backbone for accurate predictions. Additionally, we introduce a patch masking strategy during training to support arbitrary input lengths. After trained on large-scale datasets, the proposed foundation model demonstrates strong generalization to unseen scenarios and achieves zero-shot performance on new tasks that surpass traditional full-shot baselines.

Key facts. Cited by 11 papers in the map (data through 13 Oct 2026). Builds on 21 of its 35 references that are in the map. First posted on arXiv 8 Jul 2025.

Builds on

21 of 35 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,106
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,979
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 3,999
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,157
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,016
  7. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,413
  8. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,193
  9. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,130
  10. 2023A decoder-only foundation model for time-series forecastingcited by 674
  11. 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 416
  12. 2020Toward a 6G AI-Native Air Interfacecited by 55
9 more
  1. 2024LLM4CP: Adapting Large Language Models for Channel Predictioncited by 42
  2. 2024Beam Prediction based on Large Language Modelscited by 20
  3. 2021Cram'er-Rao Bound Optimization for Joint Radar-Communication Designcited by 13
  4. 2024Large Language Model Enabled Multi-Task Physical Layer Networkcited by 13
  5. 2020Radar-assisted Predictive Beamforming for Vehicular Links: Communication Served by Sensingcited by 11
  6. 2020Bayesian Predictive Beamforming for Vehicular Networks: A Low-overhead Joint Radar-Communication Approachcited by 11
  7. 2019Addressing the curse of mobility in massive MIMO with Prony-based angular-delay domain channel predictionscited by 10
  8. 2022Deep CLSTM for Predictive Beamforming in Integrated Sensing and Communication-enabled Vehicular Networkscited by 3
  9. 2019Performance Analysis of Channel Extrapolation in FDD Massive MIMO Systemscited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 2; 2026: 9.

11 papers.