SCA-LLM: Spectral-Attentive LLM-Based Wireless World Modeling for Agentic Communications
On the map: World models → World models for language agents
also in 1 more
Abstract (arXiv)
Future AI-native wireless networks are moving from reactive optimization to agentic decision-making that can sense, predict, and plan under fast-varying channels. This calls for wireless world models that can predict and roll out channel dynamics, for which multi-step channel state information (CSI) prediction offers a practical short-horizon look-ahead. Recent advances in foundation sequence models further motivate large language models (LLMs) as general-purpose dynamics learners when suitably adapted to non-text time-series signals. However, bridging CSI to LLMs is non-trivial because an effective adapter must expose informative spectral and temporal evolution patterns, while prior designs provide limited inductive bias to capture such channel structures. To this end, we propose SCA-LLM, a spectral-attentive LLM-based wireless world modeling framework that bridges CSI to LLMs via a spectral-channel attention (SCA) adapter. Specifically, the SCA adapter performs multi-spectral representation learning to extract informative channel features and align CSI with the LLM's sequence modeling capability, enabling parameter-efficient adaptation while keeping the LLM backbone largely frozen. Extensive simulations show that SCA-LLM achieves state-of-the-art prediction performance and strong zero-shot generalization, yielding up to -2.4 dB normalized mean squared error (NMSE) advantage over the previous LLM based method. Our ablation studies further confirm the effectiveness of the proposed SCA adapter in mitigating domain mismatch.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 18 of its 36 references that are in the map. First posted on arXiv 9 Sep 2025.
Builds on
18 of 36 references.
References · 18
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2024Qwen2 Technical Reportcited by 2,120
- 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
- 2020FcaNet: Frequency Channel Attention Networkscited by 179
- 2024Large Language Model (LLM) for Telecommunications: A Comprehensive Survey on Principles, Key Techniques, and Opportunitiescited by 83
- 2023On the Road to 6G: Visions, Requirements, Key Technologies and Testbedscited by 77
- 2024WirelessLLM: Empowering Large Language Models Towards Wireless Intelligencecited by 44
- 2024LLM4CP: Adapting Large Language Models for Channel Predictioncited by 42
- 2025WirelessGPT: A Generative Pre-trained Multi-task Learning Framework for Wireless Communicationcited by 40
6 more
- 2020Massive MIMO Channel Prediction: Kalman Filtering vs. Machine Learningcited by 21
- 2019Deep Transfer Learning Based Downlink Channel Prediction for FDD Massive MIMO Systemscited by 19
- 2025AI-RAN: Transforming RAN with AI-driven Computing Infrastructurecited by 14
- 2019Addressing the curse of mobility in massive MIMO with Prony-based angular-delay domain channel predictionscited by 10
- 2019JPEG Image Compression using the Discrete Cosine Transform: An Overview, Applications, and Hardware Implementationcited by 1
- 2021Towards Optimally Efficient Search with Deep Learning for Large-Scale MIMO Systemscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Large Language Models for Wireless Communications: From Adaptation to Autonomy
- 2024Csi-LLM: A Novel Downlink Channel Prediction Method Aligned with LLM Pre-Training
- 2026Large Language Model (LLM)-enabled Reinforcement Learning for Wireless Network Optimization
- 2026The AI Telco Engineer: Toward Autonomous Discovery of Wireless Communications Algorithms
- 2026Structured Latent Dynamics in Wireless CSI via Homomorphic World Models
- 2026CSI-Agent: LLM-Assisted Few-Shot Adaptation for Cross-Domain Wi-Fi CSI Sensing
- 2026MambaCSP: Hybrid-Attention State Space Models for Hardware-Efficient Channel State Prediction
- 2026ComAgent: Multi-LLM based Agentic AI Empowered Intelligent Wireless Networks