Self-Evolving In-Context Learning for Direct Pilot-to-Beamformer Design in MU-MISO Systems
Not on the map. Why?
Abstract (arXiv)
We develop an enhanced in-context learning (ICL) framework to improve the performance of pilot-based beamforming in multi-user multiple-input single-output (MU-MISO) systems. The proposed scheme integrates the ICL-Transformer backbone with the pilot encoder-decoder network (EDN) and the beamformer EDN. A crucial feature of our ICL network is that it can handle multiple channel models without retraining, enabled by the construction of model-specific context datasets. To improve convergence and robustness, we introduce three key innovations: (a) a curriculum learning (CL) strategy that smoothly transitions from supervised LMMSE-labeled imitation to unsupervised sum-rate maximization, (b) a self-evolving mechanism that dynamically expands and refines the context datasets for all channel models during CL-based training, and (c) a mismatch-aware extension that incorporates several mismatches into the general ICL framework and bypasses explicit channel calibrations. Ablation studies validate the effectiveness of the in-context architecture and enhanced training strategies. Simulation results over diverse communication environments show that the proposed scheme is able to rapidly adapt to both seen and unseen channel models without gradient-based parameter updates, and can mitigate the mismatch issues via intelligent context constructions. Furthermore, our scheme consistently outperforms the existing beamforming schemes under pilot-based settings, including the WMMSE benchmark and the recent Transformer-based methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 45 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
28 of 45 references.
References · 28
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
- 2022Transformers learn in-context by gradient descentcited by 732
- 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 715
- 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 557
- 2021Curriculum Learning: A Surveycited by 259
- 2023The Learnability of In-Context Learningcited by 127
- 2022Self-Training: A Surveycited by 86
- 2020Deep Learning for Distributed Channel Feedback and Multiuser Precoding in FDD Massive MIMOcited by 26
- 2019Deep Learning for Direct Hybrid Precoding in Millimeter Wave Massive MIMO Systemscited by 10
- 2023Transformers are Provably Optimal In-context Estimators for Wireless Communicationscited by 8
- 2024Cell-Free Multi-User MIMO Equalization via In-Context Learningcited by 8
16 more
- 2019FDD Massive MIMO Uplink and Downlink Channel Reciprocity Properties: Full or Partial Reciprocity?cited by 7
- 2022A Bipartite Graph Neural Network Approach for Scalable Beamforming Optimizationcited by 7
- 2023GNN-Based Beamforming for Sum-Rate Maximization in MU-MISO Networkscited by 7
- 2019A Family of Deep Learning Architectures for Channel Estimation and Hybrid Beamforming in Multi-Carrier mm-Wave Massive MIMOcited by 6
- 2020Deep Learning for Channel Sensing and Hybrid Precoding in TDD Massive MIMO OFDM Systemscited by 5
- 2024End-to-End Deep Learning for TDD MIMO Systems in the 6G Upper Midbandscited by 5
- 2020Sparse Channel Estimation and Hybrid Precoding Using Deep Learning for Millimeter Wave Massive MIMOcited by 4
- 2025ICWLM: A Multi-Task Wireless Large Model via In-Context Learningcited by 4
- 2026WiFo-E: A Scalable Wireless Foundation Model for End-to-End FDD Precoding in Communication Networkscited by 3
- 2022Deep Learning for Multi-User MIMO Systems: Joint Design of Pilot, Limited Feedback, and Precodingcited by 2
- 2025Learning Precoding in Multi-user Multi-antenna Systems: Transformer or Graph Transformer?cited by 2
- 2025An Encoder-Decoder Network for Beamforming over Sparse Large-Scale MIMO Channelscited by 2
- 2025A Semi-amortized Lifted Learning-to-Optimize Masked (SALLO-M) Transformer Model for Scalable and Generalizable Beamformingcited by 2
- 2023Channel Estimation and Signal Detection for NLOS Ultraviolet Scattering Communication with Space Division Multiple Accesscited by 1
- 2025In-Context Learning for Gradient-Free Receiver Adaptation: Principles, Applications, and Theorycited by 1
- 2026Direct and Ambient Backscatter Communications with a Dual-Function Radar Transmittercited by 1
Built on by
Not cited yet.