mlsanityData to 7 Oct 2026

Leveraging Large Language Models for Wireless Symbol Detection via In-Context Learning

arXiv 2409.00124 ↗First posted 28 Aug 2024eess.SP cs.AI cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Deep neural networks (DNNs) have made significant strides in tackling challenging tasks in wireless systems, especially when an accurate wireless model is not available. However, when available data is limited, traditional DNNs often yield subpar results due to underfitting. At the same time, large language models (LLMs) exemplified by GPT-3, have remarkably showcased their capabilities across a broad range of natural language processing tasks. But whether and how LLMs can benefit challenging non-language tasks in wireless systems is unexplored. In this work, we propose to leverage the in-context learning ability (a.k.a. prompting) of LLMs to solve wireless tasks in the low data regime without any training or fine-tuning, unlike DNNs which require training. We further demonstrate that the performance of LLMs varies significantly when employed with different prompt templates. To solve this issue, we employ the latest LLM calibration methods. Our results reveal that using LLMs via ICL methods generally outperforms traditional DNNs on the symbol demodulation task and yields highly confident predictions when coupled with calibration techniques.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 22 of its 41 references that are in the map. First posted on arXiv 28 Aug 2024.

Builds on

22 of 41 references.

References · 22

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2017On Calibration of Modern Neural Networkscited by 4,860
  4. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  5. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  6. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
  7. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
  8. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
  9. 2020On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselinescited by 254
  10. 2022LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Taskscited by 146
  11. 2020Deep Learning for Wireless Communicationscited by 39
  12. 2018A Very Brief Introduction to Machine Learning With Applications to Communication Systemscited by 35
10 more
  1. 2019Learning to Demodulate from Few Pilots via Offline and Online Meta-Learningcited by 21
  2. 2020Massive MIMO Channel Prediction: Kalman Filtering vs. Machine Learningcited by 21
  3. 2020Deep Learning for Wireless Communications: An Emerging Interdisciplinary Paradigmcited by 20
  4. 2020From Learning to Meta-Learning: Reduced Training Overhead and Complexity for Communication Systemscited by 18
  5. 2024Enhancing In-context Learning via Linear Probe Calibrationcited by 16
  6. 2023In-Context Learning for MIMO Equalization Using Transformer-Based Sequence Modelscited by 11
  7. 2024Cell-Free Multi-User MIMO Equalization via In-Context Learningcited by 8
  8. 2020DeepWiPHY: Deep Learning-based Receiver Design and Dataset for IEEE 802.11ax Systemscited by 6
  9. 2022Calibrating AI Models for Few-Shot Demodulation via Conformal Predictioncited by 4
  10. 2021Bayesian Active Meta-Learning for Few Pilot Demodulation and Equalizationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 6; 2026: 1.

9 papers.