Chain-of-Thought Enhanced Shallow Transformers for Wireless Symbol Detection
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Transformers have shown potential in solving wireless communication problems, particularly via in-context learning (ICL), where models adapt to new tasks through prompts without requiring model updates. However, prior ICL-based Transformer models rely on deep architectures with many layers to achieve satisfactory performance, resulting in substantial storage and computational costs. In this work, we propose CHain Of thOught Symbol dEtection (CHOOSE), a CoT-enhanced shallow Transformer framework for wireless symbol detection. By introducing autoregressive latent reasoning steps within the hidden space, CHOOSE significantly improves the reasoning capacity of shallow models (1-2 layers) without increasing model depth. This design enables lightweight Transformers to achieve detection performance comparable to much deeper models, making them well-suited for deployment on resource-constrained mobile devices. Experimental results demonstrate that our approach outperforms conventional shallow Transformers and achieves performance comparable to that of deep Transformers, while maintaining storage and computational efficiency. This represents a promising direction for implementing Transformer-based algorithms in wireless receivers with limited computational resources.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 13 of its 17 references that are in the map. First posted on arXiv 26 Jun 2025.
Builds on
13 of 17 references.
Closest ancestors · 6
Same direction, newest first
- 2025Transformers Learn to Implement Multi-step Gradient Descent with Chain of Thought28 Feb
- 2024Training Large Language Models to Reason in a Continuous Latent Space9 Dec
- 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Step23 May
- 2024Chain of Thought Empowers Transformers to Solve Inherently Serial Problems20 Feb
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Models28 Jan
Other references · 7
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 715
- 2023Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm Selectioncited by 298
- 2023In-Context Learning for MIMO Equalization Using Transformer-Based Sequence Modelscited by 11
- 2023Transformers are Provably Optimal In-context Estimators for Wireless Communicationscited by 8
- 2016Designing Security-Aware Incentives for Computation Offloading via Device-to-Device Communicationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026RF-GPT: Teaching AI to See the Wireless World
- 2026Fast Wireless Foundation Models with Early-Exits
- 2026WiMamba: Linear-Scale Wireless Foundation Model
- 2025ZK-SenseLM: Verifiable Large-Model Wireless Sensing with Selective Abstention and Zero-Knowledge Attestation
- 2025Shadow Wireless Intelligence: Large Language Model-Driven Reasoning in Covert Communications ↗
- 2025From Indirect Object Identification to Syllogisms: Exploring Binary Mechanisms in Transformer Circuits
- 2025WirelessMathBench: A Mathematical Modeling Benchmark for LLMs in Wireless Communications
- 2025RF-DETR: Neural Architecture Search for Real-Time Detection Transformers