Digital Twin Based Beam Prediction: Can we Train in the Digital World and Deploy in Reality?
Not on the map. Why?
Abstract (arXiv)
Realizing the potential gains of large-scale MIMO systems requires the accurate estimation of their channels or the fine adjustment of their narrow beams. This, however, is typically associated with high channel acquisition/beam sweeping overhead that scales with the number of antennas. Machine and deep learning represent promising approaches to overcome these challenges thanks to their powerful ability to learn from prior observations and side information. Training machine and deep learning models, however, requires large-scale datasets that are expensive to collect in deployed systems. To address this challenge, we propose a novel direction that utilizes digital replicas of the physical world to reduce or even eliminate the MIMO channel acquisition overhead. In the proposed digital twin aided communication, 3D models that approximate the real-world communication environment are constructed and accurate ray-tracing is utilized to simulate the site-specific channels. These channels can then be used to aid various communication tasks. Further, we propose to use machine learning to approximate the digital replicas and reduce the ray tracing computational cost. To evaluate the proposed digital twin based approach, we conduct a case study focusing on the position-aided beam prediction task. The results show that a learning model trained solely with the data generated by the digital replica can achieve relatively good performance on the real-world data. Moreover, a small number of real-world data points can quickly achieve near-optimal performance, overcoming the modeling mismatches between the physical and digital worlds and significantly reducing the data acquisition overhead.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Jan 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 5; 2024: 2; 2025: 2; 2026: 3.
12 papers.
- 2023Real-Time Digital Twins: Vision and Research Directions for 6G and Beyondcited by 26
- 2023Calibrating Wireless Ray Tracing for Digital Twinning using Local Phase Error Estimatescited by 14
- 2023Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarioscited by 6
- 2023A Multi-Modal Simulation Framework to Enable Digital Twin-based V2X Communications in Dynamic Environmentscited by 5
- 2023Vehicle Cameras Guide mmWave Beams: Approach and Real-World V2V Demonstrationcited by 3
- 2024Automatic AI Model Selection for Wireless Systems: Online Learning via Digital Twinningcited by 3
- 2025Context-Aware Doubly-Robust Semi-Supervised Learningcited by 2
- 2025Digital Twin-Assisted Explainable AI for Robust Beam Prediction in mmWave MIMO Systemscited by 2
- 2024Vision-Assisted Digital Twin Creation for mmWave Beam Managementcited by 1
- 2026Optimizing Reinforcement Learning Training over Digital Twin Enabled Multi-fidelity Networkscited by 0
- 2026TWIST: Closed-Loop token Synchronization for Application-Aware Wireless Digital Twinscited by 0
- 2026AIMS: An Agentic AI Framework for Sim-to-Real Multi-Modal ISACcited by 0
- 2026AIMS: An Agentic AI Framework for Sim-to-Real Multi-Modal ISAC30 Sep 2026
- 2026TWIST: Closed-Loop token Synchronization for Application-Aware Wireless Digital Twins26 May 2026
- 2026Optimizing Reinforcement Learning Training over Digital Twin Enabled Multi-fidelity Networks9 Mar 2026
- 2025Digital Twin-Assisted Explainable AI for Robust Beam Prediction in mmWave MIMO Systems12 Jul 2025
- 2025Context-Aware Doubly-Robust Semi-Supervised Learning21 Feb 2025
- 2024Automatic AI Model Selection for Wireless Systems: Online Learning via Digital Twinning22 Jun 2024
- 2024Vision-Assisted Digital Twin Creation for mmWave Beam Management31 Jan 2024
- 2023Calibrating Wireless Ray Tracing for Digital Twinning using Local Phase Error Estimates19 Dec 2023
- 2023Vehicle Cameras Guide mmWave Beams: Approach and Real-World V2V Demonstration20 Aug 2023
- 2023Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarios14 Aug 2023
- 2023A Multi-Modal Simulation Framework to Enable Digital Twin-based V2X Communications in Dynamic Environments13 Mar 2023
- 2023Real-Time Digital Twins: Vision and Research Directions for 6G and Beyond26 Jan 2023