# Real-Time Digital Twins: Vision and Research Directions for 6G and Beyond

arXiv: https://arxiv.org/abs/2301.11283 · HTML: https://mlsanity.com/paper/2301.11283/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- Builds on 5 of its 16 references that are in the map.
- First posted on arXiv 26 Jan 2023.

## Builds on (most cited first, 5 of 5)

- [DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Dataset](https://mlsanity.com/paper/2211.09769/) (2022)
- [Digital-Twin-Enabled 6G: Vision, Architectural Trends, and Future Directions](https://mlsanity.com/paper/2102.12169/) (2021)
- [Digital Twin Based Beam Prediction: Can we Train in the Digital World and Deploy in Reality?](https://mlsanity.com/paper/2301.07682/) (2023)
- [Integrated Sensing and Communication for 6G: Ten Key Machine Learning Roles](https://mlsanity.com/paper/2208.02157/) (2022)
- [Sensing Aided OTFS Channel Estimation for Massive MIMO Systems](https://mlsanity.com/paper/2209.11321/) (2022)

## Built on by (most cited first, 26 of 26)

- [Sionna RT: Differentiable Ray Tracing for Radio Propagation Modeling](https://mlsanity.com/paper/2303.11103/) (2023)
- [Learning Radio Environments by Differentiable Ray Tracing](https://mlsanity.com/paper/2311.18558/) (2023)
- [A Scalable and Generalizable Pathloss Map Prediction](https://mlsanity.com/paper/2312.03950/) (2023)
- [Calibrating Wireless Ray Tracing for Digital Twinning using Local Phase Error Estimates](https://mlsanity.com/paper/2312.12625/) (2023)
- [A Survey on Integrated Sensing, Communication, and Computation](https://mlsanity.com/paper/2408.08074/) (2024)
- [Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarios](https://mlsanity.com/paper/2308.06868/) (2023)
- [ENWAR: A RAG-empowered Multi-Modal LLM Framework for Wireless Environment Perception](https://mlsanity.com/paper/2410.18104/) (2024)
- [A Multi-Modal Simulation Framework to Enable Digital Twin-based V2X Communications in Dynamic Environments](https://mlsanity.com/paper/2303.06947/) (2023)
- [RMTransformer: Accurate Radio Map Construction and Coverage Prediction](https://mlsanity.com/paper/2501.05190/) (2025)
- [DeepSense-V2V: A Vehicle-to-Vehicle Multi-Modal Sensing, Localization, and Communications Dataset](https://mlsanity.com/paper/2406.17908/) (2024)
- [Vehicle Cameras Guide mmWave Beams: Approach and Real-World V2V Demonstration](https://mlsanity.com/paper/2308.10362/) (2023)
- [Differentiable High-Performance Ray Tracing-Based Simulation of Radio Propagation with Point Clouds](https://mlsanity.com/paper/2507.04021/) (2025)
- [Spatio-Temporal 3D Point Clouds from WiFi-CSI Data via Transformer Networks](https://mlsanity.com/paper/2410.16303/) (2024)
- [Digital Twin-Assisted Explainable AI for Robust Beam Prediction in mmWave MIMO Systems](https://mlsanity.com/paper/2507.14180/) (2025)
- [A Low-Overhead Incorporation-Extrapolation based Few-Shot CSI Feedback Framework for Massive MIMO Systems](https://mlsanity.com/paper/2312.04062/) (2023)
- [AIRMap: AI-Generated Radio Maps for Wireless Digital Twins](https://mlsanity.com/paper/2511.05522/) (2025)
- [Stackelberg Game Based Performance Optimization in Digital Twin Assisted Federated Learning over NOMA Networks](https://mlsanity.com/paper/2501.01584/) (2025)
- [Digital Twin Enabled Site Specific Channel Precoding: Over the Air CIR Inference](https://mlsanity.com/paper/2501.16504/) (2025)
- [Efficient Beam Selection for ISAC in Cell-Free Massive MIMO via Digital Twin-Assisted Deep Reinforcement Learning](https://mlsanity.com/paper/2506.18560/) (2025)
- [Photon Splatting: A Physics-Guided Neural Surrogate for Real-Time Wireless Channel Prediction](https://mlsanity.com/paper/2507.04595/) (2025)
- [MapViT: A Two-Stage ViT-Based Framework for Real-Time Radio Quality Map Prediction in Dynamic Environments](https://mlsanity.com/paper/2601.15578/) (2026)
- [A Survey on Semantic Communication for Vision: Categories, Frameworks, Enabling Techniques, and Applications](https://mlsanity.com/paper/2601.22202/) (2026)
- [Optimizing Reinforcement Learning Training over Digital Twin Enabled Multi-fidelity Networks](https://mlsanity.com/paper/2603.08931/) (2026)
- [TWIST: Closed-Loop token Synchronization for Application-Aware Wireless Digital Twins](https://mlsanity.com/paper/2605.27205/) (2026)
- [KODAMA: Multimodal Digital Twin Reconstruction for Urban RF Propagation Modelling](https://mlsanity.com/paper/2609.07298/) (2026)
- [Geometry-Aided Channel Deduction with Partial Channel Estimates and Uncalibrated Digital Twin](https://mlsanity.com/paper/2609.37277/) (2026)

## Abstract (arXiv)

This article presents a vision where textitreal-time digital twins of the physical wireless environments are continuously updated using multi-modal sensing data from the distributed infrastructure and user devices, and are used to make communication and sensing decisions. This vision is mainly enabled by the advances in precise 3D maps, multi-modal sensing, ray-tracing computations, and machine/deep learning. This article details this vision, explains the different approaches for constructing and utilizing these real-time digital twins, discusses the applications and open problems, and presents a research platform that can be used to investigate various digital twin research directions.