mlsanityData to 7 Oct 2026

A Bayesian Framework for Digital Twin-Based Control, Monitoring, and Data Collection in Wireless Systems

arXiv 2212.01351 ↗First posted 2 Dec 2022eess.SP cs.LG cs.NIcited by 18

Not on the map. Why?

Abstract (arXiv)

Commonly adopted in the manufacturing and aerospace sectors, digital twin (DT) platforms are increasingly seen as a promising paradigm to control, monitor, and analyze software-based, "open", communication systems. Notably, DT platforms provide a sandbox in which to test artificial intelligence (AI) solutions for communication systems, potentially reducing the need to collect data and test algorithms in the field, i.e., on the physical twin (PT). A key challenge in the deployment of DT systems is to ensure that virtual control optimization, monitoring, and analysis at the DT are safe and reliable, avoiding incorrect decisions caused by "model exploitation". To address this challenge, this paper presents a general Bayesian framework with the aim of quantifying and accounting for model uncertainty at the DT that is caused by limitations in the amount and quality of data available at the DT from the PT. In the proposed framework, the DT builds a Bayesian model of the communication system, which is leveraged to enable core DT functionalities such as control via multi-agent reinforcement learning (MARL), monitoring of the PT for anomaly detection, prediction, data-collection optimization, and counterfactual analysis. To exemplify the application of the proposed framework, we specifically investigate a case-study system encompassing multiple sensing devices that report to a common receiver. Experimental results validate the effectiveness of the proposed Bayesian framework as compared to standard frequentist model-based solutions.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 39 of its 74 references that are in the map. First posted on arXiv 2 Dec 2022.

Builds on

39 of 74 references.

References · 39

  1. 2017On Calibration of Modern Neural Networkscited by 4,860
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  3. 2013Auto-Encoding Variational Bayescited by 3,980
  4. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
  5. 2017Counterfactual Multi-Agent Policy Gradientscited by 733
  6. 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
  7. 2013(More) Efficient Reinforcement Learning via Posterior Samplingcited by 233
  8. 2020Model-Based Deep Learningcited by 136
  9. 2018Model-Based Active Explorationcited by 105
  10. 2020Off-Policy Multi-Agent Decomposed Policy Gradientscited by 97
  11. 2018On Improving Deep Reinforcement Learning for POMDPscited by 49
  12. 2021Digital-Twin-Enabled 6G: Vision, Architectural Trends, and Future Directionscited by 38
27 more
  1. 2019Bayesian Variational Autoencoders for Unsupervised Out-of-Distribution Detectioncited by 35
  2. 2022A Comprehensive Review of Digital Twin -- Part 1: Modeling and Twinning Enabling Technologiescited by 28
  3. 2020Towards Joint Learning of Optimal MAC Signaling and Wireless Channel Accesscited by 18
  4. 2019Deep Learning for Hybrid 5G Services in Mobile Edge Computing Systems: Learn from a Digital Twincited by 17
  5. 2022A Comprehensive Review of Digital Twin -- Part 2: Roles of Uncertainty Quantification and Optimization, a Battery Digital Twin, and Perspectivescited by 17
  6. 2020Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networkscited by 15
  7. 2021The Emergence of Wireless MAC Protocols with Multi-Agent Reinforcement Learningcited by 14
  8. 2022Edge Continual Learning for Dynamic Digital Twins over Wireless Networkscited by 13
  9. 2022Network Digital Twin: Context, Enabling Technologies and Opportunitiescited by 12
  10. 2022Towards a Decentralized Metaverse: Synchronized Orchestration of Digital Twins and Sub-Metaversescited by 12
  11. 2021Centralized Model and Exploration Policy for Multi-Agent RLcited by 11
  12. 2022Digital Twin-Assisted Efficient Reinforcement Learning for Edge Task Schedulingcited by 11
  13. 2022Programmable and Customized Intelligence for Traffic Steering in 5G Networks Using Open RAN Architecturescited by 11
  14. 2022Digital Twin for Networking: A Data-driven Performance Modeling Perspectivecited by 10
  15. 2021The Paradigm of Digital Twin Communicationscited by 8
  16. 2022Learning Generalized Wireless MAC Communication Protocols via Abstractioncited by 6
  17. 2017Dirichlet Bayesian Network Scores and the Maximum Relative Entropy Principlecited by 4
  18. 2022The Interplay of AI and Digital Twin: Bridging the Gap between Data-Driven and Model-Driven Approachescited by 4
  19. 2022Digital Twin-Empowered Network Planning for Multi-Tier Computingcited by 4
  20. 2019Intelligent Reflecting Surface: A Programmable Wireless Environment for Physical Layer Securitycited by 3
  21. 2020Multi-Agent Deep Stochastic Policy Gradient for Event Based Dynamic Spectrum Accesscited by 3
  22. 2022Toward Experience-Driven Traffic Management and Orchestration in Digital-Twin-Enabled 6G Networkscited by 3
  23. 2022Digital Twin Virtualization with Machine Learning for IoT and Beyond 5G Networks: Research Directions for Security and Optimal Controlcited by 3
  24. 2020A Digital Twin for Reconfigurable Intelligent Surface Assisted Wireless Communicationcited by 2
  25. 2022Advanced Transient Diagnostic with Ensemble Digital Twin Modelingcited by 2
  26. 2022Digital Twin-Based Multiple Access Optimization and Monitoring via Model-Driven Bayesian Learningcited by 1
  27. 2022Digital Twins for Industry 4.0 in the 6G Eracited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 6; 2024: 3; 2025: 5; 2026: 4.

18 papers.

Sort:

By area:

  1. 2023Wireless Network Digital Twin for 6G: Generative AI as A Key Enablercited by 22
  2. 2023Causal Reasoning: Charting a Revolutionary Course for Next-Generation AI-Native Wireless Networkscited by 16
  3. 2023Causal Semantic Communication for Digital Twins: A Generalizable Imitation Learning Approachcited by 14
  4. 2023Calibrating Wireless Ray Tracing for Digital Twinning using Local Phase Error Estimatescited by 14
  5. 2023In-Context Learning for MIMO Equalization Using Transformer-Based Sequence Modelscited by 11
  6. 2025How to Bridge the Sim-to-Real Gap in Digital Twin-Aided Telecommunication Networkscited by 6
  7. 2024What If We Had Used a Different App? Reliable Counterfactual KPI Analysis in Wireless Systemscited by 5
  8. 2024Multi-Fidelity Bayesian Optimization With Across-Task Transferable Max-Value Entropy Searchcited by 3
  9. 2024Automatic AI Model Selection for Wireless Systems: Online Learning via Digital Twinningcited by 3
  10. 2025Optimizing Wireless Resource Management and Synchronization in Digital Twin Networkscited by 3
  11. 2023Data-driven Energy Efficiency Modelling in Large-scale Networks: An Expert Knowledge and ML-based Approachcited by 2
  12. 2025LLM-Based Agentic Negotiation for 6G: Addressing Uncertainty Neglect and Tail-Event Riskcited by 2
6 more
  1. 2026Confounding-Valid Conformal Inference for Counterfactual KPIs in Wireless Networkscited by 1
  2. 2025Energy-Efficient Federated Learning and Migration in Digital Twin Edge Networkscited by 0
  3. 2025Multi-Fidelity Hybrid Reinforcement Learning via Information Gain Maximizationcited by 0
  4. 2026Should I Have Expressed a Different Intent? Counterfactual Generation for LLM-Based Autonomous Controlcited by 0
  5. 2026Should I Use This Synthetic Dataset for Training? How to Test with Minimal Real Datacited by 0
  6. 2026Conformal Risk-Averse Decision Making with Optimized Certainty Equivalent Risk Controlcited by 0