A Bayesian Framework for Digital Twin-Based Control, Monitoring, and Data Collection in Wireless Systems
Not on the map. Why?
Abstract (arXiv)
Commonly adopted in the manufacturing and aerospace sectors, digital twin (DT) platforms are increasingly seen as a promising paradigm to control, monitor, and analyze software-based, "open", communication systems. Notably, DT platforms provide a sandbox in which to test artificial intelligence (AI) solutions for communication systems, potentially reducing the need to collect data and test algorithms in the field, i.e., on the physical twin (PT). A key challenge in the deployment of DT systems is to ensure that virtual control optimization, monitoring, and analysis at the DT are safe and reliable, avoiding incorrect decisions caused by "model exploitation". To address this challenge, this paper presents a general Bayesian framework with the aim of quantifying and accounting for model uncertainty at the DT that is caused by limitations in the amount and quality of data available at the DT from the PT. In the proposed framework, the DT builds a Bayesian model of the communication system, which is leveraged to enable core DT functionalities such as control via multi-agent reinforcement learning (MARL), monitoring of the PT for anomaly detection, prediction, data-collection optimization, and counterfactual analysis. To exemplify the application of the proposed framework, we specifically investigate a case-study system encompassing multiple sensing devices that report to a common receiver. Experimental results validate the effectiveness of the proposed Bayesian framework as compared to standard frequentist model-based solutions.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 39 of its 74 references that are in the map. First posted on arXiv 2 Dec 2022.
Builds on
39 of 74 references.
References · 39
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
- 2017Counterfactual Multi-Agent Policy Gradientscited by 733
- 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
- 2013(More) Efficient Reinforcement Learning via Posterior Samplingcited by 233
- 2020Model-Based Deep Learningcited by 136
- 2018Model-Based Active Explorationcited by 105
- 2020Off-Policy Multi-Agent Decomposed Policy Gradientscited by 97
- 2018On Improving Deep Reinforcement Learning for POMDPscited by 49
- 2021Digital-Twin-Enabled 6G: Vision, Architectural Trends, and Future Directionscited by 38
27 more
- 2019Bayesian Variational Autoencoders for Unsupervised Out-of-Distribution Detectioncited by 35
- 2022A Comprehensive Review of Digital Twin -- Part 1: Modeling and Twinning Enabling Technologiescited by 28
- 2020Towards Joint Learning of Optimal MAC Signaling and Wireless Channel Accesscited by 18
- 2019Deep Learning for Hybrid 5G Services in Mobile Edge Computing Systems: Learn from a Digital Twincited by 17
- 2022A Comprehensive Review of Digital Twin -- Part 2: Roles of Uncertainty Quantification and Optimization, a Battery Digital Twin, and Perspectivescited by 17
- 2020Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networkscited by 15
- 2021The Emergence of Wireless MAC Protocols with Multi-Agent Reinforcement Learningcited by 14
- 2022Edge Continual Learning for Dynamic Digital Twins over Wireless Networkscited by 13
- 2022Network Digital Twin: Context, Enabling Technologies and Opportunitiescited by 12
- 2022Towards a Decentralized Metaverse: Synchronized Orchestration of Digital Twins and Sub-Metaversescited by 12
- 2021Centralized Model and Exploration Policy for Multi-Agent RLcited by 11
- 2022Digital Twin-Assisted Efficient Reinforcement Learning for Edge Task Schedulingcited by 11
- 2022Programmable and Customized Intelligence for Traffic Steering in 5G Networks Using Open RAN Architecturescited by 11
- 2022Digital Twin for Networking: A Data-driven Performance Modeling Perspectivecited by 10
- 2021The Paradigm of Digital Twin Communicationscited by 8
- 2022Learning Generalized Wireless MAC Communication Protocols via Abstractioncited by 6
- 2017Dirichlet Bayesian Network Scores and the Maximum Relative Entropy Principlecited by 4
- 2022The Interplay of AI and Digital Twin: Bridging the Gap between Data-Driven and Model-Driven Approachescited by 4
- 2022Digital Twin-Empowered Network Planning for Multi-Tier Computingcited by 4
- 2019Intelligent Reflecting Surface: A Programmable Wireless Environment for Physical Layer Securitycited by 3
- 2020Multi-Agent Deep Stochastic Policy Gradient for Event Based Dynamic Spectrum Accesscited by 3
- 2022Toward Experience-Driven Traffic Management and Orchestration in Digital-Twin-Enabled 6G Networkscited by 3
- 2022Digital Twin Virtualization with Machine Learning for IoT and Beyond 5G Networks: Research Directions for Security and Optimal Controlcited by 3
- 2020A Digital Twin for Reconfigurable Intelligent Surface Assisted Wireless Communicationcited by 2
- 2022Advanced Transient Diagnostic with Ensemble Digital Twin Modelingcited by 2
- 2022Digital Twin-Based Multiple Access Optimization and Monitoring via Model-Driven Bayesian Learningcited by 1
- 2022Digital Twins for Industry 4.0 in the 6G Eracited by 1
Built on by
Citing papers per year: 2023: 6; 2024: 3; 2025: 5; 2026: 4.
18 papers.
Sort:
By area:
- 2023Wireless Network Digital Twin for 6G: Generative AI as A Key Enablercited by 22
- 2023Causal Reasoning: Charting a Revolutionary Course for Next-Generation AI-Native Wireless Networkscited by 16
- 2023Causal Semantic Communication for Digital Twins: A Generalizable Imitation Learning Approachcited by 14
- 2023Calibrating Wireless Ray Tracing for Digital Twinning using Local Phase Error Estimatescited by 14
- 2023In-Context Learning for MIMO Equalization Using Transformer-Based Sequence Modelscited by 11
- 2025How to Bridge the Sim-to-Real Gap in Digital Twin-Aided Telecommunication Networkscited by 6
- 2024What If We Had Used a Different App? Reliable Counterfactual KPI Analysis in Wireless Systemscited by 5
- 2024Multi-Fidelity Bayesian Optimization With Across-Task Transferable Max-Value Entropy Searchcited by 3
- 2024Automatic AI Model Selection for Wireless Systems: Online Learning via Digital Twinningcited by 3
- 2025Optimizing Wireless Resource Management and Synchronization in Digital Twin Networkscited by 3
- 2023Data-driven Energy Efficiency Modelling in Large-scale Networks: An Expert Knowledge and ML-based Approachcited by 2
- 2025LLM-Based Agentic Negotiation for 6G: Addressing Uncertainty Neglect and Tail-Event Riskcited by 2
6 more
- 2026Confounding-Valid Conformal Inference for Counterfactual KPIs in Wireless Networkscited by 1
- 2025Energy-Efficient Federated Learning and Migration in Digital Twin Edge Networkscited by 0
- 2025Multi-Fidelity Hybrid Reinforcement Learning via Information Gain Maximizationcited by 0
- 2026Should I Have Expressed a Different Intent? Counterfactual Generation for LLM-Based Autonomous Controlcited by 0
- 2026Should I Use This Synthetic Dataset for Training? How to Test with Minimal Real Datacited by 0
- 2026Conformal Risk-Averse Decision Making with Optimized Certainty Equivalent Risk Controlcited by 0
- 2026Confounding-Valid Conformal Inference for Counterfactual KPIs in Wireless Networks4 Sep 2026
- 2026Conformal Risk-Averse Decision Making with Optimized Certainty Equivalent Risk Control28 Aug 2026
- 2026Should I Use This Synthetic Dataset for Training? How to Test with Minimal Real Data28 Aug 2026
- 2026Should I Have Expressed a Different Intent? Counterfactual Generation for LLM-Based Autonomous Control27 Jan 2026
- 2025LLM-Based Agentic Negotiation for 6G: Addressing Uncertainty Neglect and Tail-Event Risk24 Nov 2025
- 2025Multi-Fidelity Hybrid Reinforcement Learning via Information Gain Maximization18 Sep 2025
- 2025How to Bridge the Sim-to-Real Gap in Digital Twin-Aided Telecommunication Networks9 Jul 2025
- 2025Energy-Efficient Federated Learning and Migration in Digital Twin Edge Networks20 Mar 2025
- 2025Optimizing Wireless Resource Management and Synchronization in Digital Twin Networks7 Feb 2025
- 2024What If We Had Used a Different App? Reliable Counterfactual KPI Analysis in Wireless Systems30 Sep 2024
- 2024Automatic AI Model Selection for Wireless Systems: Online Learning via Digital Twinning22 Jun 2024
- 2024Multi-Fidelity Bayesian Optimization With Across-Task Transferable Max-Value Entropy Search14 Mar 2024
6 more
- 2023Data-driven Energy Efficiency Modelling in Large-scale Networks: An Expert Knowledge and ML-based Approach31 Dec 2023
- 2023Calibrating Wireless Ray Tracing for Digital Twinning using Local Phase Error Estimates19 Dec 2023
- 2023Wireless Network Digital Twin for 6G: Generative AI as A Key Enabler29 Nov 2023
- 2023In-Context Learning for MIMO Equalization Using Transformer-Based Sequence Models10 Nov 2023
- 2023Causal Reasoning: Charting a Revolutionary Course for Next-Generation AI-Native Wireless Networks23 Sep 2023
- 2023Causal Semantic Communication for Digital Twins: A Generalizable Imitation Learning Approach25 Apr 2023
- 2023Wireless Network Digital Twin for 6G: Generative AI as A Key Enablercited by 22
- 2023Calibrating Wireless Ray Tracing for Digital Twinning using Local Phase Error Estimatescited by 14
- 2023In-Context Learning for MIMO Equalization Using Transformer-Based Sequence Modelscited by 11
- 2025How to Bridge the Sim-to-Real Gap in Digital Twin-Aided Telecommunication Networkscited by 6
- 2024What If We Had Used a Different App? Reliable Counterfactual KPI Analysis in Wireless Systemscited by 5
- 2024Multi-Fidelity Bayesian Optimization With Across-Task Transferable Max-Value Entropy Searchcited by 3
- 2024Automatic AI Model Selection for Wireless Systems: Online Learning via Digital Twinningcited by 3
- 2025Optimizing Wireless Resource Management and Synchronization in Digital Twin Networkscited by 3
- 2023Data-driven Energy Efficiency Modelling in Large-scale Networks: An Expert Knowledge and ML-based Approachcited by 2
- 2026Confounding-Valid Conformal Inference for Counterfactual KPIs in Wireless Networkscited by 1
- 2025Energy-Efficient Federated Learning and Migration in Digital Twin Edge Networkscited by 0
- 2025Multi-Fidelity Hybrid Reinforcement Learning via Information Gain Maximizationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Confounding-Valid Conformal Inference for Counterfactual KPIs in Wireless Networks4 Sep 2026
- 2026Conformal Risk-Averse Decision Making with Optimized Certainty Equivalent Risk Control28 Aug 2026
- 2026Should I Have Expressed a Different Intent? Counterfactual Generation for LLM-Based Autonomous Control27 Jan 2026
- 2025Multi-Fidelity Hybrid Reinforcement Learning via Information Gain Maximization18 Sep 2025
- 2025How to Bridge the Sim-to-Real Gap in Digital Twin-Aided Telecommunication Networks9 Jul 2025
- 2025Energy-Efficient Federated Learning and Migration in Digital Twin Edge Networks20 Mar 2025
- 2025Optimizing Wireless Resource Management and Synchronization in Digital Twin Networks7 Feb 2025
- 2024What If We Had Used a Different App? Reliable Counterfactual KPI Analysis in Wireless Systems30 Sep 2024
- 2024Automatic AI Model Selection for Wireless Systems: Online Learning via Digital Twinning22 Jun 2024
- 2024Multi-Fidelity Bayesian Optimization With Across-Task Transferable Max-Value Entropy Search14 Mar 2024
- 2023Data-driven Energy Efficiency Modelling in Large-scale Networks: An Expert Knowledge and ML-based Approach31 Dec 2023
- 2023Calibrating Wireless Ray Tracing for Digital Twinning using Local Phase Error Estimates19 Dec 2023
12 newest of 14 All 14 (JSON)