mlsanityData to 14 Oct 2026

Bridging the Reality Gap in Digital Twins with Context-Aware, Physics-Guided Deep Learning

arXiv 2505.11847 ↗First posted 17 May 2025cs.LG cs.ROcited by 2

Not on the map. Why?

Abstract (arXiv)

Digital twins (DTs) enable powerful predictive analytics, but persistent discrepancies between simulations and real systems--known as the reality gap--undermine their reliability. Coined in robotics, the term now applies to DTs, where discrepancies stem from context mismatches, cross-domain interactions, and multi-scale dynamics. Among these, context mismatch is pressing and underexplored, as DT accuracy depends on capturing operational context, often only partially observable. However, DTs have a key advantage: simulators can systematically vary contextual factors and explore scenarios difficult or impossible to observe empirically, informing inference and model alignment. While sim-to-real transfer like domain adaptation shows promise in robotics, their application to DTs poses two key challenges. First, unlike one-time policy transfers, DTs require continuous calibration across an asset's lifecycle--demanding structured information flow, timely detection of out-of-sync states, and integration of historical and new data. Second, DTs often perform inverse modeling, inferring latent states or faults from observations that may reflect multiple evolving contexts. These needs strain purely data-driven models and risk violating physical consistency. Though some approaches preserve validity via reduced-order model, most domain adaptation techniques still lack such constraints. To address this, we propose a Reality Gap Analysis (RGA) module for DTs that continuously integrates new sensor data, detects misalignments, and recalibrates DTs via a query-response framework. Our approach fuses domain-adversarial deep learning with reduced-order simulator guidance to improve context inference and preserve physical consistency. We illustrate the RGA module in a structural health monitoring case study on a steel truss bridge in Pittsburgh, PA, showing faster calibration and better real-world alignment.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 13 of its 40 references that are in the map. First posted on arXiv 17 May 2025.

Builds on

13 of 40 references.

References · 13

  1. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  2. 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 672
  3. 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 600
  4. 2020Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Surveycited by 413
  5. 2016Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networkscited by 308
  6. 2017Learning Invariant Feature Spaces to Transfer Skills with Reinforcement Learningcited by 85
  7. 2019Digital Twin: Values, Challenges and Enablerscited by 81
  8. 2020A fast and accurate physics-informed neural network reduced order model with shallow masked autoencodercited by 80
  9. 2020Digital twin, physics-based model, and machine learning applied to damage detection in structurescited by 17
  10. 2022Towards Digital Twin Oriented Modelling of Complex Networked Systems and Their Dynamics: A Comprehensive Surveycited by 8
  11. 2023State-of-the-art review and synthesis: A requirement-based roadmap for standardized predictive maintenance automation using digital twin technologiescited by 4
  12. 2024State-of-the-Art Review: The Use of Digital Twins to Support Artificial Intelligence-Guided Predictive Maintenancecited by 2
1 more
  1. 2025Digital Twin Technologies in Predictive Maintenance: Enabling Transferability via Sim-to-Real and Real-to-Sim Transfercited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Can Context Bridge the Reality Gap? Sim-to-Real Transfer of Context-Aware Policies
  2. 2026Digital Twin AI: Opportunities and Challenges from Large Language Models to World Models
  3. 2024Constructing and Evaluating Digital Twins: An Intelligent Framework for DT Development
  4. 2025Position: Foundation Models Need Digital Twin Representations
  5. 2025When Digital Twins Meet Large Language Models: Realistic, Interactive, and Editable Simulation for Autonomous Driving
  6. 2024Mixed-Reality Digital Twins: Leveraging the Physical and Virtual Worlds for Hybrid Sim2Real Transition of Multi-Agent Reinforcement Learning Policies
  7. 2025Semantic Grounding of Digital Twin Metamodels Using RDF Graphs ↗
  8. 2026Digital Twin-Driven Real2Sim2Real: Simulator-Conditioned Generation via Paired Driving-Scene Reconstruction