Digital Twin AI: Opportunities and Challenges from Large Language Models to World Models
On the map: World models → World models for language agents
Abstract (arXiv)
Digital twins, as precise digital representations of physical systems, have evolved from passive simulation tools into intelligent and autonomous entities through the integration of artificial intelligence technologies. This paper presents a unified four-stage framework that systematically characterizes AI integration across the digital twin lifecycle, spanning modeling, mirroring, intervention, and autonomous management. By synthesizing existing technologies and practices, we distill a unified four-stage framework that systematically characterizes how AI methodologies are embedded across the digital twin lifecycle: (1) modeling the physical twin through physics-based and physics-informed AI approaches, (2) mirroring the physical system into a digital twin with real-time synchronization, (3) intervening in the physical twin through predictive modeling, anomaly detection, and optimization strategies, and (4) achieving autonomous management through large language models, foundation models, and intelligent agents. We analyze the synergy between physics-based modeling and data-driven learning, highlighting the shift from traditional numerical solvers to physics-informed and foundation models for physical systems. Furthermore, we examine how generative AI technologies, including large language models and generative world models, transform digital twins into proactive and self-improving cognitive systems capable of reasoning, communication, and creative scenario generation. Through a cross-domain review spanning eleven application domains, including healthcare, aerospace, smart manufacturing, robotics, and smart cities, we identify common challenges related to scalability, explainability, and trustworthiness, and outline directions for responsible AI-driven digital twin systems.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 43 of its 989 references that are in the map. First posted on arXiv 4 Jan 2026.
Builds on
43 of 989 references.
Closest ancestors · 1
Same direction, newest first
Other references · 42
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2016Concrete Problems in AI Safetycited by 1,642
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
30 more
- 2016Tutorial on Variational Autoencoderscited by 409
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
- 2021Unified Pre-training for Program Understanding and Generationcited by 366
- 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 344
- 2021Modern Koopman Theory for Dynamical Systemscited by 276
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
- 2022CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformerscited by 227
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
- 2020Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systemscited by 164
- 2019Variational Physics-Informed Neural Networks For Solving Partial Differential Equationscited by 148
- 2024Simulating Classroom Education with LLM-Empowered Agentscited by 127
- 2015Learning to Diagnose with LSTM Recurrent Neural Networkscited by 99
- 2024MathVC: An LLM-Simulated Multi-Character Virtual Classroom for Mathematics Educationcited by 37
- 2024Simulating Financial Market via Large Language Model based Agentscited by 25
- 2023OceanNet: A principled neural operator-based digital twin for regional oceanscited by 24
- 2024Multi-Agent Dynamic Relational Reasoning for Social Robot Navigationcited by 20
- 2024LLM experiments with simulation: Large Language Model Multi-Agent System for Simulation Model Parametrization in Digital Twinscited by 16
- 2024An LLM-Based Digital Twin for Optimizing Human-in-the Loop Systemscited by 13
- 2025CoCMT: Communication-Efficient Cross-Modal Transformer for Collaborative Perceptioncited by 13
- 2025AirV2X: Unified Air-Ground Vehicle-to-Everything Collaborationcited by 11
- 2024ClimateIQA: A New Dataset and Benchmark to Advance Vision-Language Models in Meteorology Anomalies Analysiscited by 10
- 2024CoMamba: Real-time Cooperative Perception Unlocked with State Space Modelscited by 9
- 2025Preference VLM: Leveraging VLMs for Scalable Preference-Based Reinforcement Learningcited by 7
- 2021Developing Robust Digital Twins and Reinforcement Learning for Accelerator Control Systems at the Fermilab Boostercited by 6
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectivescited by 5
- 2025TrajEvo: Trajectory Prediction Heuristics Design via LLM-driven Evolutioncited by 5
- 2024A Physics-guided Generative AI Toolkit for Geophysical Monitoringcited by 2
- 2023Using Unsupervised and Supervised Learning and Digital Twin for Deep Convective Ice Storm Classificationcited by 1
- 2024Digital Twin Calibration for Biological System-of-Systems: Cell Culture Manufacturing Processcited by 1
- 2024Uncertainty in Supply Chain Digital Twins: A Quantum-Classical Hybrid Approachcited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMscited by 1
- 2026From Digital Twins to World Models:Opportunities, Challenges, and Applications for Mobile Edge General Intelligencecited by 0
- 2026Beyond Thermal Imaging: Inferring Thermophysical Properties from Time-Resolved Thermal Observationscited by 0
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstructioncited by 0
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstruction28 Sep 2026
- 2026Beyond Thermal Imaging: Inferring Thermophysical Properties from Time-Resolved Thermal Observations8 Jul 2026
- 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMs29 May 2026
- 2026From Digital Twins to World Models:Opportunities, Challenges, and Applications for Mobile Edge General Intelligence18 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2020Machine learning based digital twin for dynamical systems with multiple time-scales
- 2024Constructing and Evaluating Digital Twins: An Intelligent Framework for DT Development
- 2025Position: Foundation Models Need Digital Twin Representations
- 2025Hybrid Modeling, Sim-to-Real Reinforcement Learning, and Large Language Model Driven Control for Digital Twins
- 2026Agentic Digital Twins: A Taxonomy of Capabilities for Understanding Possible Futures
- 2025Bridging the Reality Gap in Digital Twins with Context-Aware, Physics-Guided Deep Learning
- 2026Foundation Twins: A New Generation of Power Systems Digital Twins using Foundation AI Models ↗
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI