mlsanityData to 14 Oct 2026

Grounding Time-Series Foundation Models in Digital Twin Topology for Predictive Maintenance

arXiv 2609.40071 ↗First posted 30 Sep 2026eess.SP cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Digital twins increasingly support downstream analytical tasks that depend on time-series data, motivating interest in time-series foundation models (TSFMs) as scalable backbones. However, TSFMs are primarily pretrained for temporal continuation and often underperform on unseen tasks such as regression, and systematic empirical comparisons against state-of-the-art dedicated models in digital twin contexts remain limited. This paper makes three contributions. First, we benchmark five well-known TSFMs with frozen backbones on remaining useful life (RUL) prediction using the C-MAPSS dataset, finding that multivariate architectures substantially outperform univariate ones, particularly under varying operating conditions. This raises a deeper question: when cross-channel dependencies can be modeled through pretrained weights, target-task adaptation, and digital twin-derived representations, how much does each contribute, and are they complementary? Second, we propose a topology-informed fusion approach in which topological constraints, derived from the asset structure the digital twin stores among its information models, explicitly shape cross-attention, so that fused representations respect the physical system's local connectivity rather than relying on unconstrained all-to-all interactions. Third, we conduct an ablation study across C-MAPSS subsets of varying operational complexity that isolates the three sources and their interactions. The sources prove complementary rather than redundant, and topology-constrained attention outperforms unconstrained fusion, though by a small margin, enabling a frozen TSFM informed by digital twin representations to remain competitive or in some cases exceed state-of-the-art performance on this regression task.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 73 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

24 of 73 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  5. 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 787
  6. 2023A decoder-only foundation model for time-series forecastingcited by 692
  7. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  8. 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 239
  9. 2023The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecastingcited by 101
  10. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 94
  11. 2020A Probabilistic Graphical Model Foundation for Enabling Predictive Digital Twins at Scalecited by 58
  12. 2020Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Modelscited by 49
12 more
  1. 2021Neural Networks with Physics-Informed Architectures and Constraints for Dynamical Systems Modelingcited by 41
  2. 2019Physics-guided Convolutional Neural Network (PhyCNN) for Data-driven Seismic Response Modelingcited by 40
  3. 2022On the Power of Foundation Modelscited by 37
  4. 2024A Survey of Deep Learning and Foundation Models for Time Series Forecastingcited by 33
  5. 2020A No-Free-Lunch Theorem for MultiTask Learningcited by 28
  6. 2024Enhancing Foundation Models for Time Series Forecasting via Wavelet-based Tokenizationcited by 27
  7. 2022A Comprehensive Review of Digital Twin -- Part 2: Roles of Uncertainty Quantification and Optimization, a Battery Digital Twin, and Perspectivescited by 18
  8. 2025AdaPTS: Adapting Univariate Foundation Models to Probabilistic Multivariate Time Series Forecastingcited by 15
  9. 2022The Digital Twin Landscape at the Crossroads of Predictive Maintenance, Machine Learning and Physics Based Modelingcited by 4
  10. 2023State-of-the-art review and synthesis: A requirement-based roadmap for standardized predictive maintenance automation using digital twin technologiescited by 4
  11. 2024State-of-the-Art Review: The Use of Digital Twins to Support Artificial Intelligence-Guided Predictive Maintenancecited by 2
  12. 2026In-context Pre-trained Time-Series Foundation Models adapt to Unseen Taskscited by 1

Built on by

Not cited yet.