mlsanityData to 7 Oct 2026

Joint Hypergraph Rewiring and Memory-Augmented Forecasting Techniques in Digital Twin Technology

arXiv 2408.12634 ↗First posted 22 Aug 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Digital Twin technology creates virtual replicas of physical objects, processes, or systems by replicating their properties, data, and behaviors. This advanced technology offers a range of intelligent functionalities, such as modeling, simulation, and data-driven decision-making, that facilitate design optimization, performance estimation, and monitoring operations. Forecasting plays a pivotal role in Digital Twin technology, as it enables the prediction of future outcomes, supports informed decision-making, minimizes risks, driving improvements in efficiency, productivity, and cost reduction. Recently, Digital Twin technology has leveraged Graph forecasting techniques in large-scale complex sensor networks to enable accurate forecasting and simulation of diverse scenarios, fostering proactive and data-driven decision making. However, existing Graph forecasting techniques lack scalability for many real-world applications. They have limited ability to adapt to non-stationary environments, retain past knowledge, lack a mechanism to capture the higher order spatio-temporal dynamics, and estimate uncertainty in model predictions. To surmount the challenges, we introduce a hybrid architecture that enhances the hypergraph representation learning backbone by incorporating fast adaptation to new patterns and memory-based retrieval of past knowledge. This balance aims to improve the slowly-learned backbone and achieve better performance in adapting to recent changes. In addition, it models the time-varying uncertainty of multi-horizon forecasts, providing estimates of prediction uncertainty. Our forecasting architecture has been validated through ablation studies and has demonstrated promising results across multiple benchmark datasets, surpassing state-ofthe-art forecasting methods by a significant margin.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 34 references that are in the map. First posted on arXiv 22 Aug 2024.

Builds on

21 of 34 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2016Layer Normalizationcited by 5,579
  4. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  5. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  6. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  7. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  8. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  9. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  10. 2016Language Modeling with Gated Convolutional Networkscited by 688
  11. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
  12. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
9 more
  1. 2018Neural Relational Inference for Interacting Systemscited by 339
  2. 2021Graph Neural Network-Based Anomaly Detection in Multivariate Time Seriescited by 300
  3. 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 212
  4. 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 209
  5. 2021Graph Neural Controlled Differential Equations for Traffic Forecastingcited by 133
  6. 2021Z-GCNETs: Time Zigzags at Graph Convolutional Networks for Time Series Forecastingcited by 67
  7. 2022Learning to Reconstruct Missing Data from Spatiotemporal Graphs with Sparse Observationscited by 64
  8. 2019STG2Seq: Spatial-temporal Graph to Sequence Model for Multi-step Passenger Demand Forecastingcited by 59
  9. 2022Sparse Graph Learning from Spatiotemporal Time Seriescited by 22

Built on by

Not cited yet.