mlsanityData to 14 Oct 2026

Multiscale Representation Enhanced Temporal Flow Fusion Model for Long-Term Workload Forecasting

arXiv 2407.19697 ↗First posted 29 Jul 2024cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Accurate workload forecasting is critical for efficient resource management in cloud computing systems, enabling effective scheduling and autoscaling. Despite recent advances with transformer-based forecasting models, challenges remain due to the non-stationary, nonlinear characteristics of workload time series and the long-term dependencies. In particular, inconsistent performance between long-term history and near-term forecasts hinders long-range predictions. This paper proposes a novel framework leveraging self-supervised multiscale representation learning to capture both long-term and near-term workload patterns. The long-term history is encoded through multiscale representations while the near-term observations are modeled via temporal flow fusion. These representations of different scales are fused using an attention mechanism and characterized with normalizing flows to handle non-Gaussian/non-linear distributions of time series. Extensive experiments on 9 benchmarks demonstrate superiority over existing methods.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 27 of its 53 references that are in the map. First posted on arXiv 29 Jul 2024.

Builds on

27 of 53 references.

References · 27

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  3. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  4. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
  5. 2015Variational Inference with Normalizing Flowscited by 2,170
  6. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  7. 2016Density estimation using Real NVPcited by 2,042
  8. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  9. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  10. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
  11. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  12. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
15 more
  1. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  2. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 471
  3. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 453
  4. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
  5. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 345
  6. 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 250
  7. 2020Time Series Change Point Detection with Self-Supervised Contrastive Predictive Codingcited by 58
  8. 2023TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoderscited by 44
  9. 2020FIRM: An Intelligent Fine-Grained Resource Management Framework for SLO-Oriented Microservicescited by 41
  10. 2023Prompt-augmented Temporal Point Process for Streaming Event Sequencecited by 24
  11. 2023Monotonic Neural Ordinary Differential Equation: Time-series Forecasting for Cumulative Datacited by 9
  12. 2023Task-Driven Causal Feature Distillation: Towards Trustworthy Risk Predictioncited by 9
  13. 2022Hierarchical Capsule Prediction Network for Marketing Campaigns Effectcited by 5
  14. 2022End-to-End Modeling Hierarchical Time Series Using Autoregressive Transformer and Conditional Normalizing Flow based Reconciliationcited by 4
  15. 2022Atrapos: Real-time Evaluation of Metapath Query Workloadscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.