mlsanityData to 14 Oct 2026

Towards Robust Time Series Learning via Capacity-Centric Modulation

arXiv 2609.39489 ↗First posted 30 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Sample-level reliability heterogeneity is common in deep time series learning. Standard training pipelines apply a uniform regularization setting to all samples, which can under-regularize corrupted samples and over-restrict clean samples. Common robustness approaches filter observations in data space or impose priors on latent representations. We propose Capacity-Centric Modulation (CCM) as a complementary, sample-adaptive regularization principle. Under this principle, we introduce SACM (Sample-Adaptive Capacity Modulation), a task-agnostic framework that exploits spectral sparsity to assign sample-wise dropout probabilities along internal activation paths. SACM integrates into existing backbones without architectural redesign and preserves the deterministic inference pipeline. Across 301 real-world dataset-backbone pairs covering 9 forecasting, 32 classification, and 4 anomaly-detection datasets, SACM reduces forecasting MSE by 6.7% on average and improves classification accuracy and point-adjusted F1 by 3.04% and 17.05%, respectively, relative to unmodified backbones, with zero test-time overhead.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 59 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

40 of 59 references.

References · 40

  1. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  2. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  5. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  6. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  7. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  8. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  9. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  10. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
  11. 2015Variational Dropout and the Local Reparameterization Trickcited by 490
  12. 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 410
28 more
  1. 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 394
  2. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
  3. 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
  4. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  5. 2018The UEA multivariate time series classification archive, 2018cited by 338
  6. 2017Concrete Dropoutcited by 227
  7. 2022TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Datacited by 214
  8. 2020MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classificationcited by 190
  9. 2020A review on outlier/anomaly detection in time series datacited by 189
  10. 2019Time-Series Anomaly Detection Service at Microsoftcited by 165
  11. 2020Current Time Series Anomaly Detection Benchmarks are Flawed and are Creating the Illusion of Progresscited by 151
  12. 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
  13. 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 139
  14. 2023DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detectioncited by 103
  15. 2013Dropout Training as Adaptive Regularizationcited by 93
  16. 2025TimeFilter: Patch-Specific Spatial-Temporal Graph Filtration for Time Series Forecastingcited by 64
  17. 2022Towards Spatio-Temporal Aware Traffic Time Series Forecasting--Full Versioncited by 59
  18. 2023A Survey on Time-Series Pre-Trained Modelscited by 52
  19. 2024WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecastingcited by 26
  20. 2022Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection---Extended Versioncited by 19
  21. 2024RobustTSF: Towards Theory and Design of Robust Time Series Forecasting with Anomaliescited by 18
  22. 2023Towards Long-Term Time-Series Forecasting: Feature, Pattern, and Distributioncited by 15
  23. 2023Label-Free Multivariate Time Series Anomaly Detectioncited by 14
  24. 2025Selective Learning for Deep Time Series Forecastingcited by 8
  25. 2023Data Optimization in Deep Learning: A Surveycited by 6
  26. 2025Not All Data are Good Labels: On the Self-supervised Labeling for Time Series Forecastingcited by 4
  27. 2024LogoRA: Local-Global Representation Alignment for Robust Time Series Classificationcited by 3
  28. 2026DropoutTS: Sample-Adaptive Dropout for Robust Time Series Forecastingcited by 3

Built on by

Not cited yet.