mlsanityData to 14 Oct 2026

Learning Soft Sparse Shapes for Efficient Time-Series Classification

arXiv 2505.06892 ↗First posted 11 May 2025cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

Shapelets are discriminative subsequences (or shapes) with high interpretability in time series classification. Due to the time-intensive nature of shapelet discovery, existing shapelet-based methods mainly focus on selecting discriminative shapes while discarding others to achieve candidate subsequence sparsification. However, this approach may exclude beneficial shapes and overlook the varying contributions of shapelets to classification performance. To this end, we propose a Soft sparse Shapes (SoftShape) model for efficient time series classification. Our approach mainly introduces soft shape sparsification and soft shape learning blocks. The former transforms shapes into soft representations based on classification contribution scores, merging lower-scored ones into a single shape to retain and differentiate all subsequence information. The latter facilitates intra- and inter-shape temporal pattern learning, improving model efficiency by using sparsified soft shapes as inputs. Specifically, we employ a learnable router to activate a subset of class-specific expert networks for intra-shape pattern learning. Meanwhile, a shared expert network learns inter-shape patterns by converting sparsified shapes into sequences. Extensive experiments show that SoftShape outperforms state-of-the-art methods and produces interpretable results.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 33 of its 56 references that are in the map. First posted on arXiv 11 May 2025.

Builds on

33 of 56 references.

References · 33

  1. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  2. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  4. 2018Attention-based Deep Multiple Instance Learningcited by 1,095
  5. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  6. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  7. 2021Scaling Vision with Sparse Mixture of Expertscited by 747
  8. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  9. 2022Mixture-of-Experts with Expert Choice Routingcited by 623
  10. 2018Deep learning for time series classification: a reviewcited by 576
  11. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 453
  12. 2018The UCR Time Series Archivecited by 431
21 more
  1. 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 399
  2. 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
  3. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 345
  4. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
  5. 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
  6. 2021HIVE-COTE 2.0: a new meta ensemble for time series classificationcited by 118
  7. 2023Bake off redux: a review and experimental evaluation of recent time series classification algorithmscited by 101
  8. 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 99
  9. 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 95
  10. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 94
  11. 2024TSLANet: Rethinking Transformers for Time Series Representation Learningcited by 74
  12. 2023Deep Learning for Time Series Classification and Extrinsic Regression: A Current Surveycited by 68
  13. 2022HYDRA: Competing convolutional kernels for fast and accurate time series classificationcited by 54
  14. 2023A Survey on Time-Series Pre-Trained Modelscited by 52
  15. 2023LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation -- Extended Versioncited by 50
  16. 2023Patch-level Routing in Mixture-of-Experts is Provably Sample-efficient for Convolutional Neural Networkscited by 35
  17. 2023Mixture-of-Linear-Experts for Long-term Time Series Forecastingcited by 29
  18. 2023Inherently Interpretable Time Series Classification via Multiple Instance Learningcited by 23
  19. 2021Random Dilated Shapelet Transform: A New Approach for Time Series Shapeletscited by 22
  20. 2024Graph Mixture of Experts and Memory-augmented Routers for Multivariate Time Series Anomaly Detectioncited by 20
  21. 2024Abstracted Shapes as Tokens -- A Generalizable and Interpretable Model for Time-series Classificationcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 8.

10 papers.