mlsanityData to 7 Oct 2026

MantisV2: Closing the Zero-Shot Gap in Time Series Classification with Synthetic Data and Test-Time Strategies

arXiv 2602.17868 ↗First posted 19 Feb 2026cs.LG cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

Developing foundation models for time series classification is of high practical relevance, as such models can serve as universal feature extractors for diverse downstream tasks. Although early models such as Mantis have shown the promise of this approach, a substantial performance gap remained between frozen and fine-tuned encoders. In this work, we introduce methods that significantly strengthen zero-shot feature extraction for time series. First, we introduce Mantis+, a variant of Mantis pre-trained entirely on synthetic time series. Second, through controlled ablation studies, we refine the architecture and obtain MantisV2, an improved and more lightweight encoder. Third, we propose an enhanced test-time methodology that leverages intermediate-layer representations and refines output-token aggregation. In addition, we show that performance can be further improved via self-ensembling and cross-model embedding fusion. Extensive experiments on UCR, UEA, Human Activity Recognition (HAR) benchmarks, and EEG datasets show that MantisV2 and Mantis+ consistently outperform prior time series foundation models, achieving state-of-the-art zero-shot performance.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 56 of its 82 references that are in the map. First posted on arXiv 19 Feb 2026.

Builds on

56 of 82 references.

References · 56

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2023GPT-4 Technical Reportcited by 18,132
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  7. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  8. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  9. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  10. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  11. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  12. 2022A ConvNet for the 2020scited by 3,545
38 more
  1. 2020GLU Variants Improve Transformercited by 1,724
  2. 2017Decoupled Weight Decay Regularizationcited by 1,722
  3. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  4. 2019Root Mean Square Layer Normalizationcited by 1,425
  5. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  6. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
  7. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  8. 2018Deep learning for time series classification: a reviewcited by 575
  9. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
  10. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
  11. 2018The UCR Time Series Archivecited by 421
  12. 2016Time Series Classification from Scratch with Deep Neural Networks: A Strong Baselinecited by 358
  13. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
  14. 2018The UEA multivariate time series classification archive, 2018cited by 330
  15. 2024xLSTM: Extended Long Short-Term Memorycited by 320
  16. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 293
  17. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
  18. 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 267
  19. 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 246
  20. 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
  21. 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
  22. 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
  23. 2020Current Time Series Anomaly Detection Benchmarks are Flawed and are Creating the Illusion of Progresscited by 148
  24. 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 107
  25. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 93
  26. 2024VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasterscited by 87
  27. 2025This Time is Different: An Observability Perspective on Time Series Foundation Modelscited by 57
  28. 2022WOODS: Benchmarks for Out-of-Distribution Generalization in Time Seriescited by 29
  29. 2018Towards a universal neural network encoder for time seriescited by 28
  30. 2025Mantis: Lightweight Foundation Model for Time Series Classificationcited by 21
  31. 2023NuTime: Numerically Multi-Scaled Embedding for Large-Scale Time-Series Pretrainingcited by 20
  32. 2025AdaPTS: Adapting Univariate Foundation Models to Probabilistic Multivariate Time Series Forecastingcited by 15
  33. 2025ZARA: Training-Free Motion Time-Series Reasoning via Evidence-Grounded LLM Agentscited by 13
  34. 2020EMOPAIN Challenge 2020: Multimodal Pain Evaluation from Facial and Bodily Expressionscited by 11
  35. 2023StockEmotions: Discover Investor Emotions for Financial Sentiment Analysis and Multivariate Time Seriescited by 9
  36. 2025Pre-trained Forecasting Models: Strong Zero-Shot Feature Extractors for Time Series Classificationcited by 9
  37. 2022Fast and Robust Video-Based Exercise Classification via Body Pose Tracking and Scalable Multivariate Time Series Classifierscited by 8
  38. 2025COMODO: Cross-Modal Video-to-IMU Distillation for Efficient Egocentric Human Activity Recognitioncited by 8

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Unsupervised Statistical Feature-Guided Diffusion Model for Sensor-based Human Activity Recognition
  2. 2026MedMamba: Recasting Mamba for Medical Time Series Classification
  3. 2026InstructTime++: Time Series Classification with Multimodal Language Modeling via Implicit Feature Enhancement
  4. 2025Time Series Similarity Score Functions to Monitor and Interact with the Training and Denoising Process of a Time Series Diffusion Model applied to a Human Activity Recognition Dataset based on IMUs
  5. 2025Channel-Imposed Fusion: A Simple yet Effective Method for Medical Time Series Classification
  6. 2026Prototype-Guided Classification Sub-Task Decoupling Framework: Enhancing Generalization and Interpretability for Multivariate Time Series
  7. 2026ALER-TI: Aligned Latent Embedding Retrieval for Time Series Imputation
  8. 2025Towards Generalizable Human Activity Recognition: A Survey