MantisV2: Closing the Zero-Shot Gap in Time Series Classification with Synthetic Data and Test-Time Strategies
Not on the map. Why?
Abstract (arXiv)
Developing foundation models for time series classification is of high practical relevance, as such models can serve as universal feature extractors for diverse downstream tasks. Although early models such as Mantis have shown the promise of this approach, a substantial performance gap remained between frozen and fine-tuned encoders. In this work, we introduce methods that significantly strengthen zero-shot feature extraction for time series. First, we introduce Mantis+, a variant of Mantis pre-trained entirely on synthetic time series. Second, through controlled ablation studies, we refine the architecture and obtain MantisV2, an improved and more lightweight encoder. Third, we propose an enhanced test-time methodology that leverages intermediate-layer representations and refines output-token aggregation. In addition, we show that performance can be further improved via self-ensembling and cross-model embedding fusion. Extensive experiments on UCR, UEA, Human Activity Recognition (HAR) benchmarks, and EEG datasets show that MantisV2 and Mantis+ consistently outperform prior time series foundation models, achieving state-of-the-art zero-shot performance.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 56 of its 82 references that are in the map. First posted on arXiv 19 Feb 2026.
Builds on
56 of 82 references.
References · 56
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022A ConvNet for the 2020scited by 3,545
38 more
- 2020GLU Variants Improve Transformercited by 1,724
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2018Deep learning for time series classification: a reviewcited by 575
- 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
- 2018The UCR Time Series Archivecited by 421
- 2016Time Series Classification from Scratch with Deep Neural Networks: A Strong Baselinecited by 358
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
- 2018The UEA multivariate time series classification archive, 2018cited by 330
- 2024xLSTM: Extended Long Short-Term Memorycited by 320
- 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 293
- 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
- 2025TabICL: A Tabular Foundation Model for In-Context Learning on Large Datacited by 267
- 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 246
- 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
- 2024CBraMod: A Criss-Cross Brain Foundation Model for EEG Decodingcited by 188
- 2025Chronos-2: From Univariate to Universal Forecastingcited by 158
- 2020Current Time Series Anomaly Detection Benchmarks are Flawed and are Creating the Illusion of Progresscited by 148
- 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 107
- 2024UniTS: A Unified Multi-Task Time Series Modelcited by 93
- 2024VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasterscited by 87
- 2025This Time is Different: An Observability Perspective on Time Series Foundation Modelscited by 57
- 2022WOODS: Benchmarks for Out-of-Distribution Generalization in Time Seriescited by 29
- 2018Towards a universal neural network encoder for time seriescited by 28
- 2025Mantis: Lightweight Foundation Model for Time Series Classificationcited by 21
- 2023NuTime: Numerically Multi-Scaled Embedding for Large-Scale Time-Series Pretrainingcited by 20
- 2025AdaPTS: Adapting Univariate Foundation Models to Probabilistic Multivariate Time Series Forecastingcited by 15
- 2025ZARA: Training-Free Motion Time-Series Reasoning via Evidence-Grounded LLM Agentscited by 13
- 2020EMOPAIN Challenge 2020: Multimodal Pain Evaluation from Facial and Bodily Expressionscited by 11
- 2023StockEmotions: Discover Investor Emotions for Financial Sentiment Analysis and Multivariate Time Seriescited by 9
- 2025Pre-trained Forecasting Models: Strong Zero-Shot Feature Extractors for Time Series Classificationcited by 9
- 2022Fast and Robust Video-Based Exercise Classification via Body Pose Tracking and Scalable Multivariate Time Series Classifierscited by 8
- 2025COMODO: Cross-Modal Video-to-IMU Distillation for Efficient Egocentric Human Activity Recognitioncited by 8
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026GlucoFM: A Dual-Stream Foundation Model for Continuous Glucose Monitoringcited by 4
- 2026RocketPFN: Accurate Time Series Classification via In-Context Learningcited by 4
- 2026LeNEPA: No-Augmentation Next-Latent Prediction for Time-Series Representation Learningcited by 3
- 2026CORTEG: Foundation Models Enable Cross-Modality Representation Transfer from Scalp to Intracranial Brain Recordingscited by 1
- 2026AnyMo: Geometry-Aware Setup-Agnostic Modeling of Human Motion in the Wildcited by 1
- 2026Unlocking the Forecasting Economy: A Suite of Datasets for the Full Lifecycle of Prediction Market: [Experiments & Analysis]cited by 0
- 2026TimEE: End-to-end Time Series Classification via In-Context Learningcited by 0
- 2026TRACE-TS: Attribution-Grounded and Traceable Sensor-Language Reasoning for Human Activity Understandingcited by 0
- 2026ChorusTIC: Training-Free Multivariate Time Series Classification via Chorus In-Context Learningcited by 0
- 2026Rondo: Unsupervised Discovery of Recurring Temporal Structurecited by 0
- 2026Rondo: Unsupervised Discovery of Recurring Temporal Structure26 Sep 2026
- 2026ChorusTIC: Training-Free Multivariate Time Series Classification via Chorus In-Context Learning25 Aug 2026
- 2026TRACE-TS: Attribution-Grounded and Traceable Sensor-Language Reasoning for Human Activity Understanding31 Jul 2026
- 2026TimEE: End-to-end Time Series Classification via In-Context Learning8 Jul 2026
- 2026LeNEPA: No-Augmentation Next-Latent Prediction for Time-Series Representation Learning1 Jul 2026
- 2026RocketPFN: Accurate Time Series Classification via In-Context Learning19 Jun 2026
- 2026GlucoFM: A Dual-Stream Foundation Model for Continuous Glucose Monitoring29 May 2026
- 2026AnyMo: Geometry-Aware Setup-Agnostic Modeling of Human Motion in the Wild21 May 2026
- 2026CORTEG: Foundation Models Enable Cross-Modality Representation Transfer from Scalp to Intracranial Brain Recordings11 May 2026
- 2026Unlocking the Forecasting Economy: A Suite of Datasets for the Full Lifecycle of Prediction Market: [Experiments & Analysis]22 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2023Unsupervised Statistical Feature-Guided Diffusion Model for Sensor-based Human Activity Recognition
- 2026MedMamba: Recasting Mamba for Medical Time Series Classification
- 2026InstructTime++: Time Series Classification with Multimodal Language Modeling via Implicit Feature Enhancement
- 2025Time Series Similarity Score Functions to Monitor and Interact with the Training and Denoising Process of a Time Series Diffusion Model applied to a Human Activity Recognition Dataset based on IMUs
- 2025Channel-Imposed Fusion: A Simple yet Effective Method for Medical Time Series Classification
- 2026Prototype-Guided Classification Sub-Task Decoupling Framework: Enhancing Generalization and Interpretability for Multivariate Time Series
- 2026ALER-TI: Aligned Latent Embedding Retrieval for Time Series Imputation
- 2025Towards Generalizable Human Activity Recognition: A Survey