mlsanityData to 7 Oct 2026

SciTS: Scientific Time Series Understanding and Generation with LLMs

arXiv 2510.03255 ↗First posted 26 Sep 2025cs.LG cs.AIcited by 13

On the map: LLM reasoning → Time series reasoning

Abstract (arXiv)

The scientific reasoning ability of large language models (LLMs) has recently attracted significant attention. Time series, as a fundamental modality in scientific data, presents unique challenges that are often overlooked in current multimodal LLMs, which either encode numerical sequences as text or convert them into images. Such approaches may be insufficient for comprehensive scientific time series understanding and generation. Existing unified time series models typically specialise in either forecasting or analysis, and their effectiveness on non-periodic, heterogeneous scientific signals remains unclear. To address these gaps, we introduce SciTS, a benchmark spanning 12 scientific domains and 43 tasks, with over 50k+ instances, both univariate and multivariate signals ranging from 100 to 107 in length and up to 10~MHz in frequency. We benchmark 17 models, including text-only LLMs, multimodal LLMs, and unified time series models, and find that general-purpose LLMs exhibit stronger generalisability than specialised time series models, while representing time series as text or images limits their performance due to excessively long sequences and loss of numerical precision, respectively. We then introduce TimeOmni, a framework that equips LLMs with the ability to understand and generate time series while remaining compatible with general-purpose LLM training. This work fills a gap in both dedicated benchmarks and modelling frameworks for scientific time series, paving the way for LLMs to understand and generate complex temporal scientific data.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Time series reasoning, one of 17 directions in LLM reasoning. Builds on 48 of its 65 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

48 of 65 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025MTBench: A Multimodal Time Series Benchmark for Temporal Reasoning and Question Answering21 Mar
  2. 2025TempoGPT: Enhancing Time Series Reasoning via Quantizing Embedding13 Jan
  3. 2024ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoning4 Dec

Other references · 45

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  6. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  8. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
  9. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  10. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  11. 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 740
  12. 2024Chronos: Learning the Language of Time Seriescited by 712
33 more
  1. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  2. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  3. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 333
  4. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 280
  5. 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 163
  6. 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 113
  7. 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 105
  8. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 93
  9. 2024From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflectioncited by 93
  10. 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 88
  11. 2024Timer-XL: Long-Context Transformers for Unified Time Series Forecastingcited by 83
  12. 2021Real-time gravitational-wave science with neural posterior estimationcited by 76
  13. 2025Time-MQA: Time Series Multi-Task Question Answering with Context Enhancementcited by 74
  14. 2024Time-MMD: Multi-Domain Multimodal Dataset for Time Series Analysiscited by 65
  15. 2024TimeSeriesExam: A time series understanding examcited by 47
  16. 2024Can LLMs Understand Time Series Anomalies?cited by 41
  17. 2025Context-Alignment: Activating and Enhancing LLM Capabilities in Time Seriescited by 34
  18. 2025TimeCAP: Learning to Contextualize, Augment, and Predict Time Series Events with Large Language Model Agentscited by 33
  19. 2025Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoningcited by 33
  20. 2022Out-of-Distribution Representation Learning for Time Series Classificationcited by 30
  21. 2022Neural Importance Sampling for Rapid and Reliable Gravitational-Wave Inferencecited by 28
  22. 2023Model scale versus domain knowledge in statistical forecasting of chaotic systemscited by 27
  23. 2023TACTiS-2: Better, Faster, Simpler Attentional Copulas for Multivariate Time Seriescited by 25
  24. 2023Probabilistic Imputation for Time-series Classification with Missing Datacited by 21
  25. 2024Real-time gravitational-wave inference for binary neutron stars using machine learningcited by 21
  26. 2023MST-GAT: A Multimodal Spatial-Temporal Graph Attention Network for Time Series Anomaly Detectioncited by 20
  27. 2025T2S: High-resolution Time Series Generation with Text-to-Series Diffusion Modelscited by 19
  28. 2021Multi-task Learning Approach for Automatic Modulation and Wireless Signal Classificationcited by 17
  29. 2025The iNaturalist Sounds Datasetcited by 17
  30. 2021MIMII DUE: Sound Dataset for Malfunctioning Industrial Machine Investigation and Inspection with Domain Shifts due to Changes in Operational and Environmental Conditionscited by 9
  31. 2025FinMultiTime: A Four-Modal Bilingual Dataset for Financial Time-Series Analysiscited by 7
  32. 2025S4M: S4 for multivariate time series forecasting with Missing valuescited by 6
  33. 2023Multi-stage Learning for Radar Pulse Activity Segmentationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026TimeSeriesExamAgent: Creating Time Series Reasoning Benchmarks at Scale
  2. 2023Large Language Models Are Zero-Shot Time Series Forecasters
  3. 2025When LLM Meets Time Series: Can LLMs Perform Multi-Step Time Series Reasoning and Inference
  4. 2025TimeSense:Making Large Language Models Proficient in Time-Series Analysis
  5. 2025Toward Reasoning-Centric Time-Series Analysis
  6. 2025Adapting LLMs to Time Series Forecasting via Temporal Heterogeneity Modeling and Representation Alignment
  7. 2026Rethinking the Role of LLMs in Time Series Forecasting
  8. 2026Representing Time Series as Structured Programs for LLM Reasoning