TimeInteract: Towards Real-Time Interactive Intelligence for Streaming Time Series
Not on the map. Why?
Abstract (arXiv)
Real-world time series evolve continuously, with meaningful changes potentially emerging at any moment. However, existing time-series language models (TSLMs) remain inherently static. They either receive complete sequences for offline processing or alternate between streaming input and response generation, which prevents processing of new observations during interaction. We introduce a new regime, Time-Series Interaction: a model continuously perceives incoming time-series observations and user intent, autonomously decides when to remain silent or respond, and continues processing new observations during response generation. To realize this, we develop TimeInteract with three key designs: a dual-view streaming TS encoder that captures local variations and historical dynamics, a response control mechanism that learns when to trigger a response, and a decoupled streaming inference mechanism that separates control from response generation to avoid blocking subsequent observations. We further formulate a hierarchy of interaction capabilities, progressing from Understanding to Adaptivity. Based on this hierarchy, we construct StreamTSI-34K, a large-scale streaming TS interaction dataset with 34,588 episodes and 77,505 responses across synthetic and real-world time series in single- and multi-turn settings. Across all four interaction levels, TimeInteract consistently outperforms existing LLMs, VLMs, and TSLMs, with gains of up to 23.92 points on challenging tasks. It also improves response triggering while achieving near-zero stream stall and up to 2.15× inference speedup.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 34 of its 58 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
34 of 58 references.
References · 34
- 2025Qwen3 Technical Reportcited by 8,510
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,658
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,452
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 693
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 623
- 2024DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Servingcited by 602
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 550
- 2024Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Servecited by 514
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 497
- 2024Mini-Omni: Language Models Can Hear, Talk While Thinking in Streamingcited by 207
- 2024Llumnix: Dynamic Scheduling for Large Language Model Servingcited by 169
- 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 166
22 more
- 2022Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognitioncited by 141
- 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 137
- 2024Large Language Models for Time Series: A Surveycited by 114
- 2024TimeCMA: Towards LLM-Empowered Multivariate Time Series Forecasting via Cross-Modality Alignmentcited by 103
- 2024ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoningcited by 97
- 2024From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflectioncited by 96
- 2025Time-MQA: Time Series Multi-Task Question Answering with Context Enhancementcited by 79
- 2024TimeSeriesExam: A time series understanding examcited by 48
- 2025OpenTSLM: Time-Series Language Models for Reasoning over Multivariate Medical Text- and Time-Series Datacited by 33
- 2026It's TIME: Towards the Next Generation of Time Series Forecasting Benchmarkscited by 28
- 2025TimeOmni-1: Incentivizing Complex Reasoning with Time Series in Large Language Modelscited by 26
- 2026TSRBench: A Comprehensive Multi-task Multi-modal Time Series Reasoning Benchmark for Generalist Modelscited by 16
- 2026JoyAI-VL-Interaction: Real-Time Vision-Language Interaction Intelligencecited by 12
- 2025SensorChat: Answering Qualitative and Quantitative Questions during Long-Term Multimodal Sensor Interactionscited by 11
- 2025From Turn-Taking to Synchronous Dialogue: A Survey of Full-Duplex Spoken Language Modelscited by 9
- 2026Think While Watching: Online Streaming Segment-Level Memory for Multi-Turn Video Reasoning in Multimodal Large Language Modelscited by 7
- 2026A Survey of Full-Duplex Spoken Dialogue Systems: Architectural Hierarchy, Interaction Ontology, and Decision State Machinecited by 6
- 2026GlucoFM: A Dual-Stream Foundation Model for Continuous Glucose Monitoringcited by 5
- 2026TimeSage-MT: A Multi-Turn Benchmark for Evaluating Agentic Time Series Reasoningcited by 5
- 2025TsLLM: Augmenting LLMs for General Time Series Understanding and Predictioncited by 4
- 2026Audio Interaction Modelcited by 4
- 2026TLive-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streamingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Recognition to Understanding: Unlocking Cognitive Time Series Reasoning with LLMs
- 2025TS-Agent: Understanding and Reasoning Over Raw Time Series via Iterative Insight Gathering
- 2026StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding
- 2026Thoth: Mid-Training Bridges LLMs to Time Series Understanding
- 2025TimeSense:Making Large Language Models Proficient in Time-Series Analysis
- 2025The language of time: a language model perspective on time-series foundation models
- 2026OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants
- 2025AlphaCast: A Human Wisdom-LLM Intelligence Co-Reasoning Framework for Interactive Time Series Forecasting