mlsanityData to 7 Oct 2026

LineupRL: Verifiable Reinforcement Learning for Time Series Captioning via Caption-to-Series Identification

arXiv 2610.01800 ↗First posted 1 Oct 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Time series captioning is a fundamental step in time series understanding and can also serve as the bridge between signal and natural language. Supervised fine-tuning (SFT) relies on a larger model's captions and cannot exceed their quality. Reinforcement learning (RL) can, but its rewards were designed for other modalities and other tasks, and they transfer poorly to open-ended generation in the time series domain. We address this by proposing LineupRL, a reinforcement learning with verifiable rewards (RLVR) pipeline whose reward is caption-to-series identification. The reward model is a frozen large language model (LLM) verifier that reads the generated caption and the candidate time series as raw values, never the chart, and must pick the described time series from multiple distractors. Matching is a far lighter demand on the verifier than writing questions or judging a caption, so an off-the-shelf LLM can supply the reward. Across two captioning benchmarks, and on forecasting and reconstruction where the predictor sees only the caption, LineupRL outperforms SFT and RL baselines on every metric. The 3B vision language model (VLM) trained by LineupRL also outperforms, at 1/24 of the parameters, the 72B VLM whose captions the SFT baseline is distilled from. Our case study shows that LineupRL resists reward hacking, and that the captioner it trains both traces the trend and names the values at key points.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 58 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

45 of 58 references.

References · 45

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  5. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  6. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
  7. 2016Self-critical Sequence Training for Image Captioningcited by 544
  8. 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
  9. 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 268
  10. 2025RL's Razor: Why Online Reinforcement Learning Forgets Lesscited by 162
  11. 2025EmbeddingGemma: Powerful and Lightweight Text Representationscited by 128
  12. 2016Improved Image Captioning via Policy Gradient optimization of SPIDErcited by 112
33 more
  1. 2025Reinforcement Learning with Rubric Anchorscited by 108
  2. 2024ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoningcited by 95
  3. 2024Language Models Still Struggle to Zero-shot Reason about Time Seriescited by 81
  4. 2022Fine-grained Image Captioning with CLIP Rewardcited by 69
  5. 2018Discriminability objective for training descriptive captionscited by 67
  6. 2014Automatic Construction and Natural-Language Description of Nonparametric Regression Modelscited by 40
  7. 2024Evaluating Large Language Models on Time Series Feature Understanding: A Comprehensive Taxonomy and Benchmarkcited by 38
  8. 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 36
  9. 2024Decoding Time Series with LLMs: A Multi-Agent Framework for Cross-Domain Annotationcited by 21
  10. 2025T2S: High-resolution Time Series Generation with Text-to-Series Diffusion Modelscited by 19
  11. 2024VLRM: Vision-Language Models act as Reward Models for Image Captioningcited by 18
  12. 2025TimeMaster: Training Time-Series Multimodal LLMs to Reason via Reinforcement Learningcited by 16
  13. 2023Cross-Domain Image Captioning with Discriminative Finetuningcited by 14
  14. 2021Truth-Conditional Captioning of Time Series Datacited by 11
  15. 2025Time Series Language Model for Descriptive Caption Generationcited by 11
  16. 2025BEDTime: A Unified Benchmark for Automatically Describing Time Seriescited by 11
  17. 2026RubiCap: Rubric-Guided Reinforcement Learning for Dense Image Captioningcited by 9
  18. 2019Reinforcing an Image Caption Generator Using Off-Line Human Feedbackcited by 7
  19. 2025CaTS-Bench: Can Language Models Describe Time Series?cited by 7
  20. 2026CCCaption: Dual-Reward Reinforcement Learning for Complete and Correct Image Captioningcited by 7
  21. 2024XForecast: Evaluating Natural Language Explanations for Time Series Forecastingcited by 4
  22. 2026Can we generate portable representations for clinical time series data using LLMs?cited by 4
  23. 2025TADACap: Time-series Adaptive Domain-Aware Captioningcited by 3
  24. 2026Chart-RL: Generalized Chart Comprehension via Reinforcement Learning with Verifiable Rewardscited by 3
  25. 2026ClaimDiff-RL: Fine-Grained Caption Reinforcement Learning through Visual Claim Comparisoncited by 3
  26. 2024Distinctive Image Captioning: Leveraging Ground Truth Captions in CLIP Guided Reinforcement Learningcited by 2
  27. 2026BalCapRL: A Balanced Framework for RL-Based MLLM Image Captioningcited by 2
  28. 2026TimeSRL: Generalizable Time-Series Behavioral Modeling via Semantic RL-Tuned LLMs -- A Case Study in Mental Healthcited by 2
  29. 2026Rethinking Post-Training Recipes for Multimodal Time-Series Forecastingcited by 2
  30. 2020Human-like Time Series Summaries via Trend Utility Estimationcited by 1
  31. 2025Language Bottleneck Models for Qualitative Knowledge State Modelingcited by 1
  32. 2026Decoupling Perception from Description: Computation-Grounded Representation Alignment between Multivariate Time Series and Languagecited by 1
  33. 2026SafeCap: Improving LVLM Safety with Image Captioning Reinforcement Learningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioning
  2. 2026Adaptive Time Series Reasoning via Segment Selection
  3. 2026Time Series Reasoning via Process-Verifiable Thinking Data Synthesis and Scheduling for Tailored LLM Reasoning
  4. 2026What Do Verifiable Rewards Teach Video-Language Models About Time? A Controlled Multi-Model Study
  5. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Models
  6. 2026TimeThink: Eliciting Compositional Reasoning in Timeseries Large Language Models
  7. 2024Towards Time Series Reasoning with LLMs
  8. 2026KairosVL: Orchestrating Time Series and Semantics for Unified Reasoning