vLinear: A Powerful Linear Model for Multivariate Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
In this paper, we present vLinear, an effective yet efficient linear-based multivariate time series forecaster featuring two components: the vecTrans module and the WFMLoss objective. Many state-of-the-art forecasters rely on self-attention or its variants to capture multivariate correlations, typically incurring O(N2) computational complexity with respect to the number of variates N. To address this, we propose vecTrans, a lightweight module that utilizes a learnable vector to model multivariate correlations, reducing the complexity to O(N). Notably, vecTrans can be seamlessly integrated into Transformer-based forecasters, delivering up to 5× inference speedups and consistent performance gains. Furthermore, we introduce WFMLoss (Weighted Flow Matching Loss) as the objective. In contrast to typical velocity-oriented flow matching objectives, we demonstrate that a final-series-oriented formulation yields significantly superior forecasting accuracy. WFMLoss also incorporates path- and horizon-weighted strategies to focus learning on more reliable paths and horizons. Empirically, vLinear achieves state-of-the-art performance across 22 benchmarks and 124 forecasting settings. Moreover, WFMLoss serves as an effective plug-and-play objective, consistently improving existing forecasters. The code is available at https://anonymous.4open.science/r/vLinear.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 45 of its 57 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
45 of 57 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
33 more
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
- 2021Nystr"omformer: A Nystr"om-Based Algorithm for Approximating Self-Attentioncited by 471
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
- 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 338
- 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 337
- 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 283
- 2023FITS: Modeling Time Series with 10k Parameterscited by 195
- 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
- 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 172
- 2023FLatten Transformer: Vision Transformer using Focused Linear Attentioncited by 171
- 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 116
- 2024FreDF: Learning to Forecast in the Frequency Domaincited by 79
- 2022Flowformer: Linearizing Transformers with Conservation Flowscited by 69
- 2023CARD: Channel Aligned Robust Blend Transformer for Time Series Forecastingcited by 55
- 2024FilterNet: Harnessing Frequency Filters for Time Series Forecastingcited by 47
- 2025DBLoss: Decomposition-based Loss Function for Time Series Forecastingcited by 45
- 2024SAMformer: Unlocking the Potential of Transformers in Time Series Forecasting with Sharpness-Aware Minimization and Channel-Wise Attentioncited by 44
- 2024Revitalizing Multivariate Time Series Forecasting: Learnable Decomposition with Inter-Series Dependencies and Intra-Series Variations Modelingcited by 44
- 2025Enhancing Time Series Forecasting through Selective Representation Spaces: A Patch Perspectivecited by 39
- 2025Temporal Query Network for Efficient Multivariate Time Series Forecastingcited by 31
- 2025OLinear: A Linear Model for Time Series Forecasting in Orthogonally Transformed Domaincited by 26
- 2025FreEformer: Frequency Enhanced Transformer for Multivariate Time Series Forecastingcited by 18
- 2025TimePro: Efficient Multivariate Long-term Time Series Forecasting with Variable- and Time-Aware Hyper-statecited by 16
- 2024Sub-Adjacent Transformer: Improving Time Series Anomaly Detection with Reconstruction Error from Sub-Adjacent Neighborhoodscited by 10
- 2025NeuTSFlow: Modeling Continuous Functions Behind Time Series Forecastingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024VE: Modeling Multivariate Time Series Correlation with Variate Embedding
- 2026ProtoFlow: Prototype-Guided Flow Matching for Multivariate Time Series Forecasting
- 2025S2TX: Cross-Attention Multi-Scale State-Space Transformer for Time Series Forecasting
- 2024CMamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecasting
- 2024MultiCast: Zero-Shot Multivariate Time Series Forecasting Using LLMs
- 2025Benchmarking M-LTSF: Frequency and Noise-Based Evaluation of Multivariate Long Time Series Forecasting Models
- 2025DualSG: A Dual-Stream Explicit Semantic-Guided Multivariate Time Series Forecasting Framework
- 2025DC-Mamber: A Dual Channel Prediction Model based on Mamba and Linear Transformer for Multivariate Time Series Forecasting