mlsanityData to 14 Oct 2026

Beyond Magnitude and Shape: A Direction-Aware Loss for Time Series Forecasting

arXiv 2608.01857 ↗First posted 3 Aug 2026cs.LG cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

The direction of change --- whether a series will move up or down --- is often as important as its exact value in decisiondriven applications such as risk management and financial forecasting. However, most forecasting losses optimize either point magnitude or shape and frequency structure, and none explicitly targets the direction of change. In this paper, we find that MSE-trained forecasters fail on the direction of small moves. To address this, we propose CosDir, a simple yet effective direction-aware loss that aligns the difference vectors of the prediction and the target via cosine similarity. Being scale-invariant, CosDir keeps a directional gradient on small moves, re-injecting learning signal exactly where MSE neglects it. CosDir is a lightweight, plug-in term that attaches to any backbone without architectural modification. Since the best ratio for mixing the directional and magnitude terms differs across datasets, we further propose CosDir-UW, an extension that makes this ratio adaptive by learning it during training, matching a per-dataset tuned weight with no hyperparameter. We conduct over 100K experiments, demonstrating that our method consistently and significantly improves directional accuracy while preserving magnitude accuracy, and that it outperforms various loss functions. Code is available at: https://github.com/seunghan96/cosdir.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

16 of 26 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  5. 2020Reformer: The Efficient Transformercited by 1,668
  6. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
  7. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  8. 2017Smart "Predict, then Optimize"cited by 339
  9. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 332
  10. 2017Soft-DTW: a Differentiable Loss Function for Time-Seriescited by 271
  11. 2020Fast Differentiable Sorting and Rankingcited by 197
  12. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 160
4 more
  1. 2024FreDF: Learning to Forecast in the Frequency Domaincited by 79
  2. 2019Shape and Time Distortion Loss for Training Deep Time Series Forecasting Modelscited by 70
  3. 2020Applications of deep learning in stock market prediction: recent progresscited by 51
  4. 2023Mean Absolute Directional Loss as a New Loss Function for Machine Learning Problems in Algorithmic Investment Strategiescited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.