mlsanityData to 7 Oct 2026

Interpretable Water Level Forecaster with Spatiotemporal Causal Attention Mechanisms

arXiv 2303.00515 ↗First posted 28 Feb 2023cs.LG stat.MEcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate forecasting of river water levels is vital for effectively managing traffic flow and mitigating the risks associated with natural disasters. This task presents challenges due to the intricate factors influencing the flow of a river. Recent advances in machine learning have introduced numerous effective forecasting methods. However, these methods lack interpretability due to their complex structure, resulting in limited reliability. Addressing this issue, this study proposes a deep learning model that quantifies interpretability, with an emphasis on water level forecasting. This model focuses on generating quantitative interpretability measurements, which align with the common knowledge embedded in the input data. This is facilitated by the utilization of a transformer architecture that is purposefully designed with masking, incorporating a multi-layer network that captures spatiotemporal causation. We perform a comparative analysis on the Han River dataset obtained from Seoul, South Korea, from 2016 to 2021. The results illustrate that our approach offers enhanced interpretability consistent with common knowledge, outperforming competing methods and also enhances robustness against distribution shift.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 54 references that are in the map. First posted on arXiv 28 Feb 2023.

Builds on

16 of 54 references.

References · 16

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020End-to-End Object Detection with Transformerscited by 7,384
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  4. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  5. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
  6. 2016Language Modeling with Gated Convolutional Networkscited by 688
  7. 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 270
  8. 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
  9. 2020Representation Learning via Invariant Causal Mechanismscited by 197
  10. 2018Anchor regression: heterogeneous data meets causalitycited by 116
  11. 2023Dish-TS: A General Paradigm for Alleviating Distribution Shift in Time Series Forecastingcited by 91
  12. 2013Multilayer Networkscited by 86
4 more
  1. 2017Deep Regression Forests for Age Estimationcited by 35
  2. 2017Improving Palliative Care with Deep Learningcited by 28
  3. 2021SST-GNN: Simplified Spatio-temporal Traffic forecasting model using Graph Neural Networkcited by 9
  4. 2021Extreme Precipitation Seasonal Forecast Using a Transformer Neural Networkcited by 2

Built on by

Not cited yet.