mlsanityData to 14 Oct 2026

Neural Additive Models for Nowcasting

arXiv 2205.10020 ↗First posted 20 May 2022cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Deep neural networks (DNNs) are one of the most highlighted methods in machine learning. However, as DNNs are black-box models, they lack explanatory power for their predictions. Recently, neural additive models (NAMs) have been proposed to provide this power while maintaining high prediction performance. In this paper, we propose a novel NAM approach for multivariate nowcasting (NC) problems, which comprise an important focus area of machine learning. For the multivariate time-series data used in NC problems, explanations should be considered for every input value to the variables at distinguishable time steps. By employing generalized additive models, the proposed NAM-NC successfully explains each input value's importance for multiple variables and time steps. Experimental results involving a toy example and two real-world datasets show that the NAM-NC predicts multivariate time-series data as accurately as state-of-the-art neural networks, while also providing the explanatory importance of each input value. We also examine parameter-sharing networks using NAM-NC to decrease their complexity, and NAM-MC's hard-tied feature net extracted explanations with good performance.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 22 of its 41 references that are in the map. First posted on arXiv 20 May 2022.

Builds on

22 of 41 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  5. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  6. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  7. 2018YOLOv3: An Incremental Improvementcited by 2,659
  8. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  9. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  10. 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
  11. 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,133
  12. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
10 more
  1. 2018Efficient Neural Architecture Search via Parameter Sharingcited by 837
  2. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 508
  3. 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 375
  4. 2017Methods for Interpreting and Understanding Deep Neural Networkscited by 345
  5. 2020Neural Additive Models: Interpretable Machine Learning with Neural Netscited by 319
  6. 2020Rethinking Positional Encoding in Language Pre-trainingcited by 197
  7. 2018Temporal Pattern Attention for Multivariate Time Series Forecastingcited by 125
  8. 2020TimeSHAP: Explaining Recurrent Models through Sequence Perturbationscited by 74
  9. 2017Autoregressive Convolutional Neural Networks for Asynchronous Time Seriescited by 31
  10. 2021NeuralProphet: Explainable Forecasting at Scalecited by 22

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 2.

3 papers.