mlsanityData to 14 Oct 2026

KENN: Enhancing Deep Neural Networks by Leveraging Knowledge for Time Series Forecasting

arXiv 2202.03903 ↗First posted 8 Feb 2022cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

End-to-end data-driven machine learning methods often have exuberant requirements in terms of quality and quantity of training data which are often impractical to fulfill in real-world applications. This is specifically true in time series domain where problems like disaster prediction, anomaly detection, and demand prediction often do not have a large amount of historical data. Moreover, relying purely on past examples for training can be sub-optimal since in doing so we ignore one very important domain i.e knowledge, which has its own distinct advantages. In this paper, we propose a novel knowledge fusion architecture, Knowledge Enhanced Neural Network (KENN), for time series forecasting that specifically aims towards combining strengths of both knowledge and data domains while mitigating their individual weaknesses. We show that KENN not only reduces data dependency of the overall framework but also improves performance by producing predictions that are better than the ones produced by purely knowledge and data driven domains. We also compare KENN with state-of-the-art forecasting methods and show that predictions produced by KENN are significantly better even when trained on only 50% of the data.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 44 references that are in the map. First posted on arXiv 8 Feb 2022.

Builds on

16 of 44 references.

References · 16

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
  3. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
  4. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  5. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 607
  6. 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 576
  7. 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 569
  8. 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 434
  9. 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
  10. 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 180
  11. 2019Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecastingcited by 161
  12. 2020Cross-Layer Distillation with Semantic Calibrationcited by 143
4 more
  1. 2016Harnessing Deep Neural Networks with Logic Rulescited by 135
  2. 2019Towards Better Forecasting by Fusing Near and Distant Future Visionscited by 14
  3. 2019Forecaster: A Graph Transformer for Forecasting Spatial and Time-Dependent Datacited by 11
  4. 2018Correlated Time Series Forecasting using Deep Neural Networks: A Summary of Resultscited by 2

Built on by

Not cited yet.